Lenovo Unveils Pioneering AI Avatar to Support Dementia Sufferers

Image Credit: Lenovo‍

Technology giant Lenovo has launched the first-ever photorealistic 3D avatar powered by custom AI, designed to assist dementia patients and their families.

This proof-of-concept initiative, developed in collaboration with Innovations in Dementia, provides 24/7 access to a conversational avatar that provides tailored advice to users.

The avatar is currently undergoing trials with individuals living with dementia in a controlled setting, aiming for future public availability.

Leveraging AI from Lenovo’s extensive portfolio, this technology incorporates insights and advice from hundreds of individuals living with Alzheimer’s to create ‘Liv,’ a responsive, photorealistic 3D avatar capable of engaging in unscripted, natural conversations.

A large language model (LLM) dataset, built from the experiences of those living with Alzheimer’s, underpins the advice that Liv can impart.

When a user asks a question using speech-to-text, the LLM queries its dataset to generate a text-based response in Liv's persona, based on her knowledge base. Sentiment analysis assesses the emotional tone of the response, which is mirrored in Liv's facial expressions. Real-time 4K visual AI ensures that Liv appears to speak synchronously with the generated audio.

The avatar itself was developed using a composite of images from 10 individuals living with Alzheimer’s. Generative AI extrapolated thousands of additional expressions and angles from these initial poses, creating a comprehensive dataset. This data was then blended with the face of a filmed performer to produce Liv.

This project is the first time Lenovo's AI-ready solutions have been combined to develop an avatar of this kind.

The potential of AI innovations in the Alzheimer's space is expanding, as highlighted by FMAI's recent report on a new AI-powered app from Otsuka Precision Health and Amalgam. This app is designed to support caregivers by providing essential assistance for Alzheimer's patients.

With Lenovo’s app currently undergoing private testing, it remains to be seen whether it will be released to the public and how the broader community will respond to its adoption.

‍Examples of interactions with the avatar:

Q: I keep forgetting to take my pills. How can I remember?

‍A: It's quite common to forget things like taking medication. Perhaps setting a routine could help, like taking your pills with a meal or at the same time each day. You could also try setting an alarm or reminder on your phone. There are pill organisers, too, which can be useful. Would one of those options suit you, do you think?

‍Q: How do I talk about my diagnosis with friends and family?

‍A: Talking about your diagnosis with friends and family can be a daunting task, but it can also help to bring support and understanding. Start by sharing how you feel today and maybe a bit about what you've learned about your condition. Encourage them to ask any questions, as this can help them understand what you're going through. It’s okay to be honest about any fears or concerns you have, as well. Do you think that might be helpful?