First Photorealistic AI Avatar for People Living with Alzheimer’s and Dementia Launched by Lenovo and Innovations in Dementia
First Photorealistic AI Avatar for People Living with Alzheimer’s and Dementia Launched by Lenovo and Innovations in Dementia
Manila, Philippines, October 30, 2024 – Lenovo™, in collaboration with Innovations in Dementia, has launched a groundbreaking project at Lenovo Tech World on October 15. Named “Alzheimer’s Intelligence,” this initiative introduces a photorealistic 3D avatar powered by custom AI, offering unprecedented support for individuals and families navigating the complexities of dementia and Alzheimer’s. This proof-of-concept project provides 24-hour access to a conversational avatar, designed to offer curated advice that prioritizes accuracy, privacy, and compassion.
Dr. David Llewellyn, Professor of Clinical Epidemiology and Digital Health at the University of Exeter, highlighted the project’s global significance: “There are approximately 55 million people living with dementia worldwide, and this number is projected to reach 139 million by 2050. Lenovo’s ‘Alzheimer’s Intelligence’ initiative exemplifies how AI advancements can enhance human interaction, providing a valuable tool to support individuals living with dementia today and in the future.”
In this pioneering application, Lenovo has leveraged its comprehensive portfolio of technology solutions, from individual to enterprise, to create the Alzheimer’s Intelligence project. This initiative aggregates firsthand experiences and advice from hundreds of people living with dementia and Alzheimer’s into a responsive, photoreal 3D avatar capable of engaging in unscripted, natural conversations. As a result, individuals diagnosed with dementia are just a click away from a real-time conversational resource and aid.
Doug Fisher, Chief Security and AI Officer at Lenovo, emphasized the ethical considerations in developing this technology: “With recent and ever-growing advancements in AI, it is crucial to harness this technology purposefully and responsibly, especially for communities that may be overlooked by innovative technology. Our commitment to delivering Smarter AI for All involves developing and deploying technology that empowers everyone on every scale.”
The avatar, named “Liv,” was created using a composite of images from ten individuals living with dementia. Generative AI extrapolated thousands of facial expressions and angles from these images, which were then blended with the face of a filmed performer to create a lifelike avatar.
A large language model (LLM) dataset powers Liv’s responses, compiled from data provided by individuals with dementia, including entries from the Dementia Diaries project and in-depth panel interviews. When a user asks a question (via speech-to-text), the LLM queries the dataset to generate text-based answers, expressed using the avatar’s persona and knowledge base. These replies are then voiced using a custom vocal synth. Sentiment analysis is applied to analyze the underlying emotion of the response, which is reflected in Liv’s facial expressions. Real-time 4K visual AI ensures the avatar’s speech appears natural and synchronized.
Alzheimer’s Intelligence provides newly diagnosed patients with a resource to ask questions only someone with lived experience can answer. First Photorealistic AI Avatar this includes addressing day-to-day challenges, discussing the disease with family, and exploring new hobbies. The project was designed to be accessible, requiring minimal technical expertise and prioritizing natural, familiar interactions.
Currently, the avatar is being trialed in a controlled environment with people living with dementia, with the goal of broader public availability in the future. The Alzheimer’s Intelligence project offers an innovative way to access valuable insights based on real experiences while ensuring no medical advice is given. This was achieved by working closely with Dr. Llewellyn and Innovations in Dementia, who both advised and consulted on the avatar’s development and testing.
Lenovo’s technology, services, software, servers, and cloud solutions powered this innovative project. Kaleida, Lenovo’s tech partner, led the development of the avatar and underlying AI, leveraging Lenovo’s AI professional services for security and process support. Key devices and solutions include the ThinkStation P7 server, ThinkPad T14s Gen 6, ThinkPad X1 Carbon Gen 12, Lenovo Legion monitors, and accessories.
Steve Milton, Director of Innovations in Dementia, emphasized the importance of the AI’s supportive role: “When people are first diagnosed with dementia, they often feel lost with many questions about what is happening. This AI doesn’t replace human contact but offers a knowledgeable and compassionate source of assurance and advice based directly on the experiences and wisdom of other people with dementia.”
Innovations in Dementia reports that approximately 20% of their clients are under 65 and may live with the condition for many years. The NGO promotes a positive but realistic view of dementia, emphasizing that while it is life-changing, it is not life-ending.
Doug Fisher reaffirmed Lenovo’s commitment to inclusive innovation: “We recognize the importance of giving everyone a voice in innovation. With huge advancements in AI and smarter technologies, now is the time to explore and pilot creative new ways to use technology thoughtfully and responsibly for the greater good.”
Focus group participants Gail Gregory and Ahmad Krayem highlighted the avatar’s importance. Gregory, diagnosed with Alzheimer’s at 55, stressed the need for realism and relatability in the avatar, while Krayem, diagnosed in his early 60s, emphasized the value of shared experiences in helping others newly diagnosed.
Alzheimer’s Intelligence is a proof-of-concept tool and is not yet publicly available. For more information or to connect with individuals living with dementia, contact Innovations in Dementia (UK) or the Alzheimer’s Association (US).
To find out more visit https://www.lenovo.com, and read about the latest news via our StoryHub.
