Researchers from Korea Advanced Institute of Science and Technology and Naver AI Lab developed an app called AACessTalk that helps parents communicate with minimally verbal autistic children.
These children mainly communicate through gestures and facial expressions, using only a few words. Symbol cards help but are limited to basic needs like "I'm hungry" or "I'm cold." This often isn't enough to express thoughts or start a conversation. Parents struggle to encourage their children's initiative and turn simple requests into real dialogues.
💬 How The App Works
AACessTalk runs on a tablet with a connected button that helps children take turns in conversations. When the child presses the button, they can indicate "My turn" or "I'm done."
The parent starts by choosing a topic. Then GPT-4 analyzes what they said and figures out the direction of the conversation. When it's the child's turn, the app shows images matching the topic and context, using past conversations and the child's interests to choose the most relevant.
Parents get gentle prompts with ideas on how to respond. Suppose the parent says something too critical or complicated. In that case, the AI gently alerts parents that it might not be helpful for communication. The system learns as it goes and adjusts to the child's mood, behavior, and communication style.
💬 Conversations That Didn't Happen Before
The team tested the app for two weeks with 11 families. The results were better than expected: kids became more active in conversations and sometimes even started them on their own.
Parents changed as well. They asked fewer questions and listened more.
"It felt like we were really talking for the first time," one mom said after the trial.
Next, the team plans to explore how the AI could help other children with developmental differences.
More on the topic:
🟣 How AI is Helping Detect Autism
🟣 AI-Powered Glasses That "Read" Emotions and Count Calories
#news #health @hiaimediaen