EmotiQuest

EmotiQuest is a VR game that helps neurodivergent children practice emotion recognition via interactive storytelling. Using UE and MetaHuman, we create a safe, engaging way to learn social skills!

Comment

Inspiration

Did you know that, according to Centers for Disease Control and Prevention, 1 in 36 children is diagnosed with Autism Spectrum Disorder (ASD)? ASD is a complex developmental condition involving persistent challenges with social communication, restricted interests and repetitive behavior. Meanwhile, recent systematic review has shown promise in utilizing XR technologies for social and emotional skills learning. XR has been reported to enhance user motivation, increase attention to the desired target, and maximize learning efficiency!

What it does

Imagine a world where neurodivergent children can practice social skills in a safe, engaging, and interactive way. That’s exactly what EmotiQuest offers! Built with Unreal Engine and powered by MetaHuman’s advanced facial animation, our VR game helps children with Autism Spectrum Disorder recognize and respond to emotions through dynamic storytelling. Players interact with Amelia, their virtual friend, identifying his feelings and choosing appropriate responses—all while having fun! With XR technology showing promise in emotional learning, EmotiQuest is a step toward making social communication more accessible for neurodivergent individuals. Join us in revolutionizing emotional fluency training—one virtual conversation at a time!

How we built it

EmotiQuest runs on Unreal Engine 5.5.4, leveraging the MetaHuman API to create realistic, expressive facial animations that accurately convey human emotions. We used Blueprint and LipSync scripting to integrate the emotion recognition mechanics, ensuring a smooth and immersive player experience. Voice interactions were enhanced with AI-powered text-to-speech, making the game feel more natural and engaging.

Challenges we ran into

Building a real-time emotional interaction system was tricky—we had to balance realism with computational efficiency while keeping the experience engaging for children. Integrating MetaHuman facial animations within Unreal Engine in a way that felt fluid and intuitive took significant iteration. Another challenge was designing an intuitive and accessible interface for neurodivergent children while ensuring the gameplay mechanics remained engaging and educational.

Accomplishments that we're proud of

•Developing a functional prototype within just 36 hours, showcasing the potential of VR for social-emotional learning.

•Successfully implementing facial expression modeling using MetaHuman to create realistic emotional cues.

•Designing an engaging and scientifically informed learning experience tailored for children with Autism Spectrum Disorder (ASD).

•Creating a visually appealing and interactive VR environment that enhances emotional fluency and recognition skills.

What we learned

•The power of immersive technology in neurodiversity-focused interventions.

•How to optimize MetaHuman assets for real-time applications in Unreal Engine.

•The importance of emotionally adaptive storytelling—the way an NPC delivers a story can significantly impact player engagement and learning outcomes.

•How to effectively collaborate under intense time constraints in a hackathon setting.

What's next for EmotiQuest

✅ Expanding the range of emotions and adding more dynamic storytelling elements. ✅ Refining the user interface and accessibility features to better suit a diverse range of neurodivergent players. ✅ Exploring machine learning-based emotion adaptation, where the game dynamically adjusts difficulty based on player performance. ✅ Conducting pilot testing with educators and therapists to evaluate the real-world impact and refine the tool accordingly.

References

[1] “Autism is Expensive - Hope For Three.” Accessed: Mar. 23, 2025. [Online]. Available: https://hopeforthree.org/autism-is-expensive/ [2] “Social difficulties in autism spectrum disorder,” KU SOE. Accessed: Mar. 23, 2025. [Online]. Available: https://educationonline.ku.edu/community/social-difficulties-in-autism-spectrum-disorder [3] "Poglitsch, C., Safikhani, S., List, E., & Pirker, J. (2024). XR technologies to enhance the emotional skills of people with autism spectrum disorder: A systematic review. Computers and Graphics (Pergamon), 121, Article 103942. https://doi.org/10.1016/j.cag.2024.103942" [4] "Data and statistics on autism spectrum disorder. (2024, May 16). Autism Spectrum Disorder (ASD). https://www.cdc.gov/autism/data-research/index.html"

Built With

Share this project:

Updates