ReviveXR

Inspiration

ReviveXR was born from a deeply personal mission. Immanual, our founder, dedicated his career to healthy aging—beginning with his PhD research on cellular senescence and continuing through his work in senior care services.

The mission became urgent and profoundly personal when his own mother began experiencing the progression of Alzheimer’s disease.

Witnessing firsthand the isolation and cognitive decline associated with neurodegenerative conditions, we asked a critical question:

Can immersive technology be used not just for distraction, but for healing?

This question became the foundation of ReviveXR—bridging cutting-edge VR/MR technology with compassionate, therapeutic care.

What ReviveXR Does

ReviveXR offers a growing collection of therapeutic VR/MR activities and 40Hz gamma-entrainment 360° video sessions, specifically designed for individuals with:

Alzheimer’s Disease
Stroke rehabilitation
Traumatic Brain Injury (TBI)
Mild Cognitive Impairment (MCI)

Every experience features 40Hz light stimulation, supporting cognitive activation and neural engagement.

AI Companion – Mimi

At the heart of ReviveXR is our AI-driven conversational avatar, Mimi—a personalized therapeutic companion for seniors. Users interact with Mimi inside a virtual lobby where she:

Recommends suitable activities and videos
Tracks user progress
Answers questions about performance and completion
Provides emotional companionship

Mimi's Operational Modes

Mode	Description	Key Feature
Online Mode	Real-time conversational AI with internet access	Emotional awareness and natural interruptions
Offline Mode	Ultra-low-latency, fully local AI for facilities with no internet access	Near-instant, natural, and lifelike responses

Content Delivery & Progress Tracking

The complete content library exceeds 50GB.
The app remains lightweight at installation.
Users download only the activities and videos they need—either manually or via Mimi’s recommendations.

Progress Tracking Includes:

Level completion
Number of moves in memory games
Video watch duration

Users can view completion percentages directly in the lobby or ask Mimi for real-time updates.

Current Content Library

8+ interactive therapeutic activities
30+ immersive 360° videos
All experiences support hand tracking as the primary interaction method

Core Activities

1. Memory Match Game (Memory Training)

Memory Match Dragons is a 3D memory game featuring friendly dragon characters.
Players advance through five levels with increasing grid sizes—from 3×2 to 6×5 tiles.
Each tile reveals a unique dragon with distinct textures and colors.

2. Quest Mart (Cognitive Training)

A virtual shopping experience where seniors navigate a realistic store environment using simple step-based teleportation.
Users visit sections such as Dairy, Produce, and Bakery to complete shopping tasks that strengthen memory, planning, and attention.

3. Kitchen Quest (Physical & Motor Training)

A therapeutic VR/MR cooking experience designed for stroke and TBI rehabilitation.
It encourages: Bilateral hand coordination, step-by-step planning, and motor sequencing.
Users prepare simple meals (soups, entrées, desserts, and drinks) through guided recipes with clear visual cues.

4. Hummingbird MR Experience (Physical & Motor Training)

A passthrough mixed-reality experience that brings lifelike hummingbirds into the user’s real-world environment.
Seniors interact with the birds using simple hand gestures such as waving or pinching, encouraging gentle arm movement and coordination.

5. Hummingbird VR Experience (Physical & Motor Training)

A fully immersive garden environment where users observe and interact with hummingbirds within a serene 3D world.
Ambient nature sounds, lush visuals, and natural bird behaviors enhance relaxation and sensory engagement.

6. Orbs Game (Memory & Coordination Training)

Users slice colored orbs to train bilateral coordination and reaction timing.
The color of each orb determines which hand or direction should be used.
Red orbs must be avoided to encourage impulse control.

7. Color Match Game (Memory & Coordination Training)

Users grab and mix falling orbs of different colors to create a color presented to them
When a color match is achieved, a new color challenge is presented
Users engage in physical coordination and memory, planning and attention

8. Interactive Bible story experience (Spiritual Relaxation)

Users are presented with four different physical environments to choose from
When an environment is chosen, users are presented with a randomized * calming narration of Bible passages*

Video Library

These therapeutic and relaxation videos enhanced with 40-hertz are each 1 hour long and divided into 2–3 smaller sessions for flexible therapy scheduling:

AI Fantasy
Candlelight Meditation
Serenade of Flowers
A Culinary Journey
Delta Lullaby
Monuments and Natural Wonders
Italy: Rome to Ravello
A Tryst with Nature
Sweet Snuggles
VR360 forest and city walks

How We Built It

1. Hybrid AI Architecture (Cloud + Edge)

We developed a dual-brain AI system to ensure uninterrupted companionship:

Online Mode (Real-time AI): Uses the OpenAI Realtime API for low-latency voice conversations with emotional awareness and natural interruptions.
Offline Mode (Privacy-First AI): Powered by Alibaba’s MNN (Mobile Neural Network) framework, enabling fast, fully local AI inference on the Quest headset with zero data leakage.

2. Real-Time Voice Pipeline (Offline Version)

The offline pipeline uses localized models for near-instant response:

Speech-to-Text: Local Whisper models with continuous listening and silence detection.
Intent Classification: TensorFlow BERT-based custom intent router.
Text-to-Speech: Localized emotional TTS for natural voice responses.

3. Modular Content Delivery

We use Unity Addressables and Unity Cloud Content Delivery (CCD) to distribute activities and videos as downloadable modules, keeping the base app lightweight and scalable.

4. Activities Development

We used the following for development:

Meta All-in-One SDKs
MR Utility Kit (MRUK)
Advanced hand tracking and passthrough features

Each activity was carefully optimized for performance, accessibility, and therapeutic value.

Challenges We Faced

Native MNN Integration: Required custom Android-to-Unity native plugins with advanced memory and thread management.
Android Audio Issues: Built custom permission handling and crash-safe microphone recovery pipelines.
Performance Optimization: Balanced real-time AI (cloud and offline) with high-quality VR rendering while maintaining 60 FPS on Quest.

Our Key Accomplishments

Successfully deployed offline MNN-powered AI on Meta Quest.
Built seamless switching between online and offline AI.
Completed a 4-month clinical feasibility study of 40Hz VR therapy in Alzheimer’s patients with high adherence and positive results.
Applied for two patents covering the usage of 40hertz in XR and AI-driven VR-avatar recommendation system

What We Learned

VR is not just for gaming: The senior health sector is rapidly embracing immersive, non-drug therapy.
Every megabyte matters: Mobile VR demands ruthless optimization to support AI workloads.