Panic Button: Real-Time Immersive Panic Management

Background:

When someone has a peanut allergy, we reach for an EpiPen—it’s immediate, effective, and life-saving. But during a panic attack, there’s no equivalent go-to solution. People are left feeling helpless in a moment of acute stress, unsure of how to regain control. That’s where we come in: a personalized, simple tool that dynamically helps individuals manage and diffuse panic when they need it most.

Inspiration

The Panic Button project was inspired by a growing need for tools that can provide immediate, evidence-based relief during moments of acute stress or panic attacks. Traditional therapeutic approaches often lack the ability to adapt dynamically to a user's state in real time, leaving a critical gap in moments of urgency.

Our collaboration with Dr. Patrick Thomas, a clinical psychologist specializing in anxiety and stress disorders, brought invaluable insight into this challenge. Drawing on his expertise and current research in immersive therapy, we sought to create a system that not only reduces stress during critical moments but also empowers users to better understand and manage their emotional well-being over time.

What it does

Panic Button is an immersive therapy tool designed to detect, monitor, and respond to stress and panic in real time. Its key features include:

Real-Time Monitoring: Tracks brainwave activity (EEG), heart rate (ECG), and body discomfort using advanced sensor technology and an AI-enabled camera. Three-Tier Stress Evaluation System: Classifies stress levels into three stages—green (calm), yellow (moderate stress), and red (panic)—and initiates appropriate therapeutic protocols. Guided Calming Experience: Employs a virtual bird companion that guides the user visually through focus exercises, rhythmic breathing cues, and soothing audio, helping lower stress levels effectively. Dynamic Feedback Loop: Continuously tracks physiological changes to evaluate the effectiveness of interventions and refine future responses. Exit Protocol: Provides a safe, structured transition from a heightened state of panic back to calm, ensuring users feel supported every step of the way.

How we built it

Hardware Integration Combined the Oculus Quest headset with EEG and ECG sensors to capture physiological data. Incorporated an AI-driven camera to assess body discomfort based on posture and movements.
Software Development Leveraged Unity to design an engaging 3D environment, scripting interactive therapeutic experiences that adapt in real time. Developed algorithms to process raw EEG and ECG data into actionable stress-level classifications, mapped to the three-tier system.
Clinical Insights Integrated guidance from clinical experts to ensure alignment with evidence-based stress and panic management practices. Incorporated breathing techniques and visual focus exercises that are commonly used in cognitive-behavioral therapy (CBT).
User Experience Design Designed a calming environment where users interact with a virtual bird, promoting mindfulness and relaxation. Added responsive audio and visual cues to reinforce safety, calm, and focus.

Challenges we ran into

Hardware Compatibility: OpenBCI EEG sensors required a desktop app to function, complicating integration with the Meta Quest.
Data Processing: Translating raw physiological signals into meaningful, actionable feedback demanded significant calibration and testing.
Immersion vs. Simplicity: Crafting a VR experience that was both engaging and non-overwhelming required continuous refinement.
to make use of the Qualcomm Rb3 for the Live Video image analysis and computation , we ran into environment and dependency issues on the rb3 board, that was taking long to resolve , and we eventually switched to raspberry pi to use the controller and run the computation on the board, ( the dependency issues could be resolved if there was more time, and not dependent on only just one kind of board for the implementation.

Accomplishments that we're proud of

Simplified Data Representation: Translated complex EEG, ECG, and video data into a user-friendly, real-time feedback system. Seamless Integration: Successfully combined multiple data streams into a cohesive VR experience, demonstrating the power of interdisciplinary design. Dynamic, Personalized Therapy: Developed a tool that adapts to user states, helping them feel calm, safe, and in control during moments of acute stress. Clinical Relevance: Created a system grounded in evidence-based practices, showcasing immersive therapy's potential as a transformative healthcare tool.

What we learned

1.Collaboration is Key: Merging clinical insights with technical expertise results in solutions that are both practical and innovative. 2.The Power of Personalization: Tailored therapeutic interventions lead to significantly better user engagement and outcomes. 3.Simplified Interfaces Work: For tools targeting emotional well-being, clarity and accessibility are as important as functionality. 4.Data is Only Part of the Story: The real value lies in how raw data is used to create meaningful, actionable experiences for users.

the hardware , immersive tech and software combination to bring out tech savy solutions

What’s Next for Panic Button

We envision a future where Panic Button can evolve into a widely accessible tool that supports mental health in diverse settings. Here’s what’s next:

Enhanced Metrics: Incorporate additional sensors, such as pulse oximetry and temperature monitors, for a richer understanding of stress responses.
Remote Capabilities: Expand Panic Button for at-home and workplace use, enabling users to manage stress outside clinical environments.
AI-Powered Personalization: Use machine learning to adapt therapeutic protocols based on individual preferences, history, and real-time responses.
Scalability: Simplify the system for deployment in resource-limited settings, such as schools or community centers.
Clinical Validation: Partner with hospitals and research institutions to conduct clinical trials and refine the tool for broader therapeutic adoption.

References and Further Reading

Picamera2 Documentation: https://github.com/raspberrypi/picamera2
OpenBCI EEG Sensor Overview : https://www.opensourceimaging.org/project/openbci/
Unity for VR Development
Cognitive-Behavioral Therapy Techniques: https://positivepsychology.com/cbt-cognitive-behavioral-therapy-techniques-worksheets/
Immersive Therapy Research
By combining state-of-the-art hardware with evidence-based mental health practices, Panic Button redefines how technology can be used to combat stress and panic in a personalized, accessible way.

Special Thanks: to the mentos and organisers at the MIT Reality Hack 2025 , for helping with queries, and solving issues with configs and dependency.