FlexVR Wellness

Inspiration

There is proven research that VR environments can calm a patient down which helps reduce the stress of electro-stimulation therapy. This inspired to see how we can facilitate and make the process easier for both the patients and the therapists.

What it does

We developed an entire ecosystem where the therapist can use an AR headset to enhance their workflow, communicate with patients get live data from them remotely, and control the patient’s electro-stimulation therapy while the patient is in a calming XR environment.

How we built it

We used Unity, the Normcore multiplayer framework, and Snapdragon Spaces to interface all the devices.

Challenges we ran into

Our greatest challenge was having to interface a Snapdragon Spaces AR headset to control a custom hardware device connected to a Quest 3. The therapist and patient are connected over the internet!

Accomplishments that we're proud of

We are the first team to successfully interface a Snapdragon Spaces AR headset with a Meta Quest 3 creating a system where two users in the different headsets can interact with each other remotely. In addition, we have successfully created an electro-stimulation device that can be used in a Quest 3 and controlled remotely by a user in a Snapdragon Spaces AR headset which relies on our custom firmware to interface everything.

What we learned

We learned a lot with writing custom firmware for hardware devices!

What's next for FlexVR Wellness

We can make the device a lot smaller!

Built With

ar
electric-stimuation
meta-presence-platform
meta-quest-3
normcore
snapdragon-spaces
unity
vr

Submitted to

MIT Reality Hack 2024
- Winner Hardware: Creative Inputs/Outputs

Created by

I worked as the project manager to organize and help ensure that we were able to build features in the time we had, I also developed the VR scene the patient experienced while connected to the therapist, as well as assisted in the networking aspects between the therapist and the patient.

Cade Gilbert
I was responsible for the therapist's client as well as the networking code on both clients, responsible for end to end integration of our asymetrical platform

Shane McKelvey
Mentor & Interaction Design

Rina Kim
I was responsible for all of the ESP32 Firmware and the interface between that and unity via OSC commands ESP-side. I also assisted in general hardware design, and built the heart rate glove.

James Higdon
Prohurtz
I was responsible for fabrication and hardware design of the electro-stimulation device that could be connected to a Meta Quest 3 VR headset and controlled remotely over the internet by a Therapist.

Peter He
Ridge Lindell