- Stuart Aldrich
- Thomas Manoka
- Andrew Li
- Kai Zhang
- Erika Zhou
Geocaching and Hot-Cold game with Augmented Reality passthrough!
- Upload Arduino code to ESP-32 microcontroller
- It needs to have a power supply and be turned on
- Sideload the application to the Meta Quest 2 headset. It must run in standalone mode.
- Pair Meta Quest 2 headset with ESP-32 over Bluetooth
- Start application in headset
- Connect to device with UI in application.
- The meter indicates how close (hot) or far (cold) the user is from the ESP-32. Also, the sonar ping changes volume and pitch. (This is based off of Bluetooth RSSI (Received Signal Strength Indicator).)
- Unity 3D
- Oculus Integration SDK
- XR Interaction Toolkit
- Arduino C++
- C# scripting
- ESP-32 microcontroller
- AR passthrough
- Hardware Hack - MIT Reality Hack 2023 https://mitrealityhack.notion.site/Hardware-Hack-cea762eb43344eda849dec1067666775
- The Singularity, package by VRatMIT for integrating custom microcontroller VR hardware with Unity project https://github.com/VRatMIT/TheSingularity-Unity
- "Passthrough | Unity VR Tutorial for Oculus Quest" by RealaryVR https://youtu.be/RtoTGYBdGI4
- Sonar audio ping modified from "radar sound effect" by sounds fx https://www.youtube.com/watch?v=_YFXdDppLw0
- "How to use esp_bt_gap_read_rssi_delta function to get bluetooth classic RSSI from ESP32?" - Stack Overflow https://stackoverflow.com/questions/52572703/how-to-use-esp-bt-gap-read-rssi-delta-function-to-get-bluetooth-classic-rssi-fro