NeurAgility

Our project aims to build a multimodal exercise-tracking VR game that combines smartphone-based body tracking and EEG and EMG - based performance insights. We will first implement a mobile motion-capture pipeline and map EEG and EMG data to a slow lunge exercise or yoga exercise considering potential motion artifact. For example, EEG can be an insightful biomarker for attention during workout session and EMG can give insights about the user's muscle activation and engagement level. The reason why we didn't include ECG or IMU here is because there is a limited number of channels that can be connected to OpenBCI Cyton + Daisy board. These three data streams will be integrated into a prototype with simple instruction flow. The instructions will then be converted into an interactive 3D VR experience using free public assets sourced. The initial version will provide real-time movement tracking and post-session EEG and EMG based feedback. Further development will focus on improving visual quality, robustness, and expanding to live EEG feedback and additional exercises such as pushups, planks, and full yoga sequences.

Built With

• vr