Inspiration
Competitive games like Valorant rely heavily on spatial audio for situational awareness. Sounds such as footsteps and gunshots help players determine where enemies are located and react quickly. However, this creates a major accessibility barrier for deaf and hard‑of‑hearing (DHH) players, who cannot access this critical information through sound. While some visual cues exist, they are often subtle or require players to divert attention away from gameplay. Research by Morgan L. Baker reveals that deaf Valorant players say that lack of such cues causes a hinderance to the gaming experience and accessibility. Pulse8 was inspired by the goal of making competitive gaming more accessible by translating spatial audio into a form that can be felt instead of heard.
What it does
Pulse8 converts directional in‑game audio into haptic feedback, allowing players to physically feel where sounds are coming from. For example: Footsteps behind you → vibration from the back Gunshots to the right → feedback from the right side Movement above or below → directional signal This allows deaf and hard‑of‑hearing players to interpret spatial information through touch, improving both accessibility and situational awareness.
How we built it
Pulse8 combines audio processing software with embedded hardware.
Audio Input
Stereo game audio is captured from the computer.
Audio Processing
A software application analyzes the left and right audio channels to detect sound events such as footsteps or gunshots.
Wireless Communication
The processed signals are transmitted using ESP‑NOW between two ESP32 microcontrollers.
Directional Output
The receiving ESP32 activates outputs corresponding to eight spatial directions (Pulse8). Our prototype currently uses LED indicators to represent directional signals due to the lack of vibration motors, but the system is designed to drive haptic motors in wearable devices.
Challenges we ran into
Sound classification: Differentiating between different types of game sounds (footsteps vs gunshots) in real time Directional mapping: Converting stereo audio signals into meaningful spatial directions. Hardware constraints: Our prototype lacked vibration motors, so we had to simulate haptic feedback using LEDs. Wireless communication: Ensuring reliable communication between ESP32 devices using ESP‑NOW.
Accomplishments that we're proud of
Building a working proof‑of‑concept prototype that translates audio direction into physical signals. Successfully integrating audio processing with embedded hardware. Demonstrating how spatial audio can be represented through alternative sensory feedback. Creating a project focused on accessibility in competitive gaming.
What we learned
Through this project we learned about: Digital signal processing (DSP) for analyzing stereo audio signals. Microcontroller communication using ESP‑NOW. Designing systems that prioritize accessibility and universal design. Rapid prototyping hardware and software under hackathon time constraints.
What's next for Pulse8
Future improvements include: Real haptic motors instead of LED indicators. More advanced sound classification algorithms. Wearable hardware such as vests, belts, or wristbands. Integration with additional games beyond Valorant. Improved spatial resolution and customizable feedback patterns. Our long‑term vision is to create a system that allows players to feel the soundscape of a game, making competitive gaming more inclusive and immersive for everyone.


Log in or sign up for Devpost to join the conversation.