Hand-Sync

Inspiration

Our team was inspired by the potential of accessible technology to enhance fundamental skills. We sought to leverage standard webcam technology to create an engaging tool for rhythm and coordination practice, exploring the intersection of computer vision and interactive gaming.

What it does

Hand-Sync is an interactive rhythm and coordination game that uses real-time hand-tracking. By following on-screen prompts, users develop timing, precision, and motor skills in a dynamic and visually responsive environment, turning practice into an immersive experience

How we built it

The project was a collaborative integration of front-end and back-end systems. The development process began with Sharon establishing the core hand-tracking system using MediaPipe. Tanisha architected and implemented the front-end website, while Ananya joined Sharon to focus on backend integration and developing the coordination game mechanics. Zoey engineered the rhythm detection and gameplay logic to ensure a seamless user experience.

Challenges we ran into

Compatibility issues with Python versions and installing dependencies like Mediapipe initially caused setbacks. Tuning gesture detection for accuracy and responsiveness also required significant experimentation. Additionally, combining all parts of the project onto the website also provided a significant challenge.

Accomplishments that we're proud of

We successfully developed a functional prototype that demonstrates the core vision of a camera-based rhythm game. We are proud of our tangible progress in computer vision integration, game mechanics, and full-stack development, creating a solid foundation for future iteration.

What we learned

This project provided invaluable hands-on experience in computer vision algorithms, real-time data processing, and building interactive web applications. We also strengthened our skills in agile project management and collaborative problem-solving within a technical framework.

What's next for Hand-Sync

We plan to enhance the game with new levels, more complex rhythm challenges, improved tracking accuracy, and expanded accessibility features to reach a wider audience.