Inspiration

Our project, ASL Arcana, was inspired by the needs of the blind community and our desire to create an engaging and interactive way to learn sign language.

What it Does

ASL Arcana uses computer vision and Pygame to make learning sign language enjoyable and interactive. The game detects various hand signals and matches them to related words. Players have to form as many letters as possible within a given time to inflict damage on virtual opponents. After each session, players receive detailed learning statistics through Airtable and MATLAB, which help track their progress.

How We Built It

We utilized a combination of computer vision, Pygame, MATLAB, and Airtable to develop ASL Arcana. Computer vision helps detect hand gestures, Pygame is used for game development, MATLAB provides advanced analytics, and Airtable stores player data and statistics.

Challenges We Ran Into

Integrating MATLAB with the game Connecting computer vision to the game mechanics Designing and building the game interface and logic Accomplishments That We're Proud Of Successfully integrating MATLAB with our game to provide detailed analytics Creating an appealing graphical interface Implementing functional computer vision for real-time hand gesture detection

What We Learned

Through this project, we gained experience with MATLAB, Pygame, and Airtable. We also improved our skills in integrating different technologies to create a cohesive application.

What's Next for ASL Arcana

  • Enhancing user analytics to better understand player behavior
  • Implementing player selection and customization options
  • Adding custom sound effects for a more immersive experience
  • Expanding the game with more attacks and spell diversity

Built With

Share this project:

Updates