Inspiration
Our project, ASL Arcana, was inspired by the needs of the blind community and our desire to create an engaging and interactive way to learn sign language.
What it Does
ASL Arcana uses computer vision and Pygame to make learning sign language enjoyable and interactive. The game detects various hand signals and matches them to related words. Players have to form as many letters as possible within a given time to inflict damage on virtual opponents. After each session, players receive detailed learning statistics through Airtable and MATLAB, which help track their progress.
How We Built It
We utilized a combination of computer vision, Pygame, MATLAB, and Airtable to develop ASL Arcana. Computer vision helps detect hand gestures, Pygame is used for game development, MATLAB provides advanced analytics, and Airtable stores player data and statistics.
Challenges We Ran Into
Integrating MATLAB with the game Connecting computer vision to the game mechanics Designing and building the game interface and logic Accomplishments That We're Proud Of Successfully integrating MATLAB with our game to provide detailed analytics Creating an appealing graphical interface Implementing functional computer vision for real-time hand gesture detection
What We Learned
Through this project, we gained experience with MATLAB, Pygame, and Airtable. We also improved our skills in integrating different technologies to create a cohesive application.
What's Next for ASL Arcana
- Enhancing user analytics to better understand player behavior
- Implementing player selection and customization options
- Adding custom sound effects for a more immersive experience
- Expanding the game with more attacks and spell diversity

Log in or sign up for Devpost to join the conversation.