Signify

Home Page - Not Logged In
Sign Up Screen
Sign In Screen
Home Screen - Logged In
Profile
Learning Page
Learn Alphabet before Camera
Learn Alphabet with Camera
Letter Practice
Words Stage 1
Words Stage 2
Learn Word before Camera
Learn Word with Camera
Word Practice
Challenge Mode
Room Created
Room Play
Leaderboard

Inspiration

Learning sign language at home or individually can be repetitive and isolating, making it hard for learners to stay motivated, track progress, or receive accurate feedback. We wanted to create a solution that makes sign language practice fun, competitive, and accountable.

What it does

Signify is an interactive web platform designed to make learning American Sign Language (ASL) engaging, competitive, and accessible. Using on-device AI, Signify provides instant feedback on your hand gestures, transforming the learning process into a gamified experience.

Accomplishments that we're proud of

Designed a fully accessible interface using IBM’s colorblind-safe palette.
Enabled learners to compete against live opponents in real-time ASL battles.
100% on-device processing - no video leaves the browser.

Current Features

IBM Colorblind-Safe Palette: Designed using the IBM colourblind-safe palette to ensure strong visual contrast and accessibility for users with common forms of colour vision deficiency.
Global Leaderboard: Compete with users worldwide and climb the rankings based on total XP earned.
User Stats Dashboard: Track your progress with detailed stats including: Longest streak, Current streak, Challenges completed, Total XP earned
Interactive AI Learning Modules: Learn ASL through real-time hand tracking powered by AI. The system analyzes your hand movements and only advances when the sign is performed correctly, reinforcing accurate technique and muscle memory.
Educational Integration: Loads high-quality reference images from public resources like Lifeprint.com (Dr. Bill Vicars) for expert-level guidance.
Word & Phrase Practice: Practice full ASL words like “hello” and receive guided instruction through common ASL phrases used in everyday conversations.
Live Battle Game Mode: Create or join a room to compete against another player in real time. Each round is won by the first player to correctly perform the assigned sign.m
On-Device Processing: AI calculations happen locally and no images, frames or videos are stored in the database, ensuring low latency and user privacy.

What's next for Signify

Light / Dark Mode Toggle: Reduce eye strain and improve usability in different lighting environments.
Colour Blind Accessibility Modes: Support specific types of colour vision deficiency (protanopia, deuteranopia, tritanopia).
Group Mode for Classrooms: Private group leaderboards to encourage collaborative motivation and accountability.
Multi-Language Support: Expand beyond ASL to other sign languages, allowing learners to practice, compete, and learn new languages.

Tech Stack

Frontend: HTML5, CSS3, JavaScript (ES6+), Bootstrap 5.
Backend: Firebase (Firestore for user data, Real-time Database for Live Battles, and Firebase Auth).
AI/ML: Google MediaPipe / HandPose: For 3D hand landmark detection.
Fingerpose: A rule-based heuristic engine used to calculate gesture math from 3D coordinates.
Real-Time Comms: WebRTC for peer-to-peer video in Challenge Mode.