An ASL gesture recognition learning platform built with React, Vite, and MediaPipe.
- Node.js & npm
- Python 3.8+
- pip (Python package manager)
- Backend at root level since we didnt make a folder
you should see model.py- Create a Python virtual environment:
python -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate- Install Python dependencies:
pip install -r requirements.txt- Run the Flask backend (runs on
localhost:5050):
python model.py- From the project root, install npm dependencies:
npm install- Build the frontend:
npm run build- Start the dev server:
npm run devThe frontend will be available at http://localhost:5173 (or the URL shown in your terminal).
- Frontend: React + Vite + Tailwind CSS + MediaPipe
- Backend: Flask + TensorFlow (ASL letter classification)
- Game Modes: Practice, Blitz, Words
- Frontend components are in
src/components/ - Game logic syncs with the gesture detection backend
- Progress is persisted in localStorage
- Camera must be enabled for gesture recognition features