A web app for creating puppet theater shows. Kids stage scenes using hand puppets detected by webcam, pick backgrounds and music, then watch their film play back.

• Real-time puppet detection — hold up a rabbit or wolf hand puppet in front of the webcam; MediaPipe tracks your hand and animates the puppet on stage, including mouth movement
• Scene composer — build a play scene by scene: choose a background, record your puppets acting, add music
• Film playback — watch the finished play with all scenes, audio, and background music

• Node.js 20+
• Python 3.8+

Install Python dependencies first:

cd puppet-recognition
python -m venv .venv
source .venv/bin/activate        # Mac/Linux
.venv\Scripts\activate           # Windows
pip install -r requirements.txt

Then from the project root:

npm install
npm run dev

This starts everything concurrently:

The backend automatically spawns the Python puppet-recognition process on startup.

hackthemountain/
├── frontend/             # Angular app
│   └── src/
│       ├── app/          # Components, services, stage canvas
│       └── assets/       # Puppet images, backgrounds, music
├── backend/              # Express API + SQLite
│   └── src/
│       ├── index.ts      # Server entry point
│       ├── db.ts         # Database setup
│       └── routes/       # REST endpoints
├── puppet-recognition/   # Python WebSocket service
│   ├── main.py           # Entry point
│   ├── hand_tracker.py   # MediaPipe hand detection
│   ├── interpreter/      # Hand landmarks → puppet pose
│   └── classifier/       # Rabbit / wolf classification
└── puppet-model/         # Model training scripts (TensorFlow)