Multi-surface hackathon MVP for capturing Meta smart glasses observations, synthesizing clinician feedback, and visualizing trends.

• app-frontend: React Native (Expo) companion app for the glasses wearer.
• backend: FastAPI backend for session tracking, uploads, aggregates, and feedback.
• webapp-frontend: Next.js dashboard for clinician review and summaries.
• meta-glasses-api: Integration notes + iOS sample patch for streaming frames to the backend.

1. Backend

cd backend
python3.12 -m venv venv
source venv/bin/activate
pip install -r requirements.txt
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000

2. Mobile App (Expo)

cd app-frontend
npm install
npx expo install expo-av
export EXPO_PUBLIC_API_BASE_URL=http://YOUR_MAC_LAN_IP:8000
npm start -- --clear

3. Web Dashboard (Next.js)

Create webapp-frontend/.env.local:

AUTH0_DOMAIN=dev-khcafi2gxepjx3yk.us.auth0.com
AUTH0_CLIENT_ID=your_client_id
AUTH0_CLIENT_SECRET=your_client_secret
AUTH0_SECRET=your_64_character_secret
APP_BASE_URL=http://localhost:3000

cd webapp-frontend
npm install
npm run dev

Open the web app at http://localhost:3000.

To stream frames from the Meta Wearables iOS sample, apply the patch in meta-glasses-api/ios-cameraaccess-upload.patch and point it at:

http://YOUR_MAC_LAN_IP:8000/glasses/upload

See meta-glasses-api/README.md for details.

• Backend configuration lives in backend/.env (copy from .env.example).
• The backend can generate spoken feedback audio when ELEVENLABS_* is set.
• Firestore collections are documented in backend/README.md.