AI-powered accessibility app for blind and visually impaired users. Navigate environments, read text, and get directions—all hands-free.

Built at Hack Harvard 2025 🏆

Aria transforms your iPhone camera into an intelligent assistant with three gesture-controlled modes:

• ✋ Environment Mode - Detects obstacles, describes surroundings, guides safe paths
• ✌️ Communication Mode - Reads text from signs, menus, labels, documents
• 🗺️ Navigation Mode - Turn-by-turn walking directions with voice guidance

All controlled hands-free with simple gestures. Show a fist (✊) to stop.

• Gemini 2.0 Flash - Scene understanding & OCR
• ElevenLabs - Natural text-to-speech
• Google Maps API - Turn-by-turn navigation
• iOS Vision - Hand gesture recognition
• Swift/SwiftUI - Native iOS app

1. Clone the repo

git clone https://github.com/yourusername/aria.git

2. Get API keys from:

   • Google AI Studio (Gemini)
   • ElevenLabs (TTS)
   • Google Cloud Console (Maps - enable Directions API)

3. Add keys to Utilities/Constants.swift:

static let geminiAPIKey = "YOUR_KEY"
static let elevenLabsAPIKey = "YOUR_KEY"
static let googleMapsAPIKey = "YOUR_KEY"

4. Run on iPhone (requires physical device for camera/GPS)

Environment Mode: Show open palm ✋ → Move camera around → Hear obstacle descriptions

Reading Mode: Show peace sign ✌️ → Point at text → Hear it read aloud

Navigation: Tap Navigate button → Enter destination → Follow voice directions

Stop anytime: Show fist ✊