Aegis AI is a real-time risk triage and safety monitoring system designed to protect individuals in potentially hazardous situations. By combining live audio transcription with advanced LLM-driven risk analysis, Aegis AI acts as a "Shadow" protector, alerting trusted guardians when danger is detected.
Aegis AI provides a safety net through continuous monitoring and proactive alerting:
- Live Audio Monitoring: Streams real-time audio from the user's device.
- Intelligent Transcription: Uses AssemblyAI for low-latency, accurate speech-to-text.
- AI-Driven Risk Triage: Analyzes conversation transcripts using Google Gemini to detect markers of harassment, coercion, isolation, or imminent harm.
- Proactive Alerting: Automatically notifies a "Circle of Guardians" via the platform when a high or critical risk score is detected.
- Shared Live Status: Guardians can view the live status and location of their wards during active sessions.
- Framework: Next.js
- Language: TypeScript
- Real-time: WebSockets for live status and audio streaming.
- Framework: FastAPI (Python)
- Database & Auth: Supabase
- LLM (Risk Analysis): Google Gemini (
gemini-2.0-flash) - Transcription: AssemblyAI V3 (Streaming)
- Node.js 18+
- Python 3.10+
- Supabase Account
- AssemblyAI API Key
- Google Gemini API Key
- Install dependencies:
cd apps/web npm install - Environment Variables: Create a
.envfile inapps/web:NEXT_PUBLIC_SUPABASE_URL=your_supabase_url NEXT_PUBLIC_SUPABASE_ANON_KEY=your_supabase_anon_key NEXT_PUBLIC_API_URL=http://localhost:8000
- Run Development Server:
npm run dev
- Setup Virtual Environment:
cd apps/backend python -m venv venv source venv/bin/activate # Mac/Linux pip install -r requirements.txt
- Environment Variables: Create a
.envfile inapps/backend:SUPABASE_URL=your_supabase_url SUPABASE_SERVICE_ROLE_KEY=your_supabase_service_role_key ASSEMBLYAI_API_KEY=your_assemblyai_api_key GEMINI_KEY=your_gemini_api_key
- Run Backend Server:
uvicorn main:app --reload
For questions, demos, or collaboration, reach out to the project team:
- Adil Sabir Azeez - adilsabirazeez@gmail.com
- Srijon Kumar - srijonkumar18@gmail.com
- Caleb Walters - cwalterssoccer2004@gmail.com
- Sri Ram Swaminathan - srirams1627@gmail.com