YourAI is a next-generation healthcare assistant that transforms how we interact with our health data. Powered by cutting-edge AI and natural language processing, it delivers an intuitive, accessible, and personalized healthcare experience for everyone.
- 💬 Natural Conversations: Human-like dialogues for health guidance.
- 🎙️ Voice Commands: Manage health tasks hands-free.
- 📧 Email Management: Stay organized with health-related emails.
- 📅 Calendar Sync: Book appointments with simple voice commands.
- 🧠 Smart Responses: Clear and insightful health advice.
- 🌐 Google Workspace: Effortless integration with Gmail and Google Calendar.
- 🌙 Dark Mode: Comfortable, eye-friendly interface anytime.
- 📚 History Tracking: Access your health conversations anytime.
- 📱 Cross-Platform: Works beautifully on all devices.
| Layer | Tech Stack |
|---|---|
| Frontend | React.js, Next.js, TypeScript |
| Voice | Web Speech API, Piper, WaveNet |
| AI Engine | Llama 3.1 Model |
| Backend | Node.js, Express, PostgreSQL |
| Deployment | Docker, AWS, GitHub Actions |
- Node.js (v14+)
- npm (v6+)
- Google Cloud Platform account
- OAuth 2.0 credentials
git clone https://github.com/your-username/yourai-health.git
cd yourai-health
npm install📄 Create .env.local
NEXT_PUBLIC_API_URL=your_api_url
NEXT_PUBLIC_GOOGLE_CLIENT_ID=your_client_id
GOOGLE_CLIENT_SECRET=your_client_secret
PIPER_PATH=/path/to/piper/build/piper
PIPER_MODEL_PATH=/path/to/piper/models/en_US-libritts-high.onnxgit clone https://github.com/rhasspy/piper.git
cd piper
mkdir build && cd build
cmake ..
makeDownload Voice Model:
curl -L -o models/en_US-libritts-high.onnx https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/en/en_US/libritts/high/en_US-libritts-high.onnx
curl -L -o models/en_US-libritts-high.onnx.json https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/en/en_US/libritts/high/en_US-libritts-high.onnx.jsonInstall Dependencies:
brew install espeak-ng-
Navigate to Google Cloud Console.
-
Create/Select a Project → Enable APIs → Generate Credentials.
-
Required Scopes:
https://www.googleapis.com/auth/gmail.readonlyhttps://www.googleapis.com/auth/calendar.events
- Wake Word: "Hey YourAI" or "Hello"
- 📧 Emails: "Check my health emails"
- 📅 Appointments: "Schedule a checkup for tomorrow"
┌────────────────┐ ┌───────────────────┐
│ Text Thread │◄────►│ Audio Thread │
└────────────────┘ └───────────────────┘
│ ┌──────────────┐ ┌──────────────┐
└─►│ AI Responses │ │ Voice Synthesis │
└──────────────┘ └──────────────┘
- 📥 Data Collection:
audio_download_create_wav_files.py - 🧹 Data Cleaning:
process_wav_files_to_remove_wav_errors.py - 📜 Transcription: Use Whisper with
transcript.py - 🎛️ Model Training: Training Notebook
npm run devWe welcome your contributions to transform healthcare together!
- 🍴 Fork the repository
- 📂 Create a feature branch
- ✅ Commit your changes
- 📤 Push and open a Pull Request
YourAI was developed during the Princeton University Hackathon by a team passionate about solving real healthcare challenges. With a vision of accessible, AI-powered healthcare for everyone, YourAI centralizes health records, enhances medication management, streamlines insurance processes, and safeguards personal data privacy.