Inspiration

Many patients with chronic conditions struggle to take medications on time and communicate their health status effectively. At the same time, healthcare providers often lack real-time insights into patient behavior and emotional wellbeing between visits. We wanted to create a solution that:

  • Supports patients daily, helping them stay on track with their treatment.
  • Empowers providers with actionable insights, enabling proactive interventions.
  • Bridges the gap between self-care and clinical care, combining behavioral, emotional, and medical data.

What it does

CuraMate helps patients stay on track and empowers providers to make informed decisions by combining:

*Smart Medication Reminders – tracks adherence and provides adaptive prompts. *AI-Powered Conversational Agent – offers voice-based guidance and information access. *Voice Emotion Analysis – detects emotional state changes over time to highlight trends and risks.

All of this feeds into a personalized risk score for proactive care.

How we built it

*Voice Emotion Detection: trained a custom model on the RAVDESS dataset, analyzing spectrogram features to track emotional trends; deployed via a Flask server. *Data Storage: used PostgreSQL to securely store patient interactions, medication adherence logs, and emotional analysis results. *AI Chatbot Integration: integrated a pre-trained language model for bi-directional voice communication. *Medication Tracking: implemented adaptive reminders and adherence logging.

Aggregated all data into a risk scoring algorithm for provider dashboards.

Challenges we ran into

*Ensuring accurate emotion detection from noisy, real-world speech. *Integrating multiple data sources into a unified risk scoring system.

Accomplishments that we're proud of

  • Developing a risk scoring framework that consolidates behavioral and emotional data.

What we learned

*Emotional cues in speech can provide actionable insights for healthcare providers. *Integration across multiple AI modules is challenging but essential for patient-centered solutions.

What's next for CuraMate

*Improve risk scoring with more real-world patient data. *Add predictive insights for early intervention and personalized treatment adjustments.

  • Scale the platform for broader healthcare adoption.
  • Enhance cloud-based data security and compliance, ensuring close adherence to HIPAA standards for sensitive health information.
Share this project:

Updates