Inspiration

Medical professionals spend significant time documenting patient interactions, often leading to burnout and reduced focus on patient care. Additionally, language barriers create significant challenges in healthcare, preventing patients from fully understanding diagnoses, prescriptions, and treatment plans. We wanted to streamline this process by creating an AI-powered tool that not only live transcribes and summarizes doctor-patient conversations in real-time but also provides accurate, real-time translation to ensure clear communication regardless of language differences. By enhancing accessibility and efficiency, we aim to improve the quality of care for diverse patient populations.

About Us

We're revolutionizing healthcare accessibility through innovative digital solutions. Our platform connects patients with healthcare providers seamlessly, making quality care available to everyone, everywhere.

What it does

Prescripto is an AI-powered transcription tool designed for healthcare settings. It captures and transcribes doctor-patient conversations in real-time, highlights key points, and generates actionable summaries. The tool supports:

  • Real-time Speech-to-Text for accurate medical documentation.
  • AI-Generated Summaries highlighting diagnoses, prescriptions, and follow-up steps.
  • Real-time Translation to break language barriers, enabling seamless communication between doctors and patients who speak different languages.
  • Nearest Pharmacy Look-Up using location-based services to help patients quickly find the closest pharmacy to fill their prescriptions.

How we built it

Prescripto was built using a robust tech stack:

  • Whisper AI for high-quality speech-to-text transcription.
  • Gemini AI for intelligent summarization and contextual understanding.
  • Supabase as a secure, real-time backend for storing session transcripts and user data.
  • Vercel for fast, scalable deployment with seamless updates.
  • Gumloop to create a continuous feedback loop, improving transcription accuracy over time.
  • Interactive UI Features using Next.js for an intuitive and responsive user experience.
  • Maps Places API.

Challenges we ran into

  1. Medical Jargon & Accuracy: Ensuring the transcription engine could recognize and process complex medical terminology with minimal errors.
  2. Real-Time Processing: Optimizing the system to handle live transcription and summarization without latency issues.
  3. Language Translation Accuracy: Ensuring real-time translation remains contextually accurate, especially for medical terms.
  4. User-Friendly Design: Making the tool accessible for both tech-savvy and non-tech-savvy medical professionals.

Accomplishments that we're proud of

  • Successfully integrating real-time speech-to-text and AI-generated summarization.
  • Developing a sleek, user-friendly interface that allows live corrections and contextual note-taking.
  • Deploying a working MVP that enables seamless transcription and data storage.
  • Creating a feedback mechanism to continuously enhance accuracy and user experience.
  • Implementing multilingual support to facilitate communication between doctors and patients from diverse backgrounds.

What we learned

  • The importance of balancing accuracy and speed in real-time AI transcription.
  • The challenges of developing an intuitive UI for professionals with varying levels of tech expertise.
  • The complexities of real-time translation and its impact on cross-language medical communication.
  • The value of user feedback in refining AI models and improving system usability.

What's next for Prescripto

  • Enhanced AI Summarization: Improving contextual understanding to better categorize medical information.
  • Legal & Compliance Readiness: Strengthening HIPAA and confidentiality compliance for broader adoption.
  • Advanced Translation Capabilities: Improving medical translation accuracy and supporting additional languages to ensure accessibility for diverse patient demographics.
  • Additional Features: Adding prescription image processing and different summary formats for doctors vs. patients.
  • Scalability & Integrations: Expanding integration with hospital electronic health record (EHR) systems.

Prescripto is poised to revolutionize medical documentation, reducing administrative burdens while improving the quality of patient care and breaking language barriers in healthcare.

Built With

Share this project:

Updates