Inspiration
We felt it was a shared experience to go to the dentist and to feel like you have heard a different language with technical jargon so we decided to make this project to make dentist procedures easier for dentists and more accessible for patients. We found that documentation tended to be slow, manual and often neglected - this led to us to the thought that if an AI could listen, understand and build a system that could automatically record this treatment/ checkup. This was when the idea of DentAssist was born.
What it does
It is a voice-powered AI assistant for dentists that record live speech during appointments, create stunning visualization for both dentist and patient. It also translates the transcript into multiple languages so that there is no language barrier for essential treatment.
How we built it
Front-end - Next.js with app router, Tailwind CSS for the styling 3D Chart - we built this using Three.js and mapped it to the standard numbering layout Speech-to-text - We used AssemblyAI to handle transcription of real-time audio LLM - Google Gemini's 2.5 Pro (Preview) to analyze the transcripts and returns structured data + summaries Text-to-speech - Neuphonic turns the summaries into natural and real human-sounding speech to allow patients to feel some sort of comfort while still being able to the potential aspect of feeling judged
Challenges we ran into
Designing the LLM prompt to return valid, structured JSON with no extra values such as random speech Mapping the real-world dental numbering to a custom 3D chart as well as adding the colouring on this chart. Handling all the different API calls and how to structure it all.
Accomplishments that we're proud of
Built a working pipeline from audio -> transcription -> AI analysis -> visualization -> playback Developed a clean and modern UI that is usable and has a good UI and user experience Made some tech that contributes to society and is helpful to clinicians and solved a real problem that we faced.
What we learned
Dentist jargon is annoying!! How to resolve merge conflicts (yes at our big age) How to keep team moral high when everything does not seem like it is going our way. How to put together multiple APIs and frameworks into a unified product Planning and designing ahead so that we were able to effectively work in a sort of parallel format, as well as dividing tasks fairly and not to mention the countless amount of pair programming when times got tough.
Log in or sign up for Devpost to join the conversation.