Your AI dental sidekick that helps you check your teeth, book appointments, and survive insurance paperwork without the headache.

SmAIly is a mobile app for people who are too busy, too tired, or too overwhelmed to deal with the full dental-care process alone. It can scan your teeth, guide you with AI recommendations, call a clinic to book an appointment for you, and help with insurance claim forms using the receipt from your dentist.

It is especially helpful for:

• busy people who want to save time
• newcomers and immigrants who may not yet feel comfortable handling everything in English
• anyone who hates calling clinics and filling forms

SmAIly is built to help the user through the full journey:

Use your phone camera to capture images of your teeth.
SmAIly uses AI to analyze them and provide basic recommendations or guidance on what may need attention.

Not sure what to do next? SmAIly can explain the process and help the user move from “something feels wrong” to “I have a plan.”

SmAIly uses an AI voice agent to call the dental clinic, talk with them, and help book an appointment.

Once an appointment is arranged, SmAIly can store the scheduling information through Google Calendar integration.

After the visit, SmAIly can process the dental receipt and help fill claim-related forms so the user does not have to do everything manually.

Pre-requirements: Node, Python installed.

It's recommended to create a new virtual environment (Conda, venv). Then run:

To deploy app on the mobile, use Expo/React Native lib:

npx create-expo-app SmAILy
cd SmAILy

Copy-paste files from Git into the newely created Expo project.

npx expo start

Follow console instructions. Download Expo Go app and scan QR to open build the app on mobile.

To access the core functionality and model API update all the API keys in .env (AI keys, twilio tokens). Then run to start the server:

python ai/call_server/server.py

Run to start the server:

python ai/claim/claim_ins.py

Because it is not just “AI for analysis.”

It is AI that actually does the annoying real-world stuff:

• checks your teeth
• talks on the phone
• remembers context
• books appointments
• helps with paperwork

We used a mix of mobile, AI, voice, backend, and browser automation tools:

• Expo Go — mobile app frontend

• Gemini — used for:
  • teeth scan understanding
  • recommendations
  • form filling
  • LLM-generated responses
  • support for voice interaction workflows

• Backboard.io — streaming agent orchestration
• ElevenLabs — speech and voice generation

• Twilio — outbound phone calls
• Google Calendar API — appointment scheduling and calendar support

• Flask — server-side logic and API endpoints

• Playwright — browser interaction and form handling

• Teeth model: https://sketchfab.com/3d-models/rigged-teeth-with-gums-a7d68483b3f947b9a3743018aebd584a
• Blender

A simple version of the flow looks like this:

1. User opens the SmAIly app
2. User scans their teeth
3. AI analyzes the scan and gives guidance
4. User asks SmAIly to book an appointment
5. The voice agent calls the clinic
6. Appointment details are saved
7. After the visit, user uploads the receipt
8. SmAIly helps fill insurance claim information

So instead of juggling five different tasks, the user gets one guided experience.

Building SmAIly meant combining many systems that all had to work together smoothly.

Some of the hard parts:

• making the voice agent sound natural and useful
• handling live conversations with clinics
• keeping context and memory during scheduling
• connecting scanning, calling, scheduling, and form filling into one flow
• making browser and form automation reliable
• extracting the right information from dentist receipts

This project sits at the intersection of healthcare, AI, voice, and automation, so even small integration issues could become big real-world problems.

We are proud that SmAIly is not just a demo with one cool feature.

It is a full journey assistant:

• from dental concern
• to recommendation
• to booked appointment
• to insurance support

We are also proud that it can help people who may struggle with time, stress, or language barriers. That makes the project feel practical and human, not just technical.

We want to make SmAIly even better by adding:

• more accurate teeth-scan guidance
• more natural voice conversations
• multilingual support
• better insurance form coverage
• stronger memory and follow-up support
• reminders for appointments and claim deadlines

The long-term vision is for SmAIly to become a full AI dental companion that helps users from the first concern to the final paperwork.

SmAIly — Smile more, stress less.

SmAIly is an AI-powered dental assistant mobile app that scans your teeth, guides you with recommendations, calls clinics to book appointments, and helps process insurance paperwork from dentist receipts. It is designed to save time, reduce stress, and make dental care more accessible, especially for busy users and immigrants navigating the process in English.