Inspiration

Meet Doctor DoDo. He is a medical practioner, and he has a PhD degree in EVERYTHING!

Dr. DoDo is here to take care of you, and make sure you do-do your homework!

Two main problems arise with virtual learning: It's hard to verify if somebody understands content without seeing their facial expressions/body language, and students tend to forget to take care of themselves, mentally and physically. At least we definitely did.

What it does

Doctor DoDo is a chrome extension and web-browser "pet" that will teach you about the images or text you highlight on your screen (remember his many PhD's), while keeping watch of your mood (facial expressions), time spent studying, and he'll even remind you to fix your posture (tsk tsk)!

How we built it

With the use of:

  • ChatGPT-4
  • Facial Emotion recognition
  • Facial Verification recognition
  • Voice recognition
  • Flask
  • Pose recognition with mediapipe and Procreate for the art/animation,

Challenges we ran into

  1. The initial design was hard to navigate. We didn't know if we wanted him to mainly be a study buddy, include a pomodoro timer, etc.
  2. Animation (do I need to say more)
  3. Integration hell, backend and frontend were not connecting

Accomplishments that we're proud of

We're proud of our creativity! But more proud of Dr. DoDo for graduating with a PhD in every branch of knowledge to ever exist.

What we learned

  1. How to integrate backend and frontend software within a limited time
  2. Integrating more
  3. Animation (do I need to say more again)

What's next for Doctor DoDo

Here are some things we're adding to Dr. DoDo's future: Complete summaries of webpages

Built With

+ 2 more
Share this project:

Updates