Inspiration
According to the International Agency for the Prevention of Blindness, as of 2020, approximately 1.1 billion people worldwide were living with vision loss. This includes 43 million individuals who are blind and 295 million with moderate to severe visual impairment.
What it does
Press the button on the side and the center camera takes a picture of whatever it's pointed at; the web app then reads Gemini's detailed description to you either out loud or through your headphones.
How we built it
Soldering, Hot glue, Gemini API, Python, React,
Challenges we ran into
Soldering to a while, Hardware errors (there is now a constant red filter), Nicla Vision not having support for troubleshooting or for OpenMV Python.
Accomplishments that we're proud of
Even with the red filter error, it can still take a picture and describe relatively quickly and accurately.
What we learned
We learned a lot about how to build a hardware project which we had little prior experience in
What's next for SightSense
We hope to expand on the glasses and improve upon the camera quality, image detection and text detection.
Log in or sign up for Devpost to join the conversation.