aiSight

Our Inspiration 👓

Many people in our lives—friends, grandparents, and loved ones—struggle with low vision or blindness. We've seen firsthand how hard it can be to identify the world around them, with the simple act of recognizing objects, faces, or even landmarks being incredibly difficult. Inspired by a desire to make everyday life more accessible, we set out to create a solution that could help not only those closest to us but also anyone facing similar challenges worldwide. This is how aiSight was born—a project driven by empathy, innovation, and a passion to create.

What it does ⚙️

aiSight is a smart assistant that works with a special device attached to your glasses. Paired with our app, it lets users easily connect to the device, view live video feed, and control features such as object and face recognition—all designed to help them better understand their surroundings.

How we built it 💭

We used an ESP32 device, which connects to a camera and integrates with our app. A custom 3D-printed component attaches the device to the glasses. The app is built with React Native, and we used Python with YOLOv8 for AI-powered object recognition.

Challenges we ran into 🤺

Over the course of four months, we faced plenty of challenges creating aiSight. With none of us having much experience with hardware, getting the device to work—and making sure it could communicate with our code—was a major hurdle. The AI side of the project also brought its own set of obstacles. We spent countless hours researching, debugging, and training models to find one that worked well for our goals.

What we learned 👨‍💻

This project taught us a tremendous amount about mobile app development and the integration of AI. We not only learned new programming languages but also gained hands-on experience with cutting-edge concepts that we hadn’t worked with before. Throughout the process, we had the opportunity to collaborate more effectively as a team, sharing knowledge and solving problems together. In addition to software development, we delved into the technical aspects of hardware configuration, 3D printing, and AI implementation, areas that were initially unfamiliar to us. These experiences have broadened our skill sets and deepened our understanding of how software and hardware can work together seamlessly to create innovative solutions.

Built With

• ai
• css
• esp32
• hardware
• html
• python
• react-native
• typescript
• yolov8