EYEWARE

Product
Sample Code
Object Detection
Reading

Inspiration

We have been working with the disabled community, interacting with them always inspire you about the passion for life. At that time you wonder if they can be enabled to perform day to day activities independently, what goals can they fetch. This motivated us to do something for the empowerment of these individuals. During the hackathon, we connected with Maria Kawal, who is a blind activist and a student at Fatima Jinnah University. She explained a day in her life and we kept a note of them. Another blind teenager Hamza Iqbal, from Mirpurkhas, explained to us his constraints in daily life. We identified two key problems that were common which included Navigation and Reading text independently. Their expectations after this conversation are the inspiration for us to not give up on this technology.

What it does

Once the app is opened user can tell whether they want to access the object detection or the optical character recognition module or the Augmented Reality core. In the object detection module and Augmented Reality core, the user is told if there is an object in front of them and what kind of object it is and it will help the person for indoor and outdoor navigation. Similarly in the optical character recognition module, people would be able to read the text.

How I built it

An inexpensive, easy to use prototype is made which can be operated via voice commands. Realtime input is taken from the mobile camera. This data is then processed. I have used Android-studio with Java to develop the application.

Challenges I ran into

Marketing to the blind community
3d Models for indoor navigation

Accomplishments that I'm proud of

We have successfully been able to convert text to speech
Objects of the environment are being identified correctly.

What I learned

Developing optical character recognition.
Getting to know about the lifestyle of the visually impaired or blind person.
Real-life problems.

What's next for EYEWARE

Inviting different organizations for providing us 3D models of their indoor spaces or buildings to make a more inclusive society. Integrating with the tourist industry by providing live assistance for tourists destinations.