Lend Your Eyes

• 

  SMS Notification Demo

Inspiration

The current situation of covid-19 has made our classes go online.Our current classes are taken through video conferencing platforms such as zoom,meet etc.So one time I saw one of our teachers helping one of my friend complete a question by sharing his camera facing the notebook.So we thought why not create a system that does exactly the same for blind people.This small device could have huge impacts on the life of Blind people.

What it does

Lend Your Eyes is a raspberry pi powered smart glass which helps blind person by taking the help of your friends or family.Whenever a blind person is in a situation requiring help he/she can request help through our smart glass.The blind person can request help via a button or use voice commands.The raspberry pi creates a Jitsi meeting and shares the link via SMS to all your friends and family.Thus anyone can join the link and help the blind person.It is also capable of describing an event that is in front of the blind person by generating a caption from the image captured

How We built it

We used python to automate the process of creating a jitsi meeting in the raspberry Pi.Used Twilio's API for sending the text messages to all the saved contacts.We have also used Microsoft Cognitive Services API for generating a caption from the image captured.The text generated can be converted to any language using google Translate API and can be given as voice output to the blind person.

Challenges We ran into

Since each one of our team lives in different parts of our state.It was very difficult to collaborate on a hardware project due to state restrictions and lack of hardware components.But however we were able to complete the basic working of the raspberry pi code

Accomplishments that We're proud of

This was the first hackathon for majority of our team.So we learned what a hackathon is and enjoyed brainstorming on ideas.We learned that building a product out of our ideas doesn't require you to be with your team.Thanks to the present health crisis

What We learned

We became familiar with the raspberry pi environment and learned to work with python's speech recognition module.Also this was our first time working with a computer vision API

What's next for Lend Your Eyes

• Add basic object detection capability using ultrasonic sensors or Tensorflow API
• Brainstorm on ideas on how we could solve more of the challenges faced by such people.
• Add the feature of recognizing family members using face recognition

Built With

• google-translate
• microsoft-cognitive-services
• python
• raspberry-pi
• tts
• twilio