HandsToEars

Our program asks the user to represent a number using their fingers and advises the user to add/subtract to reach the desired number. We aim to use this to convert sign language to human voice..

Comment

Inspiration

One of my best friends was born with linguistic problems. he could not speak properly and had to use sign language to convey his ideas and opinions. Unfortunately, very few people understand sign language fluently. This hindered his involvement in school and this made me very sad. This project is the starting step to develop a software to convert his sign language to spoken language.

What it does

The project senses the various hand gestures to represent hand gestures to help small children learn to count. Along with the visually interactive interface, the program also helps children learn basic addition and subtraction techniques. The program is designed to speak out instructions rather than the conventional method of printing them on the screen. This increases the fun factor of the game. The game is complete when the user achieves a score of 100. Each correct answer is worth 10 points. There is no negative marking.

How I built it

Challenges I ran into

I faced many challenges obtaining the perfect HSV values to comply with all skin tones. Removing the background noise was one of the hardest part. Ensuring the perfect detection of the hand gestures using contour area ratios and angles required a lot of editings to ensure that the detection rate was acceptable.

Accomplishments that I'm proud of

This being my first Hackathon I am very proud of making a software that makes education fun and exciting. This also gives me hope that I could help my friend who was suffering from auditory impairments. I am proud of the skills I developed in such a short time frame.

What I learned

I learned how to use an entirely new library - opencv. This was the first time I worked with computer visuals and visual detection algorithms.

What's next for HandsToEars

The project has the potential to develop into a tool that converts sign language to spoken languages this will help all people who suffer from auditory impairment interact with society more actively. This can be integrated with all the existing translators to ensure that sign language can be converted into a plethora of languages ensuring universal communication ability for these people.

Built With

Share this project:

Updates