Inspiration
Our world is enriched with a variety of people. Many of them are privileged to have all their senses working properly, while some have a slight disadvantage of not having some of their senses working properly, like people who could not speak. We don’t call them disabled, rather we call them differently-abled. We will be focusing on people who all can not speak. They constitute to be among the 5% people in the world. The only way for them to communicate is either by writing or through digital typing. Certainly, we have several technologies for them to communicate via typing. Some technologies like sign language to communicate with persons who are like them. However, they lag behind when it comes to writing. Education is truly incomplete without one holding a pen and paper and it is not possible for every such differently-abled person to reach teachers in classroom mode, especially for ones who reside in rural areas and who are financially very weak to hire personal teachers for aid. The situation has become worse in a pandemic. This gave us the clinch of our idea.
What we did
What we are trying to do in our solution is, we will be creating an online board where a mute person will be able to connect to a mentor on a video call. Both will be equipped with a mobile phone, pen, and paper. Mentor will start making some sort of symbols like alphabets, numbers, and basic stuff for a newcomer, a snapshot will be taken and the letter or symbol he has drawn will get binarized and come on the screen with a transparent background, then the impaired person will imitate the same sign /alphabet, click a snapshot. By this, both mentor’s and mute person’s symbols will come on the screen in parallel. Both the mentor and student can compare what each one of them has drawn, and how different they are. This way mentor will be able to guide the person at what point he has missed, and the person without speaking will communicate through his drawings.
How we built it / Technologies used
We have used the Flask framework for Backend development and used HTML-CSS-JS for the Frontend part of our project. We have also used Twillio API for managing the Video streaming
Accomplishments that we're proud of
We managed to platform that could help deaf and dumb people to learn how to write. In this pandemic situation, conditions have worsened for normal people, so it could be imagined that how difficult would be for a differently-able person to learn and grow their knowledge. We are proud at we could build some effective solution for them :)
What's next for Let's Write
- We will try to work upon different types of images, and backgrounds for superimposing on the current video stream. As of now, the applications work for only black text on a white background. This could be achieved by exploring more on OpenCV.
- Live captioning of the audio could be achieved, so that it would be easy to interpret the voice.
Log in or sign up for Devpost to join the conversation.