Inspiration
I wanted to create a project that could help others that need it, because I feel like this is something that should be addressed within society.
What it does
It is a text to sign language along with sign language to text converter to allow others to learn about it, and it has voice and text-speech synthesis features.
How we built it
I used HTML, CSS, and JS mainly. I used google's mediapipe in order to track hand movements. I also enabled google's speech synthesis and voices in order to utilize them with speech to text, and text to speech respectively.
Challenges we ran into
The main challenge I ran into was being able to actually track hand motions accurately to generate hand signals.
Accomplishments that we're proud of
I'm happy that I was able to design this website and utilize these features within the website. It's been a while since i've participated in a hackathon and I haven't really had time time to code on my own for a while.
What we learned
I've learned how to utilize API's and problem solve when attempting to implement them in my own way.
What's next for Assist-Aux
Actually enable the website to track sign language more accurately, and train my own model rather than using others out there. I also would like to incorporate braille within it.
Log in or sign up for Devpost to join the conversation.