Inspiration

We built this sitting in a $79 million state of the art library, due to the opportunities offered to us through our education. We never had to deal with not being able to communicate effectively, especially in learning spaces, which is a privilege not offered to all. Inspired by the love for learning, and bringing it in an accessible way to all. SignMe is a platform that allows people to both develop their skills in ASL, as well as use a translate feature to convert from English to ASL and back. By creating this translation feature, we hope to make all work spaces and schools more accessible to deaf people, bringing equal opportunity and help us all communicate better.

What it does

Has learning modules that help lower the barrier into learning ASL, through a UX friendly interface with interactive games and flashcards, as well as testing capabilities. Offers feedback through use of generative AI as well as processing your image input.

Secondly, features an text to ASL feature, which expands on both learning abilities by building on top of existing speech to text technologies, allowing for a speech-to-ASL pipeline for schools and businesses.

How we built it

Build using NodeJS, ReactJs, Pytorch through CNNs and VAEs.

Challenges we ran into

Accomplishments that we're proud of

What we learned

What's next for SignMe

Share this project:

Updates