Inspiration

One of our teammates was inspired by Duolingo which teaches languages in a fun way, but she wanted to focus on ASL instead. ASL (American Sign Language We brainstormed different ways to make ASL fun and landed on making it through music!

What it does

It teaches ASL through teaching people the signs for their favorite song! Right now, we are limited in the song library, but the premise is still the same!

How we built it

We learned how to work with computer vision technology and uploaded our training images. We trained the model using tensorflow's object detection library. We built the web application using React.JS.

Challenges we ran into

Initially, training the technology was difficult. It also was difficult figuring out how to implement our idea.

Accomplishments that we're proud of

We're proud that we learned so much in such a short amount of time! For some of us, it was our first hackathon so it was really exciting to see what we could do.

What we learned

We learned to pivot whenever there's an issue because it's most important to get out your MVP. Some of us also learned how to use React.JS and ML technology for the first time which was really cool.

What's next for SongASL

We hope to add a way to store the images (most likely using AWS) in a database and instead of having a tutorial video, we make it so that there is motion card pictures shown to teach songs in ASL.

Built With

Share this project:

Updates