SignTime

Inspiration

Recently, there's been a lot of fake sign language translators out there so I decided to make a training app so they could just learn how to do sign language and actually help the community. It's inspired by the game Brain Age on the DS which really helped me learn maths.

What it does

You must translate the character as fast as you can and it gives you a final time at the end which you can compare with other people or try to beat your own high score.

How we built it

React and ML5.js using a handpose detection then putting the positions into a neural network to train to recognise hand symbols.

Challenges we ran into

It can only recognise L, <3, D, Y and A since I didn't have enough time to train more

Accomplishments that we're proud of

A working product is nice.

What we learned

I love ml5js it makes ml so nice.

What's next for SignTime

Add the rest of the alphabet through training it more

Built With

• ml5
• react