Shoot-Translate-N-Learn

Inspiration

One of the challenges of learning a new language is coming across common objects and wanting to know the word for it in the target language.

What it does

An android language translation app that incorporates object detection. Our app allows students to quickly scan an object they would like to have translated, and save that word for future reference. Students can use the text to speech feature to hear how the word is pronounced in the target language.

How I built it

Built using Android Studio, with Tensor Object Detection API, Firebase MLkit text translation API, and Firebase Firestore.

Challenges I ran into

Configuring Firebase MLkit with our project.

Accomplishments that I'm proud of

Learning how to use TensorFlow Object Detection and Firebase MLKit.

What I learned

How to use two new google based APIs.

What's next for Shoot-Translate-N-Learn

Adding more languages to the available list, and increasing the image recognition capabilities.

Built With

• firebase-ml-kit
• firestore
• java
• tensorflow-objectdetection