SLE Learning

Inspiration

Motivated by personal experiences and witnessing the obstacles my deaf friends encountered, I embarked on a mission to devise a solution that would make sign language learning not just more accessible, but also enjoyable.

Functionality

The SLE Interactive Learning app utilizes cutting-edge 3D models and artificial intelligence to deliver a dynamic and interactive sign language learning journey. It features both a relaxed, self-paced learning mode as well as a time-bound quiz mode, catering to varied learning preferences.

Building Process

Our team harnessed the power of echoAR for the seamless rendering of 3D models and integrated machine learning algorithms to verify signs, thereby ensuring a smooth and effective learning experience.

Challenges

One of the most formidable challenges we faced was sourcing suitable 3D models for the sign language alphabet. In the end, this obstacle became a learning opportunity as I delved into mastering 3D modeling software to create the models myself.

Achievements

We take great pride in our achievement of successfully merging 3D models with AI capabilities. The result is an intuitive sign language learning tool that caters to a range of learning styles—a significant milestone in our journey.

Lessons Learned

Through this project, I gained valuable skills in 3D model rigging and posing, training CoreML models, and utilizing the Apple Vision API for image matching.

Future Vision for SLE Learn

Looking ahead, our plan for SLE Learn is to broaden the vocabulary and incorporate phrases, introduce structured training modules, and add more engaging learning modalities like a speed-run mode. We believe these enhancements will make the learning process even more enjoyable and efficient.

Built With

• swift
• xcode