RecAll

• 

• 

  Live Translation + Chat

• 

  Augmented Reality effect in one's room

Inspiration

After two whole semesters of taking online classes, I have observed the rise in usage of video conferencing tools for virtual lessons, such as BlueJeans, Zoom, Google Meet, just to name a few. While these tools are constantly updating to meet their demand, I noticed that a group of users are being left behind, specifically people with auditory disabilities. With an elder brother who is half-deaf, this issue is something dear to my heart and I desire to make the rapidly advancing technology today more accessible, hence the name RecAll with an emphasis on All instead of Call.

What it does

RecAll focuses on improving the virtual education experience for people with hearing difficulties by including an accessibility feature which alleviate potential issues with online communication. The live speech-to-text, or live captioning feature, aims to translate the speaker's speech into tangible captions in real time. This minimizes the risk of miscommunication between teacher and students, and increases students' understanding the first time a new topic is communicated across. There is also a Augmented Reality feature that incorporates a hologram effect so that professors can make the virtual lesson experience more hands-on and engaging for more visual learners or those who have a hard time staying still.

How we built it

I primarily used Figma to wireframe and prototype RecAll in a desktop application format. However, it is also feasible to code and develop into a functional desktop and mobile application.

Challenges we ran into

Plunging into this idea the moment I was inspired, I did not prioritize finding teammates. I believe that I would accomplish a lot more and push my idea further with more manpower. As a developer as well, I wish I had the time to code up a prototype.

Accomplishments that we're proud of

I am pleased to have a functional prototype on Figma that uses smart animation to roughly demonstrate how the live captioning would work.

What's next for RecAll

I have many ideas I wish to push, such as extending my target audience to all inaccessibilities. For instance:

• An accessibility toggle/user customization setting to increase contrast, font size, etc. to make it the user experience more stress-free for people with visual difficulties
• A live assistance chatbot with AI is also one of my ideas to help people who are less technologically-savvy
• Translate this prototype to code!

Built With

• figma