Talk & Explore

An interface designed as a speech therapy supplemental for children with speech disorders. Designed to augment communication for users and educate on phonetic sounds in the English language.

Comment

Inspiration

The inspiration for Talk and Explore originated from examining the need for enhanced tools of communication for individuals struggling with speech disorders.

What it does

The interface developed will have the user read the premade stories available on the app and will be evaluated based on phonetic pronunciation of each word in the book, specifically the word underlined on each page of the book. This is to evaluate what are the common phonetics that the user currently struggles with pronouncing.

How we built it

Using APIs such as ChatGPT, Azure and LLM, we implemented an auditory input program that allows the user to read the given sentences, and the program runs every possible phonetic pronunciation variant of the word and returns whether the user has correctly pronounced the sentence, otherwise is prompted to read the sentence again and is evaluated once again.

Challenges we ran into

Some challenges that we had run into was figuring out what was the best form of design that would be appealing to our target audience of children at a reading age while also making the interface user-friendly for other groups such as the parents of the kid. Balancing the duality of these two audiences and maintaining an efficient design proved to be the most impactful challenge we ran into.

Accomplishments that we're proud of

Implementing auditory input to a program for it to analyze the user's sentences and designing a user interface that addresses our concern and challenge of balancing user target age groups when considering a user-friendly interface.

What we learned

Throughout this process, we were able to learn the importance of front end and back end and their each individual contributions which make them crucial to the development of our interface. Additionally, expanding our knowledge on APIs and their impact on the backend and frontend development of software applications.

What's next for Talk & Explore

We hope to create more stories for the app so that the user has a wide variety of choices and can be evaluated on different topics which allows for more accurate evaluations overall.

Built With

Share this project:

Updates