TALK2ME

Inspiration

We found that a lot of language learning apps don't really teach us how to hold live conversations with another person. We hope that this app eases access for anyone to be able to practice their communication skills without having to find a partner or go overseas just to practice talking to native language speakers.

What it does

TALK2ME allows language learners to engage in conversations with AI-generated personas who test them on their language speaking skills and pick up on any hiccups during their conversation. Users choose which avatar or language they would like to talk to and they will put into a chatroom with that persona.

How we built it

TALK2ME is a mobile app built by the SwiftUI framework. It communicates with a FastAPI webserver that holds conversations made in the app and delivers responses formed by ChatGPT to the user.

Challenges we ran into

Fine-tuning ChatGPT to deliver the responses we wanted was a major challenge during this hackathon. The process of making ChatGPT sound more conversational involved a lot of fine-tuning with the way each conversation is setup.

Accomplishments that we're proud of

Utilizing and controlling ChatGPT to roleplay personas and critique the user's conversational skills
Implementing our Figma designs into SwiftUI
Enabling HTTPRequests between SwiftUI and the FastAPI Backend

What we learned

I learned how to fine-tune ChatGPT to handle our current use case which is being able to carry conversations as any persona the user would like to speak with. -Nathan I learned to work with streams of incoming data in real time and update the front-end in correlation with the changes. - Amir

What's next for TALK2ME

We plan enhance the conversational experience by taking the conversation from text to voice call. We want to incorporate voice generation technology and face gesture generation in order to enhance the conversation experience. We want to also give more options to configure the conversation, whether it be turning it into an argument or giving users the freedom to generate their own AI personas.