Inspiration
Difficult customers make your employees emotionally exhausted, depressed, and leave. Such heavy emotional labor can be sourced to our Dogeza AI, which always stays calm, never gets tired, and keeps apologizing to ease difficult customers' anger.
What it does
Our agent avatar helps the frustrated and aggressive customer calm down by apologizing A LOT. Because our agent apologies so much, the aggressive customer will start to feel sorry. At some point, they will start apologizing back.
How we built it
We use multiple services to coordinate a realtime conversational experience with an avatar. Model coordination: Vapi Transcription: Deepgram Nova2 General Text response generation: OpenAI gpt-4o-mini Voice: LMNT Avatar: Simli Frontend: React + Next.js Image generation and fine-tuning: Diffusion model
Challenges we ran into
We wanted to make the avatar look emotional. We explored using multiple images of the same subject with different emotions by preparing the images through generative AI. Unfortunately, we ran out of time to implement it.
Accomplishments that we're proud of
We have a pissed off customer agent and an over-apologetic customer agent.
Built With
- deepgram
- lmnt
- next.js
- openai
- simli
- vapi
Log in or sign up for Devpost to join the conversation.