ReplayMeetings

ReplayMeetings - master meetings with AI. We identify emotion mismatches, offering a Chess.com-style post-game analysis. Learn from blunders, improve your communication, and win your next meeting!

Comment

Inspiration

We wanted to improve our communication skills, as it plays a crucial role in every aspect of life, whether professional or personal.

What it does

ReplayMeetings uses advanced AI to analyze the sentiment and emotion in both video and audio from your meetings. It detects discrepancies between the emotions expressed through facial cues and the sentiment of the spoken words. It then provides actionable insights to help improve your communication style and effectiveness.

How we built it

We used Hume AI to gather sentiment data from video and audio, analyzing any discrepancies between facial expressions and the semantic meaning of the spoken words. By combining these insights with comprehensive data visualization, we created a user-friendly tool for self-improvement, and also a fun product to laugh at your mistakes.

Challenges we ran into

We faced hurdles with JSON format debugging, and we had some difficulties utilizing Google Cloud effectively. We also initially found it hard to use the Hume AI API, but we found that the documentation was extremely helpful compared to most new AI products and we were able to gather a lot of data flawlessly.

Accomplishments that we're proud of

We are proud of building a full stack application from scratch, incorporating an advanced AI API, and creating a practical tool for everyday use. The ability to turn complex emotional data into user-friendly feedback is an accomplishment we're particularly proud of.

What we learned

Throughout the process, we gained a deeper understanding of how to create a full-stack application while exploring the Hume AI API. We also learned how to navigate and resolve challenges with JSON formatting and Google Cloud.

What's next for ReplayMeetings

We plan to incorporate Vocal Bursts (ums, uhhs) for deeper sentiment analysis, enabling a more accurate and comprehensive coaching system. We also aim to continually refine our algorithms and improve our user interface based on user feedback and emerging AI technologies.

Share this project:

Updates