Vibe.AI - Your AI Dance Partner

Vibe.AI is a recreational dance app designed to bring the joy of dancing to party-goers and help seniors stay active through music and AI. Our app offers automatic choreography generation by simply playing any song. Vibe.AI's cross-platform companion app listens to ambient music and sends audio data to our servers for real-time processing. It’ll also monitor your moves for timely feedback to keep you on beat!

Inspiration

Dance is a fun way to express oneself and stay active, but not everyone has the experience or confidence to choreograph dances for specific songs. Less popular songs may not have readily available choreographs online, and sometimes you may not even know the name of the awesome song you’ve just heard at a party.

What it does

With Vibe.AI's automatic choreography feature, we want to make it easier for anyone to dance! Simply play the music you love, and our AI will generate custom dance routines that perfectly match the music's rhythm and mood. Just follow your AI dance partner, and if you have trouble keeping time Vibe.AI will buzz your mobile device or wearable to help you out!

Key Features

Automatic choreography for any song, with no manual song selection required.
Real-time AI-generated dance moves for any music genre.
Animated dance instructions using stick figures.
Easily integrates with common wearables using TerraAPI to make it easy to track your exercise stats

Technology Stack

Vibe.AI is developed using Flutter for the mobile app and Python for AI modeling. For seamless integration of other wearables into our stack in the future, we used the Terra API. We adapted Stanford University's music generation AI model EDGE, incorporating their research findings to enhance our AI capabilities. Additionally, we rely on Modal's cloud computing services, including their cloud-based infrastructure, for on-demand ML training.

Challenges we ran into

None of us had any experience with wearable app development, or the Modal platform. The Bangle API did not work despite the TerraAPI working well with other watches, such as WearOS. Since none of us owned a smartwatch, we unfortunately had to develop most of the features on an android phone directly (though it works trivially with other watches :)).

Accomplishments that we're proud of

We worked together to pull off a pretty complex project with many components that we were unfamiliar with.

What we learned

Aside from learning how to use specific technologies such as EDGE and platforms like Terra and Modal, we also got to work on a ubiquitous computing project involving wearables. While it was not as successful as we had hoped, we certainly can better appreciate the difficulties of working with a diverse range of hardware.

What's next for Vibe.AI

In the future, this app can be improved by further optimizing the choreography generation. We could also include social features, such as a leaderboard with friends to gamify the process further and make it more fun. Team Members: Mohit Hulse: Move Generation + Evaluation AI Toya Takahashi: Companion App + Wearable Integration Uzay Girit: Move Generation + Evaluation AI Yue Chen Li: Companion App + Wearable Integration

Acknowledgments

We'd like to thank the mentors at Terra API for their invaluable assistance in debugging Bangle smartwatch-related issues during the development of Vibe.AI.

Demo: Explore our app's demo at [Demo Link] to experience the magic!