SnapTune

Inspiration

A problem that a lot of faced in spending too much time picking music for an instagram caption

What it does

Ever had a photo that you want to share but you don't know what music it goes with on your all-important social media page? Our model aims to fix that. Next time you want to make a compilation video but you dont know what background images you want? Pass an image into our model. It'll run it through our algorithm using CLIP, BLIP, Gemini, etc. and give you the songs that would go perfectly with your image.

How we built it

OpenAI CLIP, BLIP, Gemini

Challenges we ran into

Desigining the algorithm to decide which properties of an image would impact the audio output

Accomplishments that we're proud of

We are proud that we made our own custom algorithm to extract important properties of an image and connect it to an audio output

What we learned

We learned how to utilize AI models such as BLIP, CLIP, and Gemini to analyze image data and request endpoints from an API.

What's next for SnapTune

Translating video data into audio output

Built With

• gemini
• python
• spotify
• streamlit