CaptionCraft

Provide us an image, and we will generate catchy Instagram captions with full context of the image contents.

Comment

Inspiration

Wouldn't it be nice to not have to scour the internet for a catchy caption every time you want to post something on Instagram? Wouldn't it be nice if there was an app that could just look at your photos and caption them?

What it does

We take your photos and generate context aware captions that are just perfect for your next Instagram or Social media post.

How we built it

A Flask application serves an endpoint that receives the image, runs the Blip image captioning model on it and generates a basic text description of the image.

This description is then fed into Google's Palm 2 model using the Vertex AI API which then finally outputs the desired captions. The Flask/Gunicorn server that serves the endpoints to the React.js application is containerized using Google's Cloud Build and deployed using Cloud Run.

Accomplishments that we're proud of

  • Our Beautiful and intuitive UI that has a really simple flow, yet powerful results
  • The Cloud Build, Cloud Run, Vertex AI (Palm 2) Pipeline we developed on Google cloud

What's next for CaptionCraft

Perhaps integrate with the Instagram API to provide new captions for reposts of public images.

Built With

Share this project:

Updates