Poe Studio

Ask the bot to create a REEL for your story!
Download the generated video and have a GOOD TIME!
It can create a crisp message if the story is too long.

Inspiration

Aditya's been working on an AI video editor since the Mistral AI hackathon, Yogesh has built an DallE AI Storyteller and Sagar is a hobby drone photographer fascinated by FAL AI's media generation capabilities. So we were all fascinated by the idea of cloud AI video generation on-demand.

What it does

Dreams up coherent short stories and advertisements based on a plot prompt provided.

How we built it

Input: User Prompt Retrieval & Generation: Search images from pexels, generate images using Stable Diffusion & FAL.ai Captioning: Using moviepy & ffmpeg Postprocessing: Resulting video sent back to user

Challenges we ran into

Installing moviepy and imagemagick is suprisingly complicated We had never captioned videos before We had not hosted multiple Poe Bots in one codebase before Hosting & debugging on fly.io had a learning curve, but now we have a handy Dockerfile and github action and we just push and boom

Accomplishments that we're proud of

Damn cool app! Getting moviepy to work in the cloud using fly.io Launching 5 Poe bots in the end, > 1 BPH (Bot Per Hour)

What we learned

Launching Poe bots is so easy. If we were launching Midjourney today we would definitely use Poe over Discord This is the first time we've happily run cloud services with no pain