Stream2Script

Logo
Home Page - I
Home Page - II
Home Page - III
About Us Page
Conversion Page - I
Conversion Page - II

Inspiration ✨🌟

My Inspiration: One day, I wanted to watch a video of 20 minutes, but didn't want to literally watch it, and I started to procrastinate, and later I found out myself at the end of the 120+ yt shorts, super tired without even doing anything. I thought it would have been super cool if there existed a program that could turn a movie into a book, into a pdf, or just a youtube video? and from there, came this idea! 🔥

What it does 💪⚒️

So this is how it works:

It takes the youtube video url from the user or the mp4 file
then, it downloads the youtube video as .mp4 or just process the .mp4 file uploaded by the user
then, it will convert that into .mp3 file.
then, it will convert that .mp3 into .wav file
then, it will start creating chunks, smaller chunks of .wav file, for ex: first chunk of first 5 seconds of audio along with the picture (thumbnail) at the 5th second.
it will use openai's whisper model to get the text from the first chunk, put it into the pdf, and just below it, put the picture at that second, and does it over and over till the video ends.
uses claude3 for summarization.
I am using flask, so it has routes, I can just send a request to those routes to get the video summarized into a pdf or just a video into a pdf.

How I built it 🏗️👷

I am a big procrastinator, despite that, I built it using python, (chatgpt's power), openai's whipser, pytube, moviepy, numpy, torch, fpdf, and flask_cors to get rid of those cors errors 😢

Challenges we ran into 🤚⛔

less time
school work pending
version problem of python, giving uncountable errors
unable to deploy the api because of ffmpeg problem.

Accomplishments that we're proud of 🔥😎

I made something that I didn't find on the internet.
I made it because I needed it, and I think people would too.
I am happy because I finished it on time and this was my first time making a good website UI/UX.

What we learned 📚🏫

I learned how to use codespaces, how to use whisper, how to download video from youtube directly, and everything that was mentioned in the workflow.

What's next for Stream2Script 🔥📊🔮

My initial idea was to have a flipbook in manga style, right-to-left, but couldn't implement it, so I'll make my custom in the future.
My initial idea was also to have presets, like x font with y bg, with z layout, but couldn't implement because spent more than 4 hours debugging that I forgot to just make the api public.
much more!