I built the simplest way to convert your video to other languages.
all you need is a youtube link. no install required.
curious? check out @lexfridman + zuck talking about @elonmusk in hindi.
Here's my conversation with @narendramodi, Prime Minister of India.
It was one of the most moving & powerful conversations and experiences of my life.
This episode is fully dubbed into multiple languages including English and Hindi. It's also available in the original (mix of
How do I do it?
GPT-4 + prompt engineering for translation
11labs for voice training + text-to-speech in other languages while preserving the OG speakers voice
wav2lip-2 API to lipsync the video to the translated audio in HD [sota model + API in beta by @synchronicitylabs]
Putin x @TuckerCarlson translated + lipsynced to English
breaking the language barrier is the first step towards mutual understanding
generated w/ @syncdotso
we translated + lip-synced the entire putin x
@TuckerCarlson interview to english
couldn't get this out earlier bc our infra struggled w/ 2hrs of content for a single job :/
i was pissed – so we rebuilt it all over the last 72 hrs
massive speedup for long videos incoming 😎
it’s official — we raised a $5.5M seed led by @GVteam 🚀
AI lip sync is only the beginning
everyone has a story to tell, but not everyone is a storyteller — yet
imagine a world where we can remix and reimagine ourselves in video in exactly the way we want to be seen
⚡️ Don’t want to rush the build process, but this is too cool not to share.
@FakeTimeAI prototyped the first step in generating live 1:1 AI-gen video calls w/your favorite celebrity.
Our early access list is live — @elonmusk’s excited about it 🔥
cc. @_buildspace
from a viral demo to a VC scale research company in < 6 months
life can be wild
beyond blessed to have work / life so aligned
and we're only just getting started 😎
we just shipped our most capable video-to-video lipsyncing model yet
introducing lipsync-1.8.0 🪄
edit what anyone says in any video, no training required
available now via API + v2 playground. check it out 👇
⚡️ introducing our new synchronizer api
it lets you lip-sync a video to an audio in any language
why is this useful? check out the gladiator in seamless hindi, chinese, spanish, and japanese.
curious? we’ll let you beta test at cost ($1/min generated). link below 👇
YC w24 🙏🏼 see you soon
I can only expand to the environment I’m in
ty to everyone helping me unbound my thinking + inspiring me to break into bigger rooms
can’t wait to write the next chapter 👌🏼
⚡️its official: we got into @ycombinator 🙏
the last 4 weeks have been a blessing
yc w24 + 2 world renowned professors joining as advisors + 6k dev signups / 120+hrs of video generated in a single month
and we're just getting started
curious? check out what else is new👇