demo

product video: https://www.loom.com/share/8e3f870cb27f47f59113c068b754b2b2

github: https://github.com/arjunlohan/multimodal-frontier-hackathon-interdimensional-cable

inspiration

we wanted to build the rick & morty "interdimensional cable" concept for real — infinite, ai-generated talk show content about anything you're curious about. pick a topic, pick a format, and get a full produced segment in minutes.

what it does

users choose a topic (or paste a url), select a show template (late night monologue, weekend update-style desk, etc.), and set a duration. the app then:

  1. researches the topic using gemini with google search grounding for real-time info
  2. writes a script tailored to the host's personality and comedic style
  3. generates video clips using veo 3.1 with reference images for visual consistency
  4. stitches and uploads the final video to mux for instant streaming playback

everything runs as a durable workflow — you can close the tab and come back later.

how we built it

  • next.js 16 app router with react 19 and tailwind css 4
  • gemini 3 flash for research (with google search grounding) and script writing
  • veo 3.1 for 8-second video clip generation with reference image support
  • vercel workflows for durable, resumable orchestration across all steps
  • mux for video hosting, playback, and streaming
  • drizzle orm + postgres for show metadata and state tracking
  • ffmpeg for stitching clips into final videos

challenges

  • veo rate limits when generating multiple clips in parallel — solved with sequential generation and exponential backoff retry
  • celebrity content filters rejecting reference images — added automatic fallback to generate without reference
  • keeping the ui responsive during long-running workflows — used server-sent events and localstorage for resumable progress tracking

Built With

Share this project:

Updates