StreamTale

Elevate storycrafting with a human-like touch.

Comment

Inspiration

Kids today passively consume endless pre-made videos and stories—stifling their creativity and sense of agency. We asked: what if every child could be the co-author of their own adventure, guiding characters and plot twists in real time?

What it does

StreamTale is a Video Chat AI Assistant that transforms passive screen time into interactive storytelling:

  1. Interactive Prompting: The AI asks your child to describe a character and plot elements.
  2. On-the-Fly Image Generation: Flux-Krea crafts that character; Flux-Kontext paints each new scene.
  3. Seamless Audio Narration: Our custom TTS engine weaves the child’s inputs into a fluid, engaging narrative.
  4. Real-Time Video Chat: Powered by Tavus AI over WebRTC, the whole experience feels like talking to a friendly storyteller.

How we built it

  • Tavus AI (WebRTC Video Chat): Real-time, low-latency two-way video.
  • FAL AI:
    • Flux-Krea for consistent, kid-approved character art.
    • Flux-Kontext for dynamic scene generation that follows the plot.
  • Rio Python Frontend Library: Orchestrates video streams, user inputs, and AI calls in a single web app.
  • Custom TTS Pipeline: Glues user descriptions into coherent audio stories without awkward pauses or robotic tone.

Challenges we ran into

  • Visual Consistency: Keeping characters looking the same across dozens of AI-generated frames.
  • Latency Optimization: Tuning WebRTC and image-generation pipelines so young users never feel a lag.
  • Safety & Simplicity: Designing prompts that are both engaging and easy for kids to understand.

Accomplishments that we’re proud of

  • End-to-End Demo: A hackathon prototype—no mockups, no placeholders.
  • Smooth UX on Varied Devices: From tablets to low-end phones, StreamTale stayed responsive.
  • Art Style Continuity: Our Flux models produced a coherent, storybook look frame after frame.

What we learned

  • Modular AI Workflows: How to stitch together multiple AI services (video, vision, audio) into one seamless user journey.
  • Real-World WebRTC Tuning: Practical lessons in buffer management and fallback strategies for spotty networks.
  • Kid-Centric Design: The importance of clear, fun prompts and instant feedback loops for younger audiences.

What’s next for StreamTale

  • Parent Dashboard: Let caregivers set teaching goals and story themes.
  • Mobile Apps & Offline Mode: Bundle assets so kids can keep “writing” without Wi-Fi.
  • Expanded AI Personalities: Multiple “storytellers” with distinct voices and art styles for even richer play.

Built With

Share this project:

Updates