-
-
Entertainment Track Champion + Grand Champion for LA Tech Week Hackathon 2024
Our AI-powered platform revolutionizes sports media production by automating real-time commentary, highlight generation, and social media sharing for live events. Designed to streamline the production process, our platform allows small teams to scale their operations with minimal resources, saving time and money while delivering high-quality, engaging content. This solution is perfect for sports organizations looking to enhance fan engagement without the overhead of a large production crew.
Bridging the Digital Divide in Sports Media:
In line with addressing the digital divide, our platform also tackles inequities in digital access, design, and use. The digital divide, as defined by the U.S. Department of Education, refers to the gap in access to digital tools and resources. Our platform addresses this by offering affordable, scalable solutions for sports organizations that may lack the resources to implement advanced media production technologies. By leveraging AI, we make it easier for underfunded teams to access and utilize cutting-edge production tools, thus leveling the playing field.
Key factors that contribute to the digital divide, such as lack of wealth, underdeveloped infrastructure, and limited digital content, are addressed through our solutions like affordable internet connectivity, AI-driven highlight generation, and offline content options. This way, even smaller sports organizations can harness the power of advanced technology without significant investments.
Challenge & Objective:
The traditional process of live sports production is resource-heavy, requiring large teams and significant investment in manual editing, commentary, and highlight creation. Our goal was to create a solution that could automate these tasks in near real-time, providing sports organizations with a way to scale their production while drastically reducing costs.
For Fight Night San Jose, our objective was to build a seamless workflow for connecting to the live stream, downloading the video feed every 30-60 seconds, and using AI to process and identify key actions such as punches, kicks, and knockdowns. From there, we wanted to automate highlight creation, generate AI-powered commentary, and include captions to make the entire production pipeline efficient and cost-effective.
Key Features:
Real-Time AI Commentary: Our platform features AI-powered commentary that can deliver near-live insights with only a 3-5 minute tape delay, providing a fully automated experience.
Digital Twins of Commentators: To add a visual element, our system creates digital twins of commentators, providing a lifelike presence on-screen without the need for a live commentator.
AI-Powered Highlight Creation: The platform automatically identifies key actions within the video (like punches, kicks, knockdowns), creating highlights in real-time. Users can easily search for specific actions and generate clips instantly.
Intuitive UI with Searchable Metadata: Users can search for specific moments like “punch,” “knockdown,” or “submission,” and the platform will pull those clips, which can then be immediately shared on social media platforms.
Captions API Integration: The platform automatically generates captions for each highlight video, ensuring accessibility and engagement for all users.
Cloud-Based Workflow: Our platform connects seamlessly to the venue’s live feed, downloads MP4 clips every 30-60 seconds to the cloud, and processes them with AI to generate detailed metadata tags and ready-to-share clips.
How It Works:
Video Upload & Processing: We take the highlight reel from the round and send it to GPT-4 to generate fight commentary in text form.
Audio & Video Integration: The voice-over audio track is combined with the highlight reel using FFmpeg to create a cohesive video ready for social sharing.
Highlight Generation: The Twelve Labs API analyzes the video footage, identifies key actions like punches and knockdowns, and creates metadata tags for these moments.
Final Output: The clips are cut using FFmpeg, captions are generated via the Captions API, and the final video (complete with voice-over commentary and captions) is ready for sharing across platforms.
Benefits:
Cost Efficiency: By automating commentary, editing, captions, and highlight creation, sports organizations can significantly reduce production costs, allowing small teams to deliver high-quality content at scale.
Scalability: The platform enables sports organizations to scale their production with minimal overhead, handling everything from live events to social media sharing without needing a large crew.
Real-Time Engagement: The quick turnaround of highlights and AI commentary keeps fans engaged, providing them with shareable content almost instantly after key moments happen.
Potential for All Sports:
While we’ve built this solution for Fight Night San Jose, the technology can be applied to any sport, allowing organizations across the globe to automate their production process and keep fans engaged with AI-powered highlights, commentary, and captions.
Future Vision:
As we continue to refine the platform, we envision expanding its capabilities to handle multiple camera angles, advanced analytics, and further customization for sports beyond fighting. Our goal is to make AI-driven production a standard in the sports industry, empowering teams of any size to create engaging, high-quality content effortlessly.
Conclusion:
Our AI-powered platform has proven that it is possible to produce live sports content with minimal delay, fully automated commentary, and highlight creation. With an intuitive interface, captions, and the ability to scale production quickly, our solution is ideal for sports organizations looking to save costs and enhance fan engagement through real-time, shareable moments.
By addressing the digital divide in access to technology and digital tools, our platform not only helps sports organizations deliver high-quality content but also empowers them to compete in an increasingly digital world.
Log in or sign up for Devpost to join the conversation.