TelemetryX2

• 

  Gemini + ElevenLabs(Commentary)

• 

  Strategy Dashboard

• 

TelemetryX2 — F1 Strategy Dashboard & Race Animator

the pit wall for pace, stints, and stops

Inspiration

• We love Formula 1—the craft, chaos, and tire calls that flip a race.

• Timing screens are scattered; the strategy story gets lost mid-session.

• TelemetryX2 puts lap pace, stints, pit windows, and track position on one surface that explains itself.

What it does

• Live race-to-strategy pulls laps, stints, and pit events, refreshes in place

• Animated replay track-accurate positions from FastF1 with scrub/jump controls

• User steering focuses a driver, compare two, toggle compounds and phases.

• Gemini lap notes concise lap/overall insights (pace fade, traffic, pit loss) with session_key.

• ElevenLabs commentary real-time pit-wall narration from Gemini notes.

How we built it

• Frontend — Streamlit + Plotly (dashboard), React (animator/canvas).

• Backend — FastAPI + Uvicorn; JSON streaming; server-side caching & pre-warm for popular sessions.

• Data — OpenF1 (meetings/sessions/laps/stints/pit/drivers) + FastF1 (telemetry).

• Processing — cached loaders, lap cleaning, stint ranges, pit sorting, driver→team color map (normalized hex).

• AI/Voice — Gemini 2.5 Flash for structured lap notes & summaries; ElevenLabs TTS for synced commentary

Challenges we ran into

• First-load telemetry latency → server caches, pre-warming, non-blocking UI.

• Data gaps / inconsistent pit durations → defensive processors + visual fallbacks.

• Prompt drift → compact racing-specific schemas + caching by (driver, session).

• Rate limits (Gemini / ElevenLabs) → cache results and debounce generation.

Accomplishments that we're proud of

• Shipped an end-to-end pipeline: OpenF1/FastF1 → visuals → AI notes → voice → replay.

• Track-accurate animator with smooth scrubbing and lap jumps.

• Strategy-first visuals: stints, pit deltas, and pace trends pop at a glance.

• Teamwork & dev UX: PR flow, clean branches, and everyone running on localhost after early Windows/macOS/.env pains.

What we learned

• Short, structured prompts beat prose for racing insight.

• A few features (lap time, compound, pit flags) tell most of the story.

• Multi-layer caching is essential for telemetry-heavy UX.

Features in the Demo

• Session picker (Year → GP → FP/Quali/Race).

• Lap pace chart with 🔧 pit-out flags & MM:SS formatting.

• Pit stop comparison (grouped durations).

• Driver compares overlay (two traces).

• Gemini lap notes with time-linked navigation.

• ElevenLabs voice commentary feature.

Use Cases/ Industry Applications

1.) Live watch parties & broadcasts

2.) Post-race breakdowns

3.) Driver/team reviews

4.) Education & clubs

What’s next for TelemetryX2

• Live timing ingestion

• Two-driver deltas & sector heatmaps.

• Season aggregations & standings.

• Animator upgrades (multi-car focus, POV camera, speed traces).

🔒 Security Notes

• Keys live only in. env; rotate compromised keys (see GEMINI_SETUP.md).

• Frontend never receives secrets.

Built With

• elevenlabs
• fastapi
• gemini
• openf1api
• python