Hands Free Gambling

Inspiration

We came to this hackathon with one goal: hack something. Starting with a trip to a nearby thrift store, we stumbled upon a broken Barbie Power Wheels Jeep and thought, "What if we turned this into a drivable Vegas casino?" We bought a drill from Home Depot, fixed the Jeep’s mechanics, and immediately started thinking about how we could bring a whole casino experience to life on wheels. The hackathon theme—casino—sealed the deal.

And so, Hands Free Gambling was born.

“The future is filled with less car crashes due to gambling addictions.” – us.

What it does

Hands Free Gambling is a driveable Barbie-themed casino powered by a Raspberry Pi. Players can:

🎰 Play Blackjack, Roulette, and Slot Machines using physical buttons or voice commands 🗣️ Get AI-generated voice feedback powered by Gemini for all game outcomes 💡 Experience an LED light show to celebrate big wins 🎵 Hear sound effects and instructions via an onboard speaker 🎧 Use a headset for voice input 🚗 Drive the entire setup around like it’s a mobile gambling den straight from Vegas

All of this runs inside a Barbie Jeep on a touchscreen powered by Python and Tkinter.

How we built it

Hardware Setup
- Raspberry Pi + Touchscreen: Hosts the casino UI and runs the games
- Headset (mic + speaker): Used for voice input and flashy output
- Arduino: Handles LED control via serial communication with the Pi
- LED strips: Flash colorful lights on big wins
- Barbie Power Wheels Jeep: The hacked vehicle chassis, originally broken, now reborn
Software Stack
- Built a Python/Tkinter GUI with three games: Blackjack, Roulette, and Slot Machine
- Used the Gemini API (via google.generativeai) to handle natural voice command parsing and response generation
- Enabled voice recognition via SpeechRecognition and feedback via pyttsx3
- Maintained game state across sessions with a custom CasinoState manager
- Voice commands are context-aware thanks to our VoiceCommandListener architecture
Features
- Smart voice parsing like “bet 25 on red”
- Game-specific command handlers for dealing, hitting, doubling down, spinning, etc.
- LED celebration lights on big wins 🎇

Challenges we ran into

Hardware repairs: The Barbie Jeep had multiple broken systems. We had to retrofit new wiring and power solutions just to get it rolling again.
Arduino-RPi communication: Getting LEDs to respond at the right time required serial communication tuning.
Voice recognition quirks: Parsing real spoken language into bet targets and amounts was trickier than expected.
Gemini integration: Getting concise voice feedback from a generative model without long-winded explanations took tuning.
UI layout: Ensuring the UI scaled correctly to the screen size on the Jeep’s touchscreen was harder than anticipated.

Accomplishments that we're proud of

We turned a thrift store toy into a fully operational, voice-controlled gambling vehicle.
Our games are feature-complete with real bet handling, chip tracking, win/loss logic, and feedback.
Voice support is rock-solid across games.
The whole system feels cohesive, immersive, and fun—with real Vegas vibes.

What we learned

How to interface voice models (Gemini) with real-time game logic
Python threading, Tkinter UI structuring, and hardware control with RPi.GPIO and Arduino
Arduino-to-Raspberry Pi communication via digital
How to make software feel alive through sound, light, and interactivity
The value of prototyping fast and iterating in a hardware-software hybrid project

What's next for Hands Free Gambling

Self-driving mode: Let the casino drive itself to you
Multiplayer games: Add support for local competitive games like Texas Hold’em
Camera detection: Use a webcam and image recognition to detect physical playing cards
Enhanced speech control: Support full conversations and responses to “What’s my chip count?” or “How do I play?”
Mobile version: Deploy the games as a standalone Android Auto app