Aww Sheet!

Homepage
Generate Sheet Music + Gemini Chatbot
Competition
Begin!

Inspiration

In today’s tech driven world, many traditional art forms are fading, including the beautiful craft of writing and reading classical sheet music. Fewer people are learning how to read music or pick up an instrument, often because it feels intimidating or outdated. This app was created to make music creation fun again, letting anyone bring their melodies to life without needing to know complex theory. It encourages creativity, playfulness, and friendly competition through an interactive battle mode that turns learning music into an exciting game. Combining all of this together we created "Aww Sheet!"

What it does

What doesn’t it do, Awww Sheet is an interaction violin performance and training platform that combines real time music transcription, learning and gaming. It listens to a user’s violin performance, transcribes the audio into sheet music, and gives useful information such as corresponding chords, key signatures, and beats per minute. Users also have the ability to challenge another person in our “Battle Mode”, a system where players perform up to 10 seconds of a chosen song. The system will then analyze both recordings, determines who played the most accurate notes and displays detailed results showing each person’s detected notes. Additionally, we included a music theory chatbot, The Director, that acts like an instructor who explains notes, theory concepts and how they relate to the user’s performance.

How we built it

Frontend: We built Aww Sheet’s frontend with React and TypeScript to keep everything smooth and easy to manage. Tailwind helped us bring our beige, cream, and navy palette to life, capturing the feeling of working on real sheet music. We used shadcn/ui for the interface, Framer Motion to make notes flow gracefully across the screen, and Lucide React for clean and consistent icons. Every transition, color, and sound was carefully tuned to feel musical, almost as if the app moves in rhythm with you.

Audio Capture: we used Libra, a python library that aided us in pitch tracking, timing analysis and other musical statistics.

Music Theory & Transcription: we music21 which allowed us to detect out musical notes and map them to key signatures, identify chord and formatting. We created custom pitch recognization methods that help us convert the raw frequencies into note names and merge frames into playable notes

Backend: Our backend consist of FastAPI, Unicorn and Starlette. These tools allowed us to quickly deploy our server and allow it to run smoothly.

A.I Bot/Deployment Our chatbot was made using the Gemini API and we deployed our site using Vercel.

Challenges we ran into

One of the main issues we encountered in our project was rhythm detection. The software initially struggled to detect when notes changed between bow strokes — it would either produce false notes or skip them entirely. We experimented with several techniques and ultimately fixed this by adjusting the note detection margin, allowing problematic notes to be ignored rather than misclassified. Another issue we faced was getting Battle Mode to work efficiently. Early on, the algorithm that determined the better player wasn’t very accurate and often selected the weaker performance as the winner. We resolved this by fine-tuning the algorithm to be more sensitive to lower-pitched notes and to compare note sequences more precisely with the reference song the players were attempting to replicate.

Accomplishments that we're proud of

We are proud of how Aww Sheet became more than just a tool, it feels like an experience. The colors blend seamlessly, the notes drift naturally, and every detail feels alive. Game Mode brings a playful edge to practice, turning performance into friendly competition. The Director chatbot gives that authentic practice makes perfect energy, pushing users to improve while keeping the soul of music alive.

What we learned

Aww Sheet aims to make that tradition feel exciting again by blending creativity with technology and gamified learning. We also learned how powerful design, timing, and sound can be when they work in harmony. Most of all, we discovered that music’s heart can live on, even through code.

What's next for Aww Sheet!

Aww Sheet is just getting started. In future versions I want to bring even more depth to how people interact with their music. The next big step is teaching the app to transcribe full chords and write them directly into the sheet music so every harmony comes to life on screen. I also plan to expand Game Mode with a growing library of songs and challenges that keep players inspired to learn and compete. The goal is to make Aww Sheet feel like a living music studio where creativity and play go hand in hand.