What it does
Splat is an AR game that lets users paint their surroundings using their voices -- the most primal & powerful form of human expression. As the user sings/talks their pitch and volume directly influence the colors and styles of the paint they're applying; higher pitches produce warmer colors, while lower tones create cooler hues.
This creates a full-body, multi-sensory experience that encourages users to explore & interact with the environment, and express themselves in unprecendented ways!
Inspiration
Our team was inspired by the therapeutic effects of both music and art. We envisioned a world where people could express themselves creatively through both voice and movement, transforming their environment into a canvas of color and sound.
The idea of "splatting" an environment originates from the video game "Splatoon"
How we built it
We built it with Lens Studio software -- a platform for developing on Snapchat Spectacles.
We utalized the the Mel Spectrogram to to perform pitch analysis, and the Lens Studio audio library to perform volume analysis. We then connect the result of analysis to the painting mechanism.
We created customized painting textures and sounds to add a visual flair to the painting results, using photoshop and audacity.
We also created our own particle system: when a paintball hits a surface, we create a particle impact effect using a mesh emitter, which outputs a burst of randomly generated shapes.
Accomplishments that we're proud of
We tied voice and music to color and space! In doing so we have created a new dimension for human expression.
We are proud of our visual & audio effects; they bring together a cohesive painting experience.
Our application runs in ultra low latency; emotions in every word translate into different colors and brushstrokes -- every piece of artwork tells a sonic story!
What's next for Splat
More complex brush-strokes -- given the time constraint, we only implemented few splat patterns; we wish to implement many more to increase the visual flair.
Multiplayer -- it'd be 10x cooler to hear each other's voice and visualize each other's spoken-out-loud thoughts.
Persistence -- we want to capture & preserve one's spacial-emotional moments!
Challenges we ran into
We put in some effort & had a lot of fun learning about the specifics of Snapchat's dev tools and APIs.
Initially we also ran into some version-controlling issues -- merging none-text files led to much confusion.
Built With
- lensstudio
- snapchatspectacles
Log in or sign up for Devpost to join the conversation.