Inspiration

The idea was born from the concept of bringing a journal to life. Journaling is a powerful tool for self-reflection and emotional processing, but what if you could immerse yourself in those emotions? What if the world around you could change based on how you feel or what you've written? We wanted to create an experience where players can explore their inner world in a more interactive and dynamic way, amplifying their emotions through an evolving environment.

What it Does

HeadSpace takes your journal entries and turns them into a living, breathing world. As you write or speak your thoughts, the game uses AI to interpret your words and generate a 3D environment that reflects your emotions. Whether it's a serene forest when you're feeling calm or a stormy sea when you're overwhelmed, the environment changes to match your mood. The goal is to provide a unique and immersive way for players to explore their emotions and gain insight into their mental state.

How We Built It

  • Unity: The core of our game development, allowing us to build a dynamic and interactive environment.
  • Sloyd: Our go-to for AI-generated 3D models. It provided the visual elements that populate the world based on the player's journal entries.
  • Groq: This AI handles the journal processing:
    • Extracting references to 3D objects from the text.
    • Performing sentiment analysis to gauge the player's mood and select appropriate environmental elements.
  • Picovoice: Integrated for speech-to-text capabilities using Cheetah real-time STT, so players can simply talk to their journal and have the world respond in real-time.

Challenges We Ran Into

  • C# Coroutines: We had to master coroutine management to ensure smooth, concurrent execution of time-consuming tasks. It was a steep learning curve, but we got there.
  • Unity Game Object Management: Unity's scene state management proved to be quite the puzzle. Merge conflicts in Git that didn't actually exist? Check. Navigating these complexities required us to develop a robust workflow to keep everything running smoothly.

Accomplishments That We're Proud Of

  • Optimized Coroutine Calls: By enhancing coroutine execution, we ensured the game runs seamlessly, even when handling multiple tasks concurrently.
  • Secured Collaboration with Sloyd: We caught the attention of Sloyd, which provided efficient environmental assets to enhance our game's world.
  • Created Stunning 3D Objects: We managed to create impressive 3D objects and environments within a tight timeframe, adding depth and immersion to the player experience.
  • Team Collaboration: We tackled and solved numerous challenges as a team, showing that effective collaboration leads to great results.

What We Learned

  • Technical Skills: We deepened our understanding of coroutine management in C# and the intricacies of Unity's scene management.
  • AI Integration: We learned how to effectively leverage AI for sentiment analysis and 3D model generation, enhancing the player experience.
  • Workflow Management: Dealing with Unity's quirks taught us the importance of a solid workflow and careful scene management.

What's Next for HeadSpace

  • Publishing: We're looking to publish the game so it can be accessible to everyone seeking a unique emotional therapy experience.
  • Enhanced Model Processing: Once online, we plan to improve our 3D model processing by using GLB models and leveraging MASV for dynamic large file handling.
  • Virtual Reality (VR): We would love to put this experience into VR for a more immersive experience. We were planning to implement during the Hackathon, but we were not able to acquire a headset.

HeadSpace is just getting started, and we can't wait to see how players interact with and benefit from this immersive journaling experience!

Built With

Share this project:

Updates