MR Blueprint

Inspiration

Spatial thinking is still fragmented. Whether you're learning physics, designing systems, or prototyping ideas, you jump between sketching, modeling, and simulation tools that don’t connect. At the same time, XR and stylus input have matured—but are still mostly used for viewing, not thinking.

MR Blueprint started from a simple idea: what if your environment itself became a system you could design, test, and understand in real time?

What it does

MR Blueprint is a mixed reality physics sandbox that turns your space into an interactive lab. Users can place objects, draw behaviors like springs and hinges, adjust physical properties, and run simulations instantly.

Instead of just watching motion, users see trajectories, vectors, and live data—making cause and effect intuitive and immediate.

How we built it

Built in Unity for Meta Quest, MR Blueprint combines spatial interaction, stylus input, and real-time simulation into one continuous workflow:

A world-space editor with floating UI and content drawer
Object spawning and manipulation for rapid scene setup
A physics inspector to tune mass, friction, restitution, and more
Draw Mode powered by Logitech MX Ink, enabling users to sketch constraints and behaviors directly in 3D
A simulation engine with pause, restart, and full scene restore
A visual feedback layer with trajectories, vectors, motion paths, and live graphing

Everything is designed around a tight loop: build → draw → simulate → iterate.

Challenges we ran into

Making a 3D, world-space interface feel intuitive without traditional UI patterns
Turning stylus input into something meaningful and expressive, not just precise
Maintaining performance and responsiveness during live simulation
Designing visualizations that clarify behavior without adding noise
Balancing power and simplicity in a first-time user experience

Accomplishments that we're proud of

Transforming MX Ink into a true behavior authoring tool
Delivering a complete end-to-end XR workflow, not just a feature demo
Enabling instant iteration with scene restoration, encouraging experimentation
Creating a clean, demo-ready experience that feels like a real product
Showing how XR can support understanding and reasoning, not just visualization

What we learned

Direct, spatial interaction dramatically improves intuition and engagement
People understand systems faster when they can see behavior unfold live
Stylus input becomes powerful when mapped to system-level meaning
A tight, repeatable workflow loop is more valuable than feature complexity
XR + real-time feedback is especially strong for education and prototyping use cases