Spatial Architect

Spatial Architect is a mixed-reality training platform that teaches 3D artists spatial motor control through structured drawing drills.

Comment

Note: See attached PDF for project one-page document

Inspiration

I love the idea of creating 3D art in a VR headset instead of Blender. It feels intuitive and physical, but I've struggled to draw lines and forms accurately. Having benefited from 2D drawing drills, I wanted to create an application that makes it fun to improve your hand-eye coordination when drawing in 3D. I think the MX Ink stylus would be a great tool for this application, and want to feature it as the high-precision option for training and drawing in 3D.

What it does

Informed by recent learning studies, the training application will initially focus on wireframe tracing drills to give artists a strong muscle memory for 3D form. Users will start by developing hand-eye coordination by tracking simple lines, and continue by unlocking progressively challenging drills until they are drawing wireframes of more complex objects. Audiovisual feedback helps the user perceive their level of accuracy during the drill.

Performance metrics are tracked for each exercise, helping users to analyze what skills to work on. Unlocking levels and getting 5-star scores helps users see progress and improve confidence throughout their journey. Existing VR art tools focus on expression, not structured skill acquisition. Spatial Architect is the first system built specifically for measurable spatial motor skills training.

How I built it

I created a prototype in Unity with the Meta Unity Core SDK.

Current prototype features:

  • A series of line-based tracing drills
  • After drawing a line, the line changes color based on your accuracy. This is currently calculated by looking at the average distance between your line and the reference line.
  • Audio (pitch) feedback while drawing the line, to sense how close your trace is to the reference.

It currently uses Quest controller tracking, and it should be straightforward to integrate with the MX Ink stylus using the Logitech-provided package.

Challenges I ran into

Without something like this already available, I’ve had to design a unique UX and learning path system. I’ve used 2D art lessons, design studies, educational studies as references for designing the learning journey. I plan to get lots of user feedback to make sure that the app accomplishes the goal of being fun and effective at teaching 3D drawing skills.

Accomplishments that I'm proud of

I’m happy with the prototype experience so far. It feels right and I can see the progression system being motivating. I look forward to developing it further and using it myself to get better at creating 3D art in my VR headset.

What I learned

I’ve learned a lot about different control systems in VR. The Logitech design documentation was helpful for understanding benefits of using a VR stylus over a power-grip controller (precision, intuitive grip, lightweight, and 2D surface drawing).

From other studies, I’ve also learned that 3D drawing is a unique skill that isn’t directly transferable from 2D drawing or spatial understanding. I think this leaves an opportunity for both new and experienced artists to benefit from 3D drawing training.

What's next for Spatial Architect

I’d like to add the following core features for a v1 prototype:

  • 3D drawing mode with MX Ink support
  • Unlocking progression system
  • Accuracy metrics and rating for each drill
  • Basic accessibility features for position / rotation of shapes

Based on feedback, and as time allows, these are other features I’m considering:

  • Additional metrics (consistency, speed, streak, reps, progression charts)
  • Specific 2D surface mode training for MX Ink
  • Deeper qualitative instruction on technique and form based on research and best practices
  • Deeper narrative or game elements
  • Hand tracking input method support

Built With

Share this project:

Updates