Skip to content

SensAIHackademy/SensAIWorldModelKits

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 

Repository files navigation

SensAI World Model Kits 🌍

This is a collection of world model kits for building immersive world model experiences across WebXR, Unity and Unreal Engine.

📝 Table of Contents

  1. WorldLabs WebXR Kit
  2. WorldLabs Unity Kit
  3. WorldLabs Unreal Kit
  4. Acknowledgements & Credits
  5. License
  6. Contact

Overview

1. WorldLabs WebXR Kit

🎯 A WebXR template project for building immersive world model experiences with Gaussian splats, spatial UI, and locomotion - runnable in any WebXR-capable browser.


  • Renders local or remote .spz/.ply Gaussian splats using SparkJS 2.0 with GPU-accelerated fly-in/fly-out animations
  • Includes Level-of-Detail (LoD) support - adjusts splat quality by distance to maintain stable framerates on headsets
  • Built on IWSDK for locomotion, grabbing, spatial UI, and XR session management

⚠️ Setup Notes

  • Prerequisites: Node ≥ 20.19.0 and a WebXR-capable browser
  • Splat Files: Keep large splat files outside the repo and load via URL

GitHub: 👉 WorldLabs WebXR Kit

WorldLabsWebXRKit

2. WorldLabs Unity Kit

🎯 A Unity package for generating and rendering 3D Gaussian Splatting scenes using the WorldLabs API with a built-in runtime VR world browser.


  • Generate 3D scenes from text prompts via the WorldLabs API
  • Real-time Gaussian Splat rendering with runtime loading and splat layer support
  • In-game VR/screen-space world browser and creator (WorldBrowserController)
  • Editor importer for browsing and importing worlds as project assets

⚠️ Setup Notes

  • Unity Version: 6000.2.10f1 recommended
  • Render Pipeline: URP required
  • Graphics API: D3D11 is NOT supported - use D3D12/Vulkan (Windows), Metal (Mac), or Vulkan (Android/Quest)
  • API Key: Obtain from WorldLabs and place in a .env file at the project root
  • Render Graph: Enable "Compatibility Mode (Render Graph disabled)" in Project Settings > Graphics
  • XR: Set OpenXR Render Mode to Multi-pass for VR builds
  • Meta Quest: Adding a Camera Rig from "Meta Building Blocks" may force D3D11 - switch back to Vulkan manually

GitHub: 👉 WorldLabs Unity Kit

WorldLabsUnityKit

3. WorldLabs Unreal Kit

🎯 An Unreal Engine 5.5 template project for rendering Gaussian splats using the XVERSE XV3DGS plugin.

  • Import .ply splat files directly via the XV3DGS editor tab - produces a converted splat and a Blueprint ready to place in your level
  • Includes a training tool to convert .mp4 video into .ply splat files (requires CUDA 11+)

⚠️ Setup Notes

  • Engine Version: Unreal Engine 5.5 only - XV3DGS is not compatible with later versions
  • Plugin: Included under Plugins/XV3dGS, enabled automatically
  • Hardware Ray Tracking: Make sure it is disables in project setting, due to incompatibility with XV3DGS
WorldLabsUnrealKit

4. Acknowledgements & Credits

  • Check out our Master SensAI Kits for a full collection of context-aware AI tools for Unity and Meta XR, ready to power your XR and AI projects
  • Join the Worlds in Action Hack and connect with a community of creators and innovators.
  • Visit our our SensAI Knowledge Hub for curated learning use cases and inspiration across AI, XR, and robotics.
  • Thanks to Nigel Hartman for the WorldLabs Unity package - a great source of AI & XR insights.
  • Big thanks to Johannes Tscharn for the Unreal and WebXR world model templates - check out his work for more cool XR projects.

Powered by SensAI Hackademy


5. License

📜 By downloading and using these kits, you agree to the License Terms.


6. Contact

✉️ Have questions, suggestions, or feedback? We’d love to hear from you! Reach out to us at hello@sensaihack.com



About

This is a collection of world model kits for building immersive world model experiences across WebXR, Unity and Unreal Engine.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors