RAE (Robotics Access for Everyone) Unity plugin and Simulation

RAE For Unity is in active development. Its features and API are subject to significant change as development progresses. Code coming soon !

What is RAE For Unity?

RAE For Unity is Unity plugin enabling RAE robot digital twin simulation.

Main goals are:

• Digital twin of RAE (virtual RAE simulation) enabling development in virtual environment.
• Connect to real RAE using ROS integration (rae-ros and depthai-ros) with smooth transition from sim to real.
• Abstract ROS stack and develop from Unity.
• Develop native apps from basic control to augmented reality (AR) / mixed reality (MXR).
• Unlock Unity power with third party assets.
• Publish topics from simulation and subscribe topics from real RAE for convenient ROS development.

Examples coming (may use third party assets from Asset Store):

• Mobile (iOS / Android) and Desktop native app to control RAE including:
  • use PS4 game controller to control RAE
  • use voice control
  • how to use all peripherals

• Augmented Reality using native iOS/Android
  • Touch and Go control

• Mixed Reality using Meta Quest 3 (Coming soon)

• Using GPT4V for obstacle avoidance and navigation