Skip to content

"Select" voice command does not fire the appropriate events when using OpenXR on HoloLens 2 #10154

@cj-lopez

Description

@cj-lopez

Describe the bug

When you Gaze and say "Select" on a HoloLens 2, the MRTK input system should fire the appropriate events for the "select" action. This no longer works like it did for the Legacy XR. Other keywords work just fine.

To reproduce

Steps to reproduce the behavior:

The easiest way to see the problem is with the EyeTrackingDemo example

  1. Install the OpenXR Plugin
  2. Import the EyeTracking demo
  3. Deploy to the HoloLens 2
  4. In the TargetSelection scene, say "select" while looking at a gem, the speech confirmation tooltip appears, but the gem does not explode. Saying "explode" does explode the gem.
  5. Gaze at a different scene in the Scene Menu and say "select". It's no longer possible to change scenes with the "select command".

Expected behavior

Saying "Select" should fire the appropriate events to cause a "select" action.

Screenshots

Unfortunately, the "select" tooltip isn't captured when I try to take a screenshot.
Select

Your setup (please complete the following information)

  • Unity Version 2020.3.15f2
  • MRTK Version 2.7.2
  • MR OpenXR Plugin 1.0.2
  • OpenXR Plugin 1.2.8
  • XR Plugin Management 4.0.7

Target platform (please complete the following information)

  • HoloLens 2

Metadata

Metadata

Assignees

Labels

BugUrgency-SoonHigh priority issues to be worked on after Urgency-Now issues

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions