Handling Input on HoloLens and Mixed Reality Immersive Headsets

Input handling for hands and controllers on the Microsoft Mixed Reality platform has changed a bit with the latest Unity3D Release (Unity 2017.2.0f3 and the Windows 10 Fall Creators Update Build 16299).

The key API is still InteractionManager, with some changes in the properties and events.

Sample usage for HoloLens Hand tracking is at:
https://github.com/ritchielozada/HoloLensHandTracking

Sample usage for the Mixed Reality Immersive headsets is at:
https://github.com/ritchielozada/MixedRealityInput

The new Mixed Reality Motion controllers work across various headsets,  I used the units bundled with the Samsung HMD Odyssey with my Acer HMD as long as it’s paired with the workstation.

I also provide sample virtual movement supporting the camera and motion controllers in the scene and parenting the camera and controllers so they are not “left behind” when the camera is virtually moved — a common question raised during our training sessions.

 

Xbox One X and Samsung HMD Odyssey Delivery

Xbox One X and Samsung HMD Odyssey Delivery

My pre-orders arrived one day after each other from the Microsoft Online Store.

  • Samsung HMD Odyssey Windows Mixed Reality Headset with Motion Controllers
  • Xbox One X 1TB Console – Project Scorpio Edition

The Samsung Odyssey Mixed Headset is surprisingly comfortable considering it’s a bit heavier compared to my Acer and HP headsets.  I’m enjoying the Motion Controllers and I’ll be checking out the changes to the Mixed Reality Input API’s over the next few days.

Eventually, I’ll have enough time to play on the new Xbox.

 

 

Handling Controller Input for Immersive Mixed Reality Headsets

Handling Controller Input for Immersive Mixed Reality Headsets

Microsoft recently started shipping the new Immersive Mixed Reality Headsets and while built with the same technology spatial tracking as the HoloLens, we don’t have hand gestures for Input.

The current immersive mixed reality headsets are tethered to a PC so developers have some flexibility on input devices, the typical experience is with an Xbox Game Controller or the announced Motion Controllers.

Continue reading “Handling Controller Input for Immersive Mixed Reality Headsets”

Getting Started with Immersive Mixed Reality Headset – Part 3: Development

Getting Started with Immersive Mixed Reality Headset – Part 3: Development

Time to code for Windows Immersive Mixed Reality!   The device setup is done, the Mixed Reality Portal works and inside-out tracking rocks!   We’re not anymore bound by the sensor placement requirements of Oculus Rift or setting up HTC Vive lighthouses on high poles.   I’m also enjoying the HP Mixed Reality Headset build quality and the headband feels secure and cushioned nicely compared to other models I’ve used.

MR-OSFastRing

It took a while to update to the Windows 10 Insider Build (1703-16251.0) — so a bit of patience or doing the dev workstation update with a high-speed Internet link and SSD OS drives; the price paid for being an early adopter.

Continue reading “Getting Started with Immersive Mixed Reality Headset – Part 3: Development”

Getting Started with Immersive Mixed Reality Headset – Part 2: Workstation

I followed the notes on the  Mixed Reality – Install The Tools alongside Mixed Reality – Immersive Headset Setup guide to configure Windows 10 Creators Update.  I updated to the latest available Windows 10 Release (1703 15063.502 as of writing) and hoped that I’m in good enough driver state for the workstation I use with my Oculus and HTC Vive setup.

MR-OSVersion2

Time to plug-in my new Mixed Reality Headset just in case the workaround mentioned in the guide is still needed.   I’m using an ASUS GTX-1080Ti Graphics card on an ASUS ROG MAXIMUS VIII motherboard for reference.  My setup concern is with the USB3 ports — that it is hardware and driver compatible; and to a lesser extent hoping the Head Mounted Display (HMD) is clean without dead/bright pixels.

Continue reading “Getting Started with Immersive Mixed Reality Headset – Part 2: Workstation”

Getting Started with Immersive Mixed Reality Headset – Part 1: Unboxing

I finally received delivery of my personal pre-ordered Microsoft Mixed Reality Immersive Headsets.  I ordered the listed units after they were announced at //BUILD without waiting for the bundle offers for the controllers just to get the headsets early.  There were two models available for order at the Microsoft Store from Acer and HP; the HP Windows Mixed Reality Headset Developer Edition arrived first.

Box-01

Continue reading “Getting Started with Immersive Mixed Reality Headset – Part 1: Unboxing”