AR/VR and Motion Recognition: The Microsoft Hololens

With all the hype in the AR and VR world, many people are asking: what type of practical applications are there that can help industry, cities, or people to live better lives. It's fun to use and AR/VR headset for a video game, however it's not the groundbreaking use case many people were hoping for.


Some examples of practical applications include: measurements, data overlay (e.g. pricing info, image analysis, etc.), and team dynamics.  Our team got a hold of a Microsoft Hololens to explore other useful applications, here are our results:


Here is first use of hololens with our team: 


The purpose of exploring in such an avenue was to determine the natural interface with limited education; and overall for Mixed-Reality the experience the visual representation was aligned with expectations.


The largest challenge was the gesture interface; which can be balanced with the provided clicker. Our initial experience led to only understanding the pinch/click gesture, which tags important items.


Then we explored how to place 3D objects in space:

In this demo, we took an elephant and rotated to further inspect the item. This could be a useful application in enterprise and industrial use cases to look at plans three dimensionally.

Finally we tried to interact with dinosaurs. 


For the purpose of Kiwi, we are exploring how other smart devices can be augmented with the hololens to fuse a more intuitive and natural interactive experience.


The biggest gaps we see right now with the Hololens is the lack of insight generated for the wearer to make them self aware, perception analysis with people interacting with you, and natural movement response. Our goal with the Hololens is to connect motion and biometric sensors to cover the above gaps.


This could include heart rate and body language analysis, simplified augmented sentiment, or being able to interact with objects in space relative to gesutres such as a wrist rotation while wearing a smart device.


If you want to try out our hololens application, we'll be showcasing it at CES 2017 this year. Come visit our booth (#44322) in the Sands A-D Hall to try it out. We'll be focusing our efforts on gaps in the hololens as mentioned above.

Sign up here to receive prelimary videos and stories as we build a new type of interaction with the hololens, including: an animal, motion sensors, and heart rate sensors.