Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 - PowerPoint PPT Presentation

Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 goto; conference Berlin Image: microsoft.com/hololens

Philipp Bauknecht Founder & CEO medialesson GmbH @GrillPhil 4x

AR vs. VR vs. MR

Virtual Reality Augmented Reality Mixed Reality

Virtual Reality Augmented Reality Mixed Reality Image: gospelherald.com Image: parenting.blog.austin360.com Image: littleover.derby.sch.uk

Virtual Reality Augmented Reality Mixed Reality Immersion Immersion Immersion ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ Comfort Comfort Comfort ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ Collaboration Collaboration Collaboration ฀ ฀ ฀ ฀ ฀ ฀ Mobility Mobility Mobility ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀ ฀

Holograms

What is a Hologram? • A hologram is an object like any other object in the real world, with only one difference: instead of being made of physical matter, a hologram is made entirely of light. • Holographic objects can be viewed from different angles and distances, just like physical objects. • Holograms do not offer any physical resistance when touched or pushed because the don‘t have any mass.

Image: Lucasfilm

Image: Marvel/Paramount Pictures

Microsoft HoloLens

Mixed Reality + Virtual Reality Spatial Mapping Fully unthered Runs Windows 10 Interaction usinggaze, gestures and voice

V olume up/down Brightness up/down Build-in speakers Spatial audio Intel Atom CPU Custom-build Holographic Processing Unit (HPU) Battery 2-3 hours of active use Fully functional when charging 579g Passively cooled (no fans) 64GB Flash 2GB RAM See-through holographic lenses (waveguides) 2 HD (720p) 16:9 light engines Wi-Fi 802.11ac Automatic pupillary distance calibration Bluetooth 4.1 LE Image: microsoft.com

4 Environment understanding cameras 2MP photo& HD video camera depth camera Micro USB 2.0 Audio 3.5mm jack 4 Microphones Ambient light sensor Image: microsoft.com

Use scenarios

Marketing Image: microsoft.com

Product Design Image: microsoft.com

Education Image: microsoft.com

Architecture Image: microsoft.com

Remote Services Image: microsoft.com

Research & Science Image: microsoft.com

Games & Entertainment Image: microsoft.com

Semi-virtual Construction Image: microsoft.com

Current Projects

Live Demo

Development

Tooling • Visual Studio 2015 with Update 3 (free as Community Edition) Pro tip: Make sure to pick Tools (1.4) and SDK (10.0.10586) of the Universal Windows App Development Tools when doing a custom install. • HoloLens Emulator • Unity 5.5.0b11 (as of November 9 th ) Pro tip : Do not use the HoloLens Technical Preview builds of Unity as they are outdated and broken.

Framework options • All apps are Universal Windows Platform (UWP) apps • Raw power: DirectX 11 using C++ or C# with SharpDX • Easy to prototype and build: Unity using C#

App view options Holographic View 2D View Image: microsoft.com Image: microsoft.com

App view options Holographic View 2D View • Creates holograms • Renders on a slate • No other app can draw at the same • Slates are world-locked and can be time adjusted in size and position by the • Can render world-locked holograms user • Shell does not render at the same time • Apps resolution stays fixed • App is responsible to handle all user • Apps have to switch into 2D view for input. keyboard entry • All UWP apps run in 2D view without modifications Image: microsoft.com Image: microsoft.com

Development workflow using Unity 1. Use Unity to layout your scenes, place holograms, camera and light 2. Develop components using Visual Studio. 3. Export the project from Unity as Visual Studio Solution. You will still be able to modify scripts but not a scene. 4. Deploy app to the Emulator or your real device.

Demo Workflow

Where to start 1. Grab the tools 2. Attend the free Holographic Academy online https://developer.microsoft.com/EN- US/WINDOWS/HOLOGRAPHIC/ACADEMY 3. Deep dive into the HolographicApp Development documentation https://developer.microsoft.com/en- us/windows/holographic/documentation 4. Check you open source Galaxy Explorer app on GitHub https://github.com/Microsoft/GalaxyExplorer 5. Submit yourfirst app to the Windows Store

How to buy Availabily Order online at microsoftstore.com • Australia • Canada Developer Edition • Ireland 3.299 EUR incl. VAT • France • Germany Commercial Suite • New Zealand 5.489 EUR incl. VAT • United Kingdom • United States

Thanks. Questions?