Mixed Reality with Microsoft HoloLens

Transcription

1 Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 goto; conference Berlin Image: microsoft.com/hololens

2

3 Philipp Bauknecht Founder & CEO medialesson 4x

4 AR vs. VR vs. MR

5 Virtual Reality Augmented Reality Mixed Reality

6 Virtual Reality Augmented Reality Mixed Reality Image: gospelherald.com Image: parenting.blog.austin360.com Image: littleover.derby.sch.uk

7 Virtual Reality Augmented Reality Mixed Reality Immersion Immersion Immersion Comfort Comfort Comfort Collaboration Collaboration Collaboration Mobility Mobility Mobility

8 Holograms

9 What is a Hologram? A hologram is an object like any other object in the real world, with only one difference: instead of being made of physical matter, a hologram is made entirely of light. Holographic objects can be viewed from different angles and distances, just like physical objects. Holograms do not offer any physical resistance when touched or pushed because the don t have any mass.

10 Image: Lucasfilm

11 Image: Marvel/Paramount Pictures

12 Microsoft HoloLens

13 Mixed Reality + Virtual Reality Spatial Mapping Fully unthered Runs Windows 10 Interaction usinggaze, gestures and voice

14 Volume up/down Brightness up/down Intel Atom CPU Custom-build Holographic Processing Unit (HPU) 579g 64GB Flash 2GB RAM Wi-Fi ac Bluetooth 4.1 LE See-through holographic lenses (waveguides) 2 HD (720p) 16:9 light engines Automatic pupillary distance calibration Build-in speakers Spatial audio Battery 2-3 hours of active use Fully functional when charging Passively cooled (no fans) Image: microsoft.com

15 4 Environment understanding cameras 2MP photo& HD video camera depth camera Micro USB Microphones Ambient light sensor Audio 3.5mm jack Image: microsoft.com

16

17 Use scenarios

18 Image: microsoft.com Marketing

19 Image: microsoft.com Product Design

20 Image: microsoft.com Education

21 Image: microsoft.com Architecture

22 Remote Services Image: microsoft.com

23 Image: microsoft.com Research & Science

24 Games & Entertainment Image: microsoft.com

25 Image: microsoft.com Semi-virtual Construction

26 Current Projects

27

28 Live Demo

29 Development

30 Tooling Visual Studio 2015 with Update 3 (free as Community Edition) Pro tip: Make sure to pick Tools (1.4) and SDK ( ) of the Universal Windows App Development Tools when doing a custom install. HoloLens Emulator Unity 5.5.0b11 (as of November 9 th ) Pro tip: Do not use the HoloLens Technical Preview builds of Unity as they are outdated and broken.

31 Framework options All apps are Universal Windows Platform (UWP) apps Raw power: DirectX 11 using C++ or C# with SharpDX Easy to prototype and build: Unity using C#

32 App view options Holographic View 2D View Image: microsoft.com Image: microsoft.com

33 App view options Holographic View Creates holograms No other app can draw at the same time Can render world-locked holograms Shell does not render at the same time App is responsible to handle all user input. 2D View Renders on a slate Slates are world-locked and can be adjusted in size and position by the user Apps resolution stays fixed Apps have to switch into 2D view for keyboard entry All UWP apps run in 2D view without modifications Image: microsoft.com Image: microsoft.com

34 Development workflow using Unity 1. Use Unity to layout your scenes, place holograms, camera and light 2. Develop components using Visual Studio. 3. Export the project from Unity as Visual Studio Solution. You will still be able to modify scripts but not a scene. 4. Deploy app to the Emulator or your real device.

35 Demo Workflow

36 Where to start 1. Grab the tools 2. Attend the free Holographic Academy online US/WINDOWS/HOLOGRAPHIC/ACADEMY 3. Deep dive into the Holographic App Development documentation 4. Check you open source Galaxy Explorer app on GitHub 5. Submit your first app to the Windows Store

37 How to buy Availabily Australia Canada Ireland France Germany New Zealand United Kingdom United States Order online at microsoftstore.com Developer Edition EUR incl. VAT Commercial Suite EUR incl. VAT

38 Thanks. Questions?

39