Introduction to Mixed Reality with HoloLens

Clemente Giorio

Matteo Valoriani

Marco Dal Pino

Agenda

AR/VR/MR

HoloLens DEMO

Gestures, Input, Voice CommandsWeb Portal

HoloLens Inside

What NEXT?

AR/MR/VRWhat are the difference?

Apollo Guidance

Computer

2000 Transistor

4k Memory

CPU evolution

2015

2010

2005

1995 5M transistors/chip

160M transistors/chip

1B transistors/chip

71B transistors/chip (2B chip mobile)

UI Dimensions

Transactional

App = Code + Markup

Immersive

App GPU intensive

2D UI

Personal Assistant:Siri, Google Now, Echo, Cortana

Machine Learning Machine2Machine

1D UI

Virtual, Augmented and

Mixing Reality

3D UI

Reality virtualitycontinuum

The area between the two extremes, where both the real and the virtual are mixed, is called mixed reality.

This in turn is said to consist of both augmented reality, where the virtual augments the real, and augmented virtuality, where the real augments the virtual.

https://en.wikipedia.org/wiki/Mixed_realityhttps://en.wikipedia.org/wiki/Augmented_realityhttps://en.wikipedia.org/wiki/Augmented_virtuality

Quiz

AR

AV

VR

https://www.google.it/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwil8suozOrPAhUEtRQKHZ0yDFAQjRwIBw&url=http://bgr.com/2016/07/06/pokemon-go-ios-android-download/&psig=AFQjCNHYN_Rfx-UEaOV1wizwhkEu4OmG-w&ust=1477094541096291

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

https://www.google.it/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjjsLOkz-rPAhXC1hQKHZTgAHsQjRwIBw&url=http://fortune.com/2015/11/16/virtual-reality-journalism/&bvm=bv.136499718,d.ZGg&psig=AFQjCNFdAiBSB31PugmZzfuvqbO_AFF3gw&ust=1477095386617082

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Recap

Introductionto HoloLens

Different Devices

Magic is in the air

advanced technology is indistinguishable from

(Arthur C. Clarke)

To be a new magician

You have to be a

good illusionist

https://www.youtube.com/watch?v=u_diRgwPCS8

DemoGestures, Input, Voice Commands

HoloLens Inside

HololensPrototype

HololensDevice - Confort

HololensDevice - Confort

HololensDevice Sensor Bar

HololensDevice Sensor Bar

Ambient Light

Sensor

2MP Photo (2048x1152)/ HD Video Camera (1408x792)

Depth CameraIR Camera based on Time-Of-FlyHands Tracking + Surface reconstruction + Object Position

4 Environment Understanding CameraGray Scale Cameras

Create Map of the Room

HololensDevice Optics

HololensDevice Optics

IMUGyroscope + Magnetometer + AccelerometerFast Position Updates (2.5k radiants(light points per radian)Automatic pupillary distance calibration

See-through holographic lenses (waveguides)R - G B Layers

HololensDevice InternalHardware

HololensDevice InternalHardware

Memory: 64GB Flash / 2GB RAM

Processor: Intel Atom x5-Z8100 1.04 GHz 64-bitIntel Airmont (14nm) 4 Logical

GPU: Intel 8086h, Dedicated Video Memory 114 MB, Shared System Memory 980 MB

Custom-built Microsoft Holographic Processing Unit (HPU 1.0)

Battery: 16,500 mWhWeight : 579g

HololensDevice 3D SpatialSound

HololensDevice 3D SpatialSound

Built-in speakers.A precise audio experience without

block out the real world.

Spatial sound.Using a scientific model that characterizes how the human ear receives sound from a specific location, MicrosoftHoloLens synthesizes sound so that you can hear holograms from anywhere in the room.

What Next?

Project Alloy

Wireless VR/MR device

2 RealSense for spatialand handstraking

Commercial optionsKiosk mode. With HoloLens kiosk mode, you can limit which apps to run to enable demo or showcaseexperiences.

Mobile Device Management (MDM) for HoloLens.Your IT department can manage multiple HoloLens devices simultaneously using solutions like Microsoft InTune. You will be able to manage settings, select apps to install and set security configurations tailored to your organization'sneed.

Identity.Azure Active Directory and next generation credentials with PINunlock.

Windows Update for Business.Controlled operating system updates to devices and support for long term servicingbranch.

Data security.BitLocker data encryption and secure boot is enabled on HoloLens to provide the same level of security protection as any other Windowsdevice.

Work access.Anyone in your organization can remotely connect to the corporate network through a virtual private network on a HoloLens. HoloLens can also access Wi-Fi networks that requirecredentials.

Windows Store for Business.Your IT department can also set up an

specific HoloLens usage. Securely distribute your enterprise software to selected group of enterpriseusers

Meta 2

Magic Leap

Daqri

HTC Vive / OculusRift2