Jennifer Colegrove (Touch Display Research) AR & VR Human Machine Interaction Sensor Technologies

June 1, 2016

Jennifer Colegrove, Ph.D.

[email protected]

AUGMENTED REALITY & VIRTUAL REALITY

HUMAN-MACHINE INTERACTION SENSOR

TECHNOLOGIES AND MARKET FORECAST

All rights and property of Touch Display Research Inc. 2016

Outline1. Hot trends in 2016

2. Augmented reality and virtual reality devices

3. Artificial intelligence devices

4. Market driver for sensors

5. Sensor technologies

– Gesture control

– Eye tracking

– Voice recognition

– Other touchless sensors

– Touch sensor and touch pad technologies

6. Sensors for AR, VR, and AI market forecast to 2022

7. Summary and business strategy recommendations


Hot Trends in 2016

• Smart home: Google/NestLabs $3.2 B

• 4K, 5K, 8K, transparent

• Quantum dot

• Near-eye devices

• Flexible display, curved

• Touch panel: ITO replacement, in-cell, on-cell

• Touchless control: gesture, voice, proximity

• Google, Apple into automotive

• Active pen: Apple Pencil, Microsoft/N-trig

• Wearable: watches, fitness, baby care, pet tracker

• Authentication: finger print, voice, Iris

• AR & VR

Source: NestLabsTDR,Facebook/Oculus

Source: Touch and Emerging Display monthly report







– Gesture control

– Eye tracking







AR VR devices• Augmented reality (AR) devices include:

• Virtual reality (VR) devices include:

Amazon Firephone Samsung Gear VR Nintendo DSi

Octagon

Facebook/Oculus

HTC Vive Toshiba

Source: Touch Display Research, Sensor for AR VR AI 2016 report


Artificial Intelligence devices

AmazonGEMECODViv

FENOTEKGoogle

Source: Touch Display Research,Sensor for AR VR AI 2016 report







– Gesture control

– Eye tracking







Critical components for AR VR: Sensors• In the “Sensor for AR VR AI” 2016 report, Touch Display Research analyzed over

20 sensor technologies, arranged into 10 categories.

10 sensor technologies categories for AR VR AI

1 Camera-based gesture2 Camera-based eye tracking3 Ultrasound or radar-based gesture4 Voice recognition5 Photodiode sensor6 Proximity touch screen7 Motion sensor fusion8 Short-range wireless sensor9 Other touchless tech

10 Touch sensors and touch pad

Source: Touch Display Research,Sensor for AR VR AI 2016 report







– Gesture control

– Eye tracking







Touchless sensor companies• Over 250 touchless sensor suppliers, software companies, system

integrators/brand companies are profiled.

Source: Touch Display Research, Sensor for AR VR AI 2016 report

Touchless HMI technologiesCompanies in 2015

Companies in 2016

1 Camera-based gesture 61 672 Camera-based eye tracking 11 123 Ultrasound or radar based gesture 10 104 Voice recognition 31 325 Photodiode sensor 15 166 Proximity touch screen 8 87 Motion sensor fusion 51 528 Short-range wireless for wearable 26 26

9 Other touchless tech 26 27

Total >220 >250


Camera-based gesture control• In November 2010, Microsoft adopted PrimeSense’s technology in the Kinect

game console. The game console became very popular with 8 million sold in the first 2 months in the market.

• In end of 2013, Apple acquired PrimeSense.

• >60 companies

Microsoft

Artheer


Eye tracking

• Eye tracking is also called eye control or eye gaze.

• In November 2014, SMI offered eye-tracking HMD upgrade for Oculus Rift developers version DK2.

• >10 companies

SMI

Fove, photo by: Touch Display Research







– Gesture control

– Eye tracking







Voice control• Voice control is also called voice recognition, or voice command.

• The benefits of voice control include:

– 1. Safety.

– 2. Faster.

– 3. Voice control doesn’t take large spaces.

• Voice control has a big challenge--accuracy.

• >30 companies

Google TV voice searchViv


Other touchless sensors

• Motion sensor: Accelerometer, Gyroscope, Magnetic Sensors, Pressure sensors(Barometers).

• Photodiode sensor

• Proximity touch sensor

• Short-range Wireless: NFC, RFID, Bluetooth

• Muscle sensor: electromyographic (EMG) sensor.

• Brain wave sensor

Source: Kionix

Source: Microchip

Source: Myo


Touch sensor/pad

• Touch sensor market has been growing explosively since 2006.

• There are over a dozen touch technologies.

• Touch pad for Gear VR

Samsung Gear VRTouch pad with grove







– Gesture control

– Eye tracking







Sensor market forecast for AR VR and AI• Touch Display Research forecasts that the sensor for AR VR and AI market will

continue to have rapid growth. Over 10 billion sensors will be adopted for AR, VR, AI market in 2017, which is $96.9 billion in value. The sensor for these markets will reach $160 billion in 2022.

©Touch Display Research©TouchDisplayResearch

Source: Touch Display Research, Sensor for AR VR and AI 2016 report


Summary and Business Strategies Recommendation • Hot trends in 2016: Smart home, quantum dot, flexible/curved, 4K, ITO

replacement, near eye, wearable.

• Augmented reality (AR), virtual reality (VR), and artificial intelligence (AI) devices include advanced smart phones, tablet PCs, digital signage, some head mounted displays (HMD), and head up displays for automobiles.

• Sensors are critical components for AR, VR and AI devices.

• Touch Display Research forecasts that the sensor for AR VR and AI market will continue to have rapid growth. Over 10 billion sensors will be adopted for AR, VR, AI market in 2017, which is $96.9 billion in value. The sensor for these markets will reach $160 billion in 2022.

• We recommend industries to adopt more sensor tech for the benefit of easy control, intuitive, convenience, faster result, power saving, safety, intelligence, fun, coolness.

• We recommend sensor manufactures to work on sensor integrations for low cost, small foot print, and fast to market.

THANK YOU!

[email protected]

Market Research Reports: Touch Display Research provides out-of-shelf reports on touch, displays, sensors, and emerging technologies.

Speaking: Touch Display Research provides tutorial or speaking at company’s sites or conferences.

Consulting: Touch Display Research provides customized consulting reports, due diligence, analyst phone call, and industry match-making services.

mailto:[email protected]

Jennifer Colegrove (Touch Display Research) AR & VR Human Machine Interaction Sensor Technologies

Technology

Transcript of Jennifer Colegrove (Touch Display Research) AR & VR Human Machine Interaction Sensor Technologies