1

Smart Terrain™ feature for Depth Sensing Cameras

David Beard Developer Evangelist, Qualcomm Connected Experiences, Inc.

Smart Terrain is a feature of the Qualcomm Vuforia SDK. Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc.

3 3

Smart Terrain

Reconstructs the environment

Awareness of your environment

Intelligence to interact with objects and surfaces

4

Overview

Smart Terrain for standard device cameras

Advantages of Depth Sensing

How it works

Developing with Smart Terrain

5

Smart Terrain for Standard Device Cameras

6

Supported Environments

Simulated images

7

Initializing Smart Terrain

Simulated images

8

Builds Primary Surface

Simulated images

9

Detects Props

Simulated images

10

Approximates Objects & Surfaces

Simulated images

11

Smart Terrain for Depth Sensing Cameras

12

Advantages of Depth Sensing Devices

Standard Device Cameras Uses an initialization target Requires user motion Approximates objects

Infrared Depth Sensors Automatic initialization No motion required Faster and richer results

13

Depth Sensing Cameras

Standard Device Cameras Uses visible light Senses contrast

Infrared Depth Sensors Projects Infrared light Fuses RGB image & depth map

14

Automatic initialization

Simulated images

15

Faster and richer results

Simulated images

16

Surface reconstruction

Simulated images

17

Object reconstruction

Simulated images

18

Automatic scale estimation

Simulated images

19

20

Developing with Smart Terrain

21

Best Practices Recommendations for the best user experiences

Supported Environments

User Experience

Designing content

Managing meshes

22

Near range experiences Stages with visually distince borders Opaque non-reflective surfaces Stable room lighting

Supported Environments

23

Designing Content

Simulated images

24

Managing Meshes

Simulated images

25

Abstracts the features of the hardware

Consistent life cycle management

Consistent event handling

Easy portability

Smart Terrain API A universal API for depth aware devices

26

Smart Terrain call flow

SmartTerrainTracker.StartMeshUpdates()

SmartTerrainTracker.StopMeshUpdates()

OnPropUpdated(Prop prop)

OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)

OnPropCreated(Prop prop)

SmartTerrainManager.AssociateProp(PropTemplate, prop)

OnPropDeleted(Prop prop)

27

Initialize Smart Terrain

Simulated images

28

Initialize Smart Terrain

StartMeshUpdates()

29

Build Mesh

Simulated images

30

Build Mesh

OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)

31

Detect Props

Simulated images

32

OnPropUpdated(Prop prop)

Detect Props

33

StopMeshUpdates(Prop prop)

Stop Reconstruction

34

Smart Terrain call flow

SmartTerrainTracker.StartMeshUpdates()

SmartTerrainTracker.StopMeshUpdates()

OnPropUpdated(Prop prop)

OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)

OnPropCreated(Prop prop)

SmartTerrainManager.AssociateProp(PropTemplate, prop)

OnPropDeleted(Prop prop)

35

Creating a Smart Terrain App in Unity

36

For more information on Qualcomm, visit us at: www.qualcomm.com & www.qualcomm.com/blog

©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries,. Uplinq and Smart Terrain are trademarks of Qualcomm Incorporated. Alll Qualcomm Incorporated trademarks are used with permission.Other products and brand names may be trademarks or registered trademarks of their respective owners.of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.

Thank you FOLLOW US ON: