IQ Tech Track AugmentedReality

7/31/2019 IQ Tech Track AugmentedReality

1/13

9/14/20

| 11

Developing with Qualcomms AR PlatformJay WrightDirector, Business Development

| 2

Disclaimer

Nothing in these materials is an offer to sell any of thecomponents or devices referenced herein. Certaincomponents for use in the U.S. are available only throughlicensed suppliers. Some components are not available foruse in the U.S.


2/13

9/14/20

| 3

GPS andCompass-based

AugmentedReality Experience

Good for rough locationof items outside our

field of view

Real World ViewLive camera view

Virtual ContentInformation about points of interest

Contentplacement

inaccurate due tocompass error

| 4

Vision-basedAugmented

Reality ExperienceEnables a moreimmersive and

interactiveexperience

Real World View

Live camera view

Virtual ContentVision-based AR recognizes objectsin field of view and aligns graphicstightly to target object


3/13

9/14/20

| 5

Example

An AR adaptation of Mattels classic Rockem Sockem game

| 6

Visualizing instructionse.g. furniture assembly

Instructional

Applications

Gaming & Play

3D games in real worldenvironments vs. game worlds

Turn Left on Main St.

Navigation & Discovery

Visualizing points of interest

Making print , outdoor, TV media, andproduct packaging come alive

Media / Advertising

Happy tobehere//Happy tobehere//Happy tobehere//

Social Networking

Placing photos, notes, graffitiin real world for friends to find

Visual Search

Retrieving related informationfrom web for the object in view


4/13

9/14/20

| 7

Goal

Enable developers to build interactive 3Dapplications and services for the real world.

| 8

What Weve Heard from Developers

Provide great technology Visual detection and tracking User interactions

Make it easy to use Support leading development tools Provide useful vision-oriented tools

Make it pervasive

Support multiple operating systems Path to standards

Make it free

Android 2.1 +

Android Tool Chain Unity 3.X Target Management

Fall 2010

Images Frame Markers Simple 3D Objects Virtual Buttons


5/13

9/14/20

| 9

Augmentable ObjectsRepresentations of real world elements that can be detected and tracked

Image Target Frame Markers Multi-Image Target(Simple 3D object)

| 10

Near Field Usage Environments

Retail ShelfTable or Floor Wall


6/13

9/14/20

| 11

Planar Images

How it Works

Natural feature-based image recognition

Needs sufficient areas with high variance incontrast (features)

How to Create

Upload JPG/PNG for quality analysis

Download target resource

Embed resource in application

Examples:

game board product packaging

poster greeting card

magazine page

Enables augmentation of ordinary images

| 12

Frame Markers

Augments many targets at the same time

How it Works

Application computes marker ID (512 possible)from marker outline

Image not used for recognition

How to Create Insert image into the supplied frame marker

using an image editor

Examples:

Game Pieces


7/13

9/14/20

| 13

HyperTargets Simple 3D Objects

Enables augmentations on simple 3Dobjects.

Examples: product packaging

How it Works Application knows spatial relationship between

various planar images

How to Create Target management application templates

Examples:

Product Packaging

| 14

Types of Interactions

AR uniquely allows you to interact with the real world

Supported interactions Frame Markers Virtual Buttons


8/13

9/14/20

| 15

Ability to be used asgame pieces in aboard game

Frame Markers

| 16

Ability to definebuttons asrectangular regionson a image target

Virtual Buttons


9/13

9/14/20

| 17

Development Options

SDK for Android SDK/NDK Unity Extension forAndroid

Distribution Download fromdeveloper.qualcomm.com

Download from Unity website with Unity 3.x.

Pricing TBA by Unity

Advantages Free Low level APIs enable

flexibility

Fully integrated gameengine reduces

development time and cost

Availability Beta this Fall Beta by end of year

More info at developer.qualcomm.com/ar

| 18

Mobile Application

Application Development with the AR SDK

TargetPosition

UserInteractions

Target

Resources

QDevNet

App Assets, Logic,

Rendering EngineTarget Images (jpg)

QCAR Library

Target Management

Application

Qualcomm Developer


10/13

9/14/20

| 19

Creating an AR App

Initialize SDK

Start Trackers

Handle TrackerUpdates

Close SDK

GLRenderer implements

GLSurfaceView.renderer {

. . .

onDrawFrame(..) {

myNativeRenderer()

}

}

myNativeCameraStartup (){

. . .

QCAR::CameraDevice.init(..);

QCAR::CameraDevice.start(..);

}

myNativeTrackerStartup

{

. . .

QCAR::Tracker.setActive

(QCAR::PLANAR_IMAGE);

}

myNativeRenderer

{

. . .// Render video background

// Update app logic using State

Object

// Render app assets

}

myApp extends Activity {

. . .

void onCreate() {

QCAR.init(..);

}

. . .

void onResume() {

. . .

setupOpenGLViews();

myNativeCameraStartup();

myNativeTrackerStartup();

}

. . .

void onDestroy() {

QCAR.deinit();

}

}

Native C/C++Java

| 20

The State Object

Member Description Type of Data

Camera Frame Current image

Trackables List of active trackable objects Planar Image Frame Marker HyperTarget

Events List of events Virtual Button 1 Virtual Button 2, etc.

RGBYUVGRAYSCALE

NameButton Press

Name4x4Matrix


11/13

9/14/20

| 21

Sample: Augmented Reality Application

| 22

Source Code Walkthrough


12/13

9/14/20

| 23

Demo: Target Management System

| 24

AR Developer ChallengeAny application / game using Qualcomm AR platform

Startdevelopingapplications

Applicationsubmissiondeadline

Fall 2010

February 14, 2011

January 7, 2011

Winnersannouncedat MobileWorldCongress

1st

$125,0002nd $50,0003rd $25,000


13/13

9/14/20

| 2525

Thank YouSign up to stay informed at developer.qualcomm.com/ar.

IQ Tech Track AugmentedReality

Documents

Transcript of IQ Tech Track AugmentedReality