Augment Search

8/2/2019 Augment Search

1/7

INFORMATION SCIENCEINFORMATION SCIENCE

INFO340Interactive Systems Design

Lecture #18

Mixed / Augmented Reality

Outline

Make a coin vanish, change, and re-appear!

Easy Magic Tricks FunPak - Collection 1 Price: $19.99

h.regenbrechtS1 2011 INFO340

INFORMATION SCIENCE

2

1. What is Mixed Reality?What is Augmented Reality?

2. MR Technology3. Application Examples & Prototypes


INFORMATION SCIENCE

3

Definition and Scope

Definition::AugmentedReality&MixedReality

Augmented Reality (AR) attempts to enrich a users real environment

by adding spatially aligned virtual objects (3D models, 2D textures,

textual annotations, etc) to it. The goal is to create the impression that

the virtual objects are part of the real environment. The users of the AR

system experience the augmented environment through special display

devices, which are either worn on the body or are placed in the


INFORMATION SCIENCE

4

working environment. From a technical point of view, AR faces three

major challenges: (1) to generate a high quality rendering, (2) to

precisely register (in position and orientation) the virtual objects with the

real environment, and (3) to do so in interactive real-time.

Regenbrecht, Baratoff, & Wagner (2001)

Definition::AugmentedReality&MixedReality


INFORMATION SCIENCE

5

Drascic & Milgram (1996)


INFORMATION SCIENCE

6

Mixed Reality Technology


2/7

ApplicationExample::CollaborativeDesignReview


INFORMATION SCIENCE

7

MRTechnology::PrincipleofanARApplication

Tracking of users head pose

Interaction device:


INFORMATION SCIENCE

8

tracking pose

handling events

Provision of VR component

spay o

mixed world

MRTechnology::ContributingTechnologies

Tracking HybridRendering


INFORMATION SCIENCE

9

MR application

Wearability Content Vis. &Interaction

MRTechnology::FormsofMRDisplays

Visual Head-Mounted Display: Optical See-Through (OST) Head-Mounted Display: Video-See-Through (VST) Projection: on screens Projection: on objects


INFORMATION SCIENCE

10

Objects as displays (e.g. OLED) Haptic

Active: force feedback, tactile feedback Passive: augmented objects

Acoustic: diegetic effects, Earcons Thermal, Olfactory, ...: almost not considered in R&D

MRTechnology::OpticalSeeThrough(OST)


INFORMATION SCIENCE

11

Azuma

MRTechnology::VideoSeeThrough(VST)


INFORMATION SCIENCE

12

Azuma


3/7

MRTechnology::ApplicationScenarios

assembly supportwireless tracking (medium fidelity)

annotation display with online database access

interaction with application and annotations

operations on large database


INFORMATION SCIENCE

13

volume data visualizationstationary tracking (high fidelity)

volume rendering with access to simulation data

interaction with real world elements

online (interpolated) simulation

MRTechnology::HybridRendering

2D video

example: volume and VR

data visualization in real

world (VST)

five domains involved

each domain can occlude

the othersVR


INFORMATION SCIENCE

14

3D real world rendering into the samecontext

problem fields:priority of rendering,

detection of real world 3Ddata, mix of different

rendering techniques,video fidelity, accurate

match of domains

Volume Vis.2D data

MRTechnology::RenderLoop

real world video

oop

texturing

real world modelmodel available | stereo pixel |shape from shadow | ...

z-bufferfill

from head-mounted camera


INFORMATION SCIENCE

15

renderl

VR modelin

scenegraph from scenegraph

volume dataogl

callbackfrom volume datacomputation

2D data integrationsg /

texturing /

callback

from data bases | windowmanager |VR browser | ...

MRTechnology::Tracking

Fidelity(accuracy, low latency,

low jitter/noise,pixelwise match)

Cabling(wireless wearablity)


INFORMATION SCIENCE

16

Instrumentation(user, real world,

real world in view)

Distances(meters...hangar dimensions,

coarse / fine tracking)

MRTechnology::Tracking

Outside-In Inside-Outemitter|cameras


INFORMATION SCIENCE

17

computer computer

+ technology available

+ high accuracy possible

- short distances

- instrumentation of real world

- depends on env. conditions (light,metals,fields,...)

+ pixelwise accurate

+ large distance tracking possible

- instrumentation of rw parts in view (markers)

- resolution (accuracy) within video limits

- influence of environmental light

MRTechnology::Interaction

Problem, Chance, andChallenge: in most cases no

keyboard, mouse, or monitor is

available


INFORMATION SCIENCE

18

Providing special devices(handheld, arm-worn, ...)

Alternative input: speech,

gesture

Using tangible interfaces withinthe real environment


4/7

MRTechnology::VSTInteractionIssue


INFORMATION SCIENCE

19

MRTechnology::Wearability

bringing displayinformation to user

lightweightergonomic

long run use


INFORMATION SCIENCE

20

large area use

robust (environment, usage)new interaction techniques

device(s) should disappear

information from user

getting interaction

device information from user

MRTechnology::Wearability

wired active devices passive devices


INFORMATION SCIENCE

21

Bauhaus University Weimar Xybernaut DaimlerChrysler AG

+ high fidelity

+ no time limits (run)

- small range

- disturbing cables

+ lightweight

+ large area use

- low fidelity

- short run use

+ lightweight

+ large area use

+/- fidelity (video)

- short run use

- sensitive RF transmission

MRTechnology::Content/Authoring

Content considering all kinds of multimedia information:

text, picture, video, VR access to internal and external resources: files,

databases, intranet, web


INFORMATION SCIENCE

22

Main bottleneck for acceptance is a closed dataand process chain

Instruction editor needs tools for the preparationof AR information display and flowExample:

MRTechnology::Content/Authoring

Development of aspecial authoring toolbased on MicrosoftPowerpoint

-


INFORMATION SCIENCE

23

-Authoring Editor(PowerSpace)

XML-based dataexchange betweenPPT, PowerSpace-Editor, and ARapplication


INFORMATION SCIENCE

24

oss e xam ues ons(not made available in lecture slides on web page)


5/7


INFORMATION SCIENCE

25

Application Examples & Prototypes

ApplicationExamples::EngineMaintenance

Today: Garage information system

on paper and CD-ROM Goal: Additional support for

mechanic with AR Useful for seldom practiced or

complicated tasks, for new productmodels, or on the road


INFORMATION SCIENCE

26

Placement of spatially aligned texts,graphics, videos, (animated) 3Dmodels, or even videophoneExample:

Standard-PC or Notebook computer Lightweight Head-Mounted Display

(Sony Glasstron), mono Miniature camera (Toshiba) Finger-worn 4-way stick and button

fot simple interaction tasks

Fraunhofer IGD

DaimlerChrysler

ApplicationExamples::WirePlacement

Work for DaimlerChrysler truck unit Customers have a high degree of

freedom in configuration of truck Almost no two trucks are identical,

therefore wiring must be plannedindividually for almost every truck

In production and production


INFORMATION SCIENCE

27

planning phase AR supports the

interactive layout of wiringharnesses (tree-structured bundles

of wires)

Layout takes place on real girder

Lightweight HMD + camera

Standard PC running AR-system

Two tracking systems: marker and optical

ApplicationExamples::CFDVisualisation

Work for airplane manufacturerAirbus within ARVIKA project

Airplane interior designs are unique(seats, linings, ...)

Variants in design are typically

shown w/ partial mockups (e.g. a


INFORMATION SCIENCE

28

Airstreams (temperatures, velocities,

etc.) cannot be experienced AR visualizes Computational Fluid

Dynamics data in form of voxels

ApplicationExamples::DriverSafetyTraining

Using AR for training drivers incar

Display of all kind of drivingsituations, even those not

presentable in reality

technolo ical or anizational


INFORMATION SCIENCE

29

, ,safety reasons)

Marker-based tracking + inertial

tracking + car data (CAN bus)

Lightweight HMDs Notebook computer on back

seat tests with customer and users

show promising results

ApplicationExamples::WireandPipeMounting

Augmented visualization of mounting/intrusion instructions outof database


INFORMATION SCIENCE

30

Boeing

EADS


6/7

ApplicationExamples::...more


INFORMATION SCIENCE

31



INFORMATION SCIENCE

32



INFORMATION SCIENCE

33



INFORMATION SCIENCE

34

Summary

AR is on its way to become productive, but:

Display technology needs to be developed

Tracking technology still insufficient or expensive

Closing the data chain, process integration, authoring

Acceptance and usability testing still in progress


INFORMATION SCIENCE

35

VERY PROMISING TECHNOLOGY IN ABROAD RANGE OF APPLICATION

FIELDS

Readings

Compulsory: these lecture slides Regenbrecht, H. (2006). Industrial Augmented Reality

Applications. In Haller, Thomas, & Billinghurst, EmergingTechnologies of Augmented Reality: Interfaces & Design. IdeaGroup Publishers.


INFORMATION SCIENCE

36

Recommended: Azuma, R. (1997). A Survey of Augmented Reality. Presence:

Teleoperators and Virtual Environments 6, 4 (August 1997),355-385.

Bimber, Emmerling, & Klemmer (2005). EmbeddedEntertainment with Smart Projectors. IEEE Computer, January2005.


7/7

Contact


INFORMATION SCIENCE

37

Holger [email protected]

[email protected]

http://www.hci.otago.ac.nz/info340

Simon [email protected]

Augment Search

Documents

Transcript of Augment Search