A Short Ride on the Reality-Virtuality Continuum

Ehud SharlinInteractions Lab, University of Calgary

The Reality—Virtuality Continuum

RealEnvironment

VirtualEnvironment

Mixed Reality

“A Taxonomy of Mixed Reality Visual Displays”Paul Milgram and Fumio Kishino, 1994

User interfaces: discrete points along the continuum

The MagicBook—Moving Seamlessly between Reality and Virtuality; Mark Billinghurst et al., 2001

VirtualEnvironment Mixed Reality

RealEnvironment

A Wireless inexpensive optical tracker for the CAVE (IEEE VR 2000)

Laser

OpticalFilter

VbVf

Uf

Buildings number increases steadily

...with thisMatch this...

The Cognitive Map Probe (CMP)

CMP virtual drivethrough

CMP physical interaction

CMP: similarity

0

0.2

0.4

0.6

0.8

1

0 30 60 90 120 150 180 210 240 270

Tim e (sec)

Sim

ila

rity

youngelderlyAD

Cognitive Cubes (2002)

...with this

Match this...

Cognitive Cubes: Similarity

0

20

40

60

80

100

0 50 100 150 200

T ime (sec)

Sim

ilar

ity

(%

)

youngelderlyAD

Goal: physical direct drawing in 3D space

• Augmentation of the classic drawing board • 3D tabletop

interface• Tactile support • Physical

reference system

Drawing in Space using the 3D Tractus (2005)

3D Tractus

Applications:

• 3D sketch-based interfaces

• 3D curve input and surface modeling

• Medical imaging and analysis

Height sensor:String pot

Modular aluminum framing components The Industrial Erector Set®

Surface interface:Tablet or tablet PC

3D Tractus design:

Robots as physical interfaces:Sony Aibo (ERS-7M2)

Designing human-robot interaction using the Aibo

Direct interaction: Aibo Mind2 Aibo Entertainment Player R-CODE (macro programming) Remote Framework (wireless) OPEN-R (comprehensive C++) CMU’s Tekkotsu Framework

Socially acceptable information-supporting robotic partner

Iolaus: a sociable robotic interface (2005)

Take a walk on the Reality—Virtuality Continuum…

RealEnvironment

VirtualEnvironment

Mixed Reality

Thank you.