Augmented Reality - UC Berkeley School of...
Transcript of Augmented Reality - UC Berkeley School of...
![Page 1: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/1.jpg)
Augmented RealityAugmented Reality
Theory and Practice of Tangible User Interfaces
Tuesday, Week 9
![Page 2: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/2.jpg)
OutlineOutline
• Overview• Overview• Examples
• Theory
• Examplesp
• Supporting AR Designs
• Examples• Examples
• Theory
![Page 3: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/3.jpg)
![Page 4: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/4.jpg)
OutlineOutline
• OverviewOverview
• Examples• Theory
• ExamplesExamples
• Supporting AR Designs
E l• Examples
• Theory
![Page 5: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/5.jpg)
First Down Line in Football GamesFirst Down Line in Football Games
![Page 6: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/6.jpg)
Virtual Laser KeyboardVirtual Laser Keyboard
![Page 7: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/7.jpg)
Eye Toy [sony]Eye Toy [sony]
• Eye Toy DemoEye Toy Demo
• Eye Toy Review
[ ]• Eye Toy Cups [2:30]
![Page 8: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/8.jpg)
OutlineOutline
• OverviewOverview
• Examples
• Theory• ExamplesExamples
• Supporting AR Designs
E l• Examples
• Theory
![Page 9: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/9.jpg)
Reality‐Virtuality (RV) Continuum[Milgram et al., 1994]
“Augmenting natural feedback to the operatorAugmenting natural feedback to the operator with simulated cues” (Milgram et al., 1994)
![Page 10: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/10.jpg)
OutlineOutline
• OverviewOverview
• Examples
h• Theory
• Examplesp• Supporting AR Designs
E l• Examples
• Theory
![Page 11: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/11.jpg)
Pacman and the RV ContinuumPacman and the RV Continuum
Virtual Environment Augmented Reality Real Environment
![Page 12: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/12.jpg)
Support Archeological Field Work[Benko et al, 2005, Columbia]
[video][ ]
![Page 13: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/13.jpg)
Overlay Assembly Instructions[Feiner et al., 1993, Columbia]
![Page 14: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/14.jpg)
Overlay Assembly Instructions[Zauner et al., 2003, Austria]
![Page 15: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/15.jpg)
Augmented Reality Kitchen[Lee et al., 2005, MIT Media Lab]
[video][ ]
![Page 16: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/16.jpg)
MARA: Mobile AR[Nokia Research]
![Page 17: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/17.jpg)
Surface Drawing[Schkolne and Keefe, 2001, Caltech]
[video]
[video]
![Page 18: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/18.jpg)
OutlineOutline
• OverviewOverview
• Examples
h• Theory
• Examples
• Supporting AR DesignsE l• Examples
• Theory
![Page 19: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/19.jpg)
Building AR Systems is HARDBuilding AR Systems is HARDHelmet Tracks
Head OrientationGPS C l l t
Camera captures real world.
GPS Calculates Positions
real world.
Computer examines Composited ImageComputer examines real world image
(vision), GPS, and head orientation to generate
Composited Image Displayed on HMD
virtual scene (graphics).
Video Compositor pCombines Virtual with Real Image
![Page 20: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/20.jpg)
Supporting AR DesignSupporting AR Design
• Hardware– Use of advanced displays (head mounted, stereoscopic, novel projection)Sensors to detect real environment actions– Sensors to detect real environment actions
– Actuators to affect the world• Software Requirementsq
– Computer Vision systems– 3D rendering systemsAll i REAL TIME– All in REAL‐TIME
• Interaction Requirements– Complex domain of possible actions/reactionComplex domain of possible actions/reaction
![Page 21: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/21.jpg)
Standard DisplaysStandard Displays
![Page 22: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/22.jpg)
Stereoscopic 3D DisplaysStereoscopic 3D Displays
![Page 23: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/23.jpg)
Immersive Displays: CAVEsImmersive Displays: CAVEs
![Page 24: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/24.jpg)
![Page 25: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/25.jpg)
![Page 26: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/26.jpg)
![Page 27: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/27.jpg)
![Page 28: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/28.jpg)
Toshiba Head‐Dome DisplayToshiba Head Dome Display
• “Ludicrous Speed, Go!”• “I have seem the future,
and it is lame”• “about as glamorous as• about as glamorous as
wearing an old‐style TV set on your head” ‐USA Today
![Page 29: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/29.jpg)
Head Mounted DisplaysHead Mounted Displays
![Page 30: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/30.jpg)
Corporate Support: Total ImmersionCorporate Support: Total Immersion
[video][ ]
![Page 31: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/31.jpg)
Software Support: ARToolKit(HIT Lab, Washington and New Zealand)
• Everything you need to draw stuff on cards (fiducials markers)
![Page 32: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/32.jpg)
OutlineOutline
• OverviewOverview
• Examples
h• Theory
• Examples
• Supporting AR Designs
• Examples• Examples• Theory
![Page 33: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/33.jpg)
Collaboration: Magic Meeting[Shared‐Reality, Germany]
[video][ ]
![Page 34: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/34.jpg)
3D Popup Book[HIT Lab, New Zealand]
[video][ ]
![Page 35: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/35.jpg)
Support Botanical Field WorkSupport Botanical Field Work
[video][ ]
![Page 36: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/36.jpg)
OutlineOutline
• OverviewOverview
• Examples
h• Theory
• Examples
• Supporting AR Designs
• ExamplesExamples
• Theory
![Page 37: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/37.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
Extent of Presence MetaphorExtent of Presence MetaphorThe extent to which the observer is intended to feel “present” within the displayed scene.
Extent of PresenceMetaphorMetaphor
![Page 38: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/38.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
Extent of World Knowledge
World
ge
Extent of World KnowledgeHow much we [the computer] actually know about the
ent o
f WKn
owledg objects and the world in
which they are displayed.
Exte K
![Page 39: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/39.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
Reproduction FidelityReproduction FidelityThe relative quality with which the synthesizing display is able to reproduce the actual or intended images of the objects being displayed.j g p y
![Page 40: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/40.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
World
geent o
f WKn
owledg
Extent of PresenceMetaphor
Exte K
Metaphor
![Page 41: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/41.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
World
geent o
f WKn
owledg
Extent of PresenceMetaphor
Exte K
Metaphor
![Page 42: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/42.jpg)
Taxonomy of Mixed Reality Systems[Milgram et al., 1994]
World
geent o
f WKn
owledg
Extent of PresenceMetaphor
Exte K
Metaphor
![Page 43: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/43.jpg)
D thi k thi i f lDo you think this is a usefultaxonomy for interaction design?
![Page 44: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/44.jpg)
Ping Pong Plus[Ishii et al., 1999, MIT Media Lab]
![Page 45: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/45.jpg)
Illuminating Clay[Piper et al., 2002, MIT Media Lab]
![Page 46: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/46.jpg)
Wait a minute. What’s going on here?
![Page 47: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/47.jpg)
![Page 48: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/48.jpg)
![Page 49: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/49.jpg)
![Page 50: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/50.jpg)
Reality‐Virtuality (RV) Continuum[Milgram et al., 1994]
“Augmenting natural feedback to the operatorAugmenting natural feedback to the operator with simulated cues” (Milgram et al., 1994)
![Page 51: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/51.jpg)
TUI vs. AR: Is there a difference?TUI vs. AR: Is there a difference?What is it?
![Page 52: Augmented Reality - UC Berkeley School of …courses.ischool.berkeley.edu/i290-13/07readings/Augmented...Augmented Reality (AR) designs seek to move computation beyond the desktop.](https://reader034.fdocuments.us/reader034/viewer/2022050523/5fa6821891d85063f21cd348/html5/thumbnails/52.jpg)
Difference[nguyen, today, tui Class]
Both Tangible User Interface (TUI) andBoth Tangible User Interface (TUI) and Augmented Reality (AR) designs seek to move computation beyond the desktop The primarycomputation beyond the desktop. The primary difference between the two lies in the approach. TUI seeks to inject computation into the physicalTUI seeks to inject computation into the physical world while AR seeks to overlay computation onto the physical world However the twoonto the physical world. However, the two approaches are not orthogonal.