Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow...
-
date post
21-Dec-2015 -
Category
Documents
-
view
219 -
download
0
Transcript of Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow...
![Page 1: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/1.jpg)
Butterfly Effect:An Augmented Reality Puzzle Game
Marleigh Norton
Blair MacIntyre
Steven DowMaribeth Gandy
![Page 2: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/2.jpg)
Game Overview
• Spatial puzzle where physical world is not modeled
• Virtual butterflies in physical environment• Catch them!
– Butterflies are stationary– Challenge comes from reaching the butterflies
• Bring butterflies into reach by rotating the virtual world– Virtual world rotates in 90 degree chunks about a
player defined axis.
![Page 3: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/3.jpg)
Equipment
![Page 4: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/4.jpg)
Head-Mounted Display
![Page 5: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/5.jpg)
Tornado Stick
![Page 6: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/6.jpg)
Rotations
• Tornado Stick controls Virtual Axis– First Button – Place / Remove Axis– Second Button – Pause / Unpause Axis– Third Button – Rotate Butterflies
![Page 7: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/7.jpg)
Tornado Stick
• People had trouble understanding rotations– Not everyone is used to
3D geometry– Though 3D puzzles have worked before
• Change the metaphor, not the interaction– “Tornado Stick”
![Page 8: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/8.jpg)
Butterfly Effect
![Page 9: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/9.jpg)
Butterfly Effect Video
QuickTime™ and aH.263 decompressor
are needed to see this picture.
![Page 10: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/10.jpg)
Design Context
• Start with medium, then design game– Mapping physical and virtual worlds is hard– AR works best when user is moving slowly
• Tracking more accurate• Safer for player – Cognitive Tunneling
![Page 11: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/11.jpg)
Design Context
• Home environment– Run on next generation game consoles– Must be easy to set up – Minimize use of special equipment
![Page 12: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/12.jpg)
1st Prototype: 2D Paper
![Page 13: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/13.jpg)
2nd Prototype: 2D Interactive
![Page 14: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/14.jpg)
3rd Prototype: Video
![Page 15: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/15.jpg)
Tuning
• Two Major Challenges– 90 degree rotation constraint– Understanding virtual space and physical space
• Possible Changes– Loosening rotation constraint– Adding more manipulations (translations)– Adding better depth perception cues
![Page 16: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/16.jpg)
Open Issues: Depth Perception
• Static Depth Cues
![Page 17: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/17.jpg)
Open Issues: Depth Perception
• Remove Automatic Depth Cues
![Page 18: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/18.jpg)
Open Issues: Depth Perception
• Remove Unavailable Depth Cues
![Page 19: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/19.jpg)
Open Issues: Depth Perception
• Texture probably the best
![Page 20: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/20.jpg)
Without Grid
![Page 21: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/21.jpg)
With Grid
![Page 22: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/22.jpg)
Is Occlusion Really Impossible?
• Ad hoc modeling– Automatic modeling during calibration– Fiducials
• Real time depth– Depth from stereo
• Something to be explored
![Page 23: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/23.jpg)
Virtual Obstacles - Bees
• No consequences for using poor strategy
• Bees behave like butterflies• “Sting” if caught• Penalty
– Lose life– Butterflies escape
QuickTime™ and aTIFF (Uncompressed) decompressorare needed to see this picture.
![Page 24: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/24.jpg)
Questions?
![Page 25: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/25.jpg)
Old Slides from Past Talks
(In case people as a question I have slides for.)
![Page 26: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/26.jpg)
Butterfly Effect:An Augmented Reality Puzzle Game
Marleigh Norton
Technical Advisor: Blair MacIntyre
![Page 27: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/27.jpg)
Person Walks Through Game Area
![Page 28: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/28.jpg)
Person Walks Through Game Area
![Page 29: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/29.jpg)
Person Walks Through Game Area
![Page 30: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/30.jpg)
Derive Walls from Path
![Page 31: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/31.jpg)
Derive Walls from Path
![Page 32: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/32.jpg)
Why this is Fun
• Fun in the same ways Rubik’s Cubes are fun
• Caillois’s Four Categories of Games [1]– agôn, alea, mimicry, ilinx
• MacTavish’s “astonishment at visual and auditory technology” [2]
![Page 33: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/33.jpg)
Open Issues
• Scoring
• Capture Interaction
• Depth Perception
![Page 34: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/34.jpg)
Open Issues: Scoring
• Score based on efficiency, not speed
• Penalized for moving too much– Accrue score as you walk– High score bad
• Problem: High Score Traditionally Good
![Page 35: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/35.jpg)
Open Issues: Capture Interaction
• Location-Based Capture– Capture butterfly by getting close enough– Pros: Technically simple. No additional cost.– Cons: Precise head tracking more important.
Less thematically appropriate. Less fun.
• Butterfly Net Capture– Capture butterfly in a net– Pros: More active, thematically appropriate
interaction.– Cons: Requires an additional tracking system,
likely expensive.
![Page 36: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/36.jpg)
Open Issues: Depth Perception
• Judging depth in virtual worlds is difficult– Overcoming this difficulty is part of the game, yet it
should not be impossible
• Problem: What can we do to help the player understand the relative locations of the butterflies?
• Research on Depth Perception yields several techniques [4] [5] [6] [7]
![Page 37: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/37.jpg)
Questions & Feedback
• Scoring – Efficiency
• Capture Interaction– Location-based capture– Butterfly Net Capture
• Depth Perception– Which cues to use? More ideas?
• Other Feedback
![Page 38: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/38.jpg)
References: Game Theory
• [1] Caillois, Roger, “Man, Play, and Games,” trans. Meyer Barash, University of Illiniois Press, 1961 (orig.1958) ch 2.
• [2] Mactavish, Andrew, “Technological Pleasure: The Performance and Narrative of Technology in Half-Life and other High-Tech Computer Games”, in: Geoff King and Tanja Krzywinska (eds.) Screenplay: Cinema/ Videogames/ Interfaces (London: Wallflower Press, 2002) 33-50
![Page 39: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/39.jpg)
References: Depth Perception 1
• [4] Cutting, J. E., and P.M. Vishton, 1995. “Perceiving layout and knowing distance: The integration, relative potency and contextual use of different information about depth”, in Perception of Space and Motion, W. Epstein and S. Rogers, Eds. Academic Press, New York, 69--117.
• [5] Furmanski, Chris, Ronald Azuma, and Mike Daily. “Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information”, in Proc. IEEE and ACM Int'l Symp. on Mixed and Augmented Reality (ISMAR 2002) (Darmstadt, Germany, 30 Sept. - 1 Oct. 2002), pp. 215-224.
![Page 40: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/40.jpg)
References: Depth Perception 2
• [6] Sinai, M.J., W. K. Krebs, R. P. Darken, J. H. Rowland, and J. S. McCarley, 1999. “Egocentric distance perception in a virtual environment using a perceptual matching task”, in Proceedings of the 43 rd Annual Meeting Human Factors and Ergonomics Society, 43, 1256-1260.
• [7] Surdick, R. T., E. T. Davis, R. A. King, and L. F. Hodges, 1997. “The perception of distance in simulated visual displays: A comparison of the effectiveness and accuracy of multiple depth cues across viewing distances”, in Presence: Teleoperators and Virtual Environments 6, 5 (October), 513--531.
![Page 41: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/41.jpg)
References: DART
• [8] MacIntyre, Blair, Maribeth Gandy, Steven Dow, and Jay David Bolter. "DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences." To appear at conference on User Interface Software and Technology (UIST'04), October 24-27, 2004, Sante Fe, New Mexico.
![Page 42: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/42.jpg)
Implementation Status
• It’s playable!*– Populate the world with a pre-defined set
of butterflies– Butterflies can be captured– Tallies of caught and remaining butterflies
are displayed– Butterflies can be rotated about the axis– Physical axis interface
* When all of the equipment is working.
![Page 43: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/43.jpg)
The Screen
![Page 44: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/44.jpg)
Feedback
• Rotation Interface
• Depth Perception
• Score
• Aesthetics
![Page 45: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/45.jpg)
Rotation Interface
• Problem: Rotating about an axis? Huh?– Suggested alternatives:
• Randomization• Jar, Mini-version of gamespace
– (Rotation about a point)
• “Tornado Stick”
• Changes: Tornado Stick– Axis/Tornado Stick only interface in which all
manipulations are valid moves– Arrows pointing to butterflies’ final location
![Page 46: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/46.jpg)
Depth Perception
• Problem: It’s hard to tell where the butterflies are, especially when they’re “behind walls”– Complication: can’t change appearance of
butterfly based on presence of wall(or can we…?)
• Changes: Add grid with drop shadows– Also, it’s less of a problem when you’re
actually playing
![Page 47: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/47.jpg)
Score
• Problem: for Efficiency-based score, lower was better (confusing players)– Suggestions
• Timer• Subtract from High initial score• No Score
• Changes: No Score– Score isn’t really that important– Was causing more problems than it solved
![Page 48: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/48.jpg)
Aesthetics
• Problem: What will the game look like?– Collecting the butterflies should be
compelling
• Changes: Aesthetics more fully fleshed out– Childlike graphic design with scanned
crayon textures– Player is frog, eating butterflies
![Page 49: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/49.jpg)
Frog has Butterfly in Sights
![Page 50: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/50.jpg)
Frog Catches Butterfly
![Page 51: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/51.jpg)
Frog Eats Butterfly
![Page 52: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/52.jpg)
Future Work: Finish Implementation
• Sounds
• Graphics
• Animations
• Refine Stick– Are those the right buttons?– Buttons or Switches or ???– InertiaCube Issues with Ferris
Environments
![Page 53: Butterfly Effect : An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven Dow Maribeth Gandy.](https://reader035.fdocuments.us/reader035/viewer/2022081516/56649d6a5503460f94a4833f/html5/thumbnails/53.jpg)
Questions?
Thanks to the Augmented Environments Lab, especially:
• Blair MacIntyre
• Steven Dow
• Enylton Machado Coelho