Hear&There An Augmented Reality System of Linked Audio
description
Transcript of Hear&There An Augmented Reality System of Linked Audio
![Page 1: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/1.jpg)
Hear&ThereAn Augmented Reality System of
Linked Audio
Joey RozierKarrie Karahalios and Judith Donath
Sociable Media GroupMIT Media Lab
ICAD 2000 Conference - April 3, 2000
![Page 2: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/2.jpg)
Overview
• Project Purpose and Goals• Brief Scenario• Basic Augmentation Details• Hardware• Authoring and Playback• Security and Privacy
![Page 3: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/3.jpg)
Purpose and Goals
• Augment Environment with Audio– Augmented Reality (or Mixed Reality)
• Develop Social Augmentations– Oral Histories– Focus on Authoring
• Activation Networks - Linking• Self-Contained and Portable• Limit Use of Visual Cues
![Page 4: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/4.jpg)
Example Scenario
• Augmented Boston Common• Can hear audio “left behind” (maybe
history)• Guided towards related audio
(moo...) • Author can add his/her own sound• Others are unaware
![Page 5: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/5.jpg)
Augmentation Details
• The SoundSpot– Basic unit of augmentation– Any type of audio (voice, music, whatever)– “Placed” at a specific location
(longitude/latitude)– Has a specified size– Other audio properties (braids, etc.)– User walking “into” SoundSpot hears it
![Page 6: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/6.jpg)
Augmentation Details
• Example
![Page 7: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/7.jpg)
Augmentation Details
• Must Determine User’s Location• GPS
– Typical Accuracy: Order of 10m– Accuracy of Ours: sub-meter– Refresh Rate: 10Hz– Drawback: Bulk– Result: Media Lab Courtyard
![Page 8: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/8.jpg)
Hardware
• GPS• Compass• PalmPilot• Laptop• Headphones• Microphone
![Page 9: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/9.jpg)
Authoring and Playback
• Focus on user authoring– Most other systems do not– Simple!
• Playback is still very important– New author options lead to new
playback issues
![Page 10: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/10.jpg)
Authoring
• Author creates SoundSpots– In-Field– Using GUI
![Page 11: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/11.jpg)
Playback: Basics
• User dons system• Very simple start-up• Moves through environment• Hears sound tied to location
![Page 12: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/12.jpg)
Playback: Spatialized Sound
• Each sound “appears” to be coming from center of a SoundSpot
• Java 3D API• Compass attached to headphones• Do not deal with environment effects
(enclosed spaces, etc.)• Future work will improve spatialized
sound
![Page 13: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/13.jpg)
Playback: Two Modes
• Explorer– All SoundSpots activated– Can be very cluttered– Ultimate control with listener
• Activation Networks
![Page 14: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/14.jpg)
Playback: Activation Networks
• For Linking and Organizing Sounds• Author creates Link Categories
– e.g. My Family, About Media Lab• Author associates Link Categories with
a SoundSpot• User can activate Link Category when
standing in SoundSpot• StartSpots
![Page 15: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/15.jpg)
Playback: Activation Networks Example
• StartSpot in Boston’s Public Garden– Link Categories
• SMG: SMG SoundSpots• Weeping Willow: interesting SoundSpots about
weeping willow trees• My Favorites: my favorite SoundSpots
– When entering StartSpot, activate “Weeping Willow”; now those “exist”
– Weeping Willow spots may have their own LinkCategories
![Page 16: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/16.jpg)
Playback: Directing the User
• Palm Interface– Easy, intuitive– But uses visual information!
• Audio Beacons?
![Page 17: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/17.jpg)
Security and Privacy
• Authentication for Authors• Open System for Users• Wireless Connection to Server?
![Page 18: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/18.jpg)
Future Work
• Finish Implementation!• More Portable System• Temporal Information• Other forms of audio augmentation
![Page 19: Hear&There An Augmented Reality System of Linked Audio](https://reader030.fdocuments.us/reader030/viewer/2022020801/56815693550346895dc43a81/html5/thumbnails/19.jpg)
Contact and Contributors
• E-mail: [email protected]• http://smg.media.mit.edu
• Primary Contributors– Judith Donath– Karrie Karahalios– Birendro Roy and Tuan Phan