UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects •...
Transcript of UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects •...
![Page 1: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/1.jpg)
UbiComp Proceedings
Aaron ZinmanSociable Media Group
![Page 2: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/2.jpg)
UbiTable (MERL)
Shen, Everitt, Ryall. “UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces” UbiComp ‘03
![Page 3: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/3.jpg)
UbiTable (MERL)• Horizontal table for collaboration during
face-to-face meetings
• Uses gradient of private, personal, and public spaces
• Previously, private == invisible only
• Uses “social protocols” as communication instead of traditional gestures
• Orientation designates space/attention
![Page 4: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/4.jpg)
UbiTable (MERL)• Use your laptop as private and drag
things into personal
• Use table for further interactions
• Rotating, moving, markup, editing, digital ink for annotations
• Color == ownership
• Bit crap. Should also use name
![Page 5: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/5.jpg)
UbiTable (MERL)
![Page 6: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/6.jpg)
UbiTable (MERL)
![Page 7: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/7.jpg)
UbiTable (MERL)
• Interaction might be awkward
• Mixed metaphors with laptops
• Laptops != Weiser
• Where should data really live?
• Spare display == Weiser
![Page 8: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/8.jpg)
MediaCup
•Hellersen, Beigl, Krull. “The MediaCup: Awareness Technology embedded in an Everyday Object.” UbiComp ‘99
![Page 9: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/9.jpg)
MediaCup
• 2D Accelerometer
• Cup is stationary
• Drinking from cup
• Fiddling with cup
• Temperature Sensor
• Hot (fresh) and cold
![Page 10: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/10.jpg)
MediaCup• Cues transmitted via IR
• Location tracked externally
• Data -> “Colleague Awareness”
• Mapped to ambient background noise (remote presence)
• Part of larger context-awareness
• Needs revamping with different hardware
![Page 11: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/11.jpg)
MediaCup• Truely using everyday objects
• MediaCup == Weiser
• Smart sensor usage: coffee cups give lots of information for “free” (better if hot beverages are used)
• Could have better networking, geolocation unclear
• No displays for feedback, but cheap
![Page 12: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/12.jpg)
FindIT Flashlight
•Hongshen, Paradiso. “The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup”. UbiComp ‘02.
![Page 13: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/13.jpg)
FindIT Flashlight• Receivers
• Small board with PIC, photodiode, response device (LED/buzzer), battery
• Interrogators
• Send AM search codes via defused laser
![Page 14: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/14.jpg)
FindIT Flashlight• Cheap, extremely low power, super cool!
• FindIT == Weiser
![Page 15: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/15.jpg)
Face-ResponsiveInterfaces
•Darrell, Tollmar, Bentley, Checka. Face-responsive interfaces: from direct manipulation to perceptive presence. Ubicomp ‘02
![Page 16: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/16.jpg)
Face-ResponsiveInterfaces• Using face recognition techniques,
detect
• Fine-grained Gaze (move pointer on screen)
• Coarsely-grained Gaze (make the wall react)
• Assumes this is a good thing
• People gaze around, don’t want cursor jumping unintentionally
![Page 17: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/17.jpg)
Face-ResponsiveInterfaces
• Did experiments to test algorithms accuracy against other systems
• Tested for small and large rotations on standard interface
• Error is same or better than other systems
• Not 0
![Page 18: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/18.jpg)
Face-ResponsiveInterfaces
• Second experiment: cursor tracking on wall
• “Successful”. Said to be equivalent to novice use of trackball. Users didn’t like linear mapping.
![Page 19: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/19.jpg)
Face-ResponsiveInterfaces
• Third experiment. Agent dialog
![Page 20: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/20.jpg)
Face-ResponsiveInterfaces
• Tests for agent interaction:
• TTT: Talk-to-talk
• LTT: Look-to-talk
• PTT: Push-to-talk
![Page 21: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/21.jpg)
Face-ResponsiveInterfaces
• Roughly split between preference for LTT and TTT, but users often looked anyway (19/30 questions).
• TTT seemed more accurate (actual algo)
• Follows observation of people looking at what they talk to
![Page 22: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive](https://reader036.fdocuments.us/reader036/viewer/2022062606/5fe38ab8f6d6651be43a4ad6/html5/thumbnails/22.jpg)
Fin