UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects •...

22
UbiComp Proceedings Aaron Zinman Sociable Media Group

Transcript of UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects •...

Page 1: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiComp Proceedings

Aaron ZinmanSociable Media Group

Page 2: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)

Shen, Everitt, Ryall. “UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces” UbiComp ‘03

Page 3: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)• Horizontal table for collaboration during

face-to-face meetings

• Uses gradient of private, personal, and public spaces

• Previously, private == invisible only

• Uses “social protocols” as communication instead of traditional gestures

• Orientation designates space/attention

Page 4: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)• Use your laptop as private and drag

things into personal

• Use table for further interactions

• Rotating, moving, markup, editing, digital ink for annotations

• Color == ownership

• Bit crap. Should also use name

Page 5: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)

Page 6: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)

Page 7: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

UbiTable (MERL)

• Interaction might be awkward

• Mixed metaphors with laptops

• Laptops != Weiser

• Where should data really live?

• Spare display == Weiser

Page 8: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

MediaCup

•Hellersen, Beigl, Krull. “The MediaCup: Awareness Technology embedded in an Everyday Object.” UbiComp ‘99

Page 9: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

MediaCup

• 2D Accelerometer

• Cup is stationary

• Drinking from cup

• Fiddling with cup

• Temperature Sensor

• Hot (fresh) and cold

Page 10: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

MediaCup• Cues transmitted via IR

• Location tracked externally

• Data -> “Colleague Awareness”

• Mapped to ambient background noise (remote presence)

• Part of larger context-awareness

• Needs revamping with different hardware

Page 11: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

MediaCup• Truely using everyday objects

• MediaCup == Weiser

• Smart sensor usage: coffee cups give lots of information for “free” (better if hot beverages are used)

• Could have better networking, geo­location unclear

• No displays for feedback, but cheap

Page 12: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

FindIT Flashlight

•Hongshen, Paradiso. “The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup”. UbiComp ‘02.

Page 13: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

FindIT Flashlight• Receivers

• Small board with PIC, photodiode, response device (LED/buzzer), battery

• Interrogators

• Send AM search codes via defused laser

Page 14: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

FindIT Flashlight• Cheap, extremely low power, super cool!

• FindIT == Weiser

Page 15: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

•Darrell, Tollmar, Bentley, Checka. Face-responsive interfaces: from direct manipulation to perceptive presence. Ubicomp ‘02

Page 16: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces• Using face recognition techniques,

detect

• Fine-grained Gaze (move pointer on screen)

• Coarsely-grained Gaze (make the wall react)

• Assumes this is a good thing

• People gaze around, don’t want cursor jumping unintentionally

Page 17: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

• Did experiments to test algorithms accuracy against other systems

• Tested for small and large rotations on standard interface

• Error is same or better than other systems

• Not 0

Page 18: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

• Second experiment: cursor tracking on wall

• “Successful”. Said to be equivalent to novice use of trackball. Users didn’t like linear mapping.

Page 19: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

• Third experiment. Agent dialog

Page 20: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

• Tests for agent interaction:

• TTT: Talk-to-talk

• LTT: Look-to-talk

• PTT: Push-to-talk

Page 21: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Face-ResponsiveInterfaces

• Roughly split between preference for LTT and TTT, but users often looked anyway (19/30 questions).

• TTT seemed more accurate (actual algo)

• Follows observation of people looking at what they talk to

Page 22: UbiComp Proceedings - MIT OpenCourseWare · 2020. 1. 4. · Truely using everyday objects • MediaCup == Weiser • Smart sensor usage: coffee cups give ... manipulation to perceptive

Fin