Collaboration via the Info. Utility
-
Upload
beatrice-waters -
Category
Documents
-
view
24 -
download
0
description
Transcript of Collaboration via the Info. Utility
![Page 1: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/1.jpg)
Collaboration via the Info. Utility
John CannyEndeavour Mini-retreat
1/20/2000
![Page 2: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/2.jpg)
Consequences of Ubiquitous Computing and Calm Technology:• As computing becomes ubiquitous and invisible, it
also ceases to be the focus of activity.
• The focus shifts instead to people and the tasks they are working on.
• This implies a Human-Centered Computing approach (HCC) to designing applications.
• Our work involves collaborations with several faculty outside CS who are expert in aspects of human behavior, and especially group behavior, via a HCC center.
![Page 3: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/3.jpg)
Three takes on collaboration• Design media for natural (physical)
interaction: Desks, PRoPs, Bearables.• Model behavior: Activity-Based
Computing (ABC): – uses tacit data to infer structure in group
members’ activities.
• Learning as collaboration: – Large classes create opportunity via group
cooperation and student perspectives to help other learners.
![Page 4: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/4.jpg)
Three takes on collaboration• Design media for natural (physical)
interaction: Desks, PRoPs, Bearables.• Model behavior: Activity-Based
Computing (ABC): – uses tacit data to infer structure in group
members’ activities.
• Learning as collaboration: – Large classes create opportunity via group
cooperation and student perspectives to help other learners.
![Page 5: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/5.jpg)
Designing Media: Distributed Cognition Theory• People use artifacts in the world to share their
thoughts (Norman, Hutchins, Pea).• Computer-enhanced artifacts have richer
behaviors and be shared across distance.
![Page 6: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/6.jpg)
A desk that loses entropy...• The UPM (Universal Planar Manipulator) is a
desk that can move many objects placed on it. It is a tangible input/output device.
![Page 7: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/7.jpg)
Applications of the UPM• Teaching Chemistry: A tangible simulation of
planar organic chemistry. Colored disks for atoms, simulation of bond forces and reactions, movement of atoms by the desk.
• Urban planning. Phycons of buildings moved by initially by hand, then aligned by the desk according to a set of rules.
• Other layout problems: web site design (moving postit-like notes).
![Page 8: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/8.jpg)
UPM principle of operation
![Page 9: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/9.jpg)
![Page 10: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/10.jpg)
PRoPs: Proxys for remote collab.
• There is still a huge gap between face-to-face and videoconferencing.
• First difference: Physical cues: gaze, posture, proxemics... are missing or distorted.
• Much collaboration involves “being in” a remote space. You need to have a body there...
![Page 11: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/11.jpg)
PRoPs: Proxys for remote collab.
• PRoPs are internet-controlled robot avatars that allow you to have a second presence somewhere.
• The user sits at a computer console watching video from the PROP, and controlling it with mouse and joystick.
![Page 12: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/12.jpg)
Theoretical underpinnings
• Right now, much of the theory driving PROP design comes from outside CS:
• Non-verbal communication (D. Keltner psychology).
• Theory of interpersonal psychology (G. Mendelsohn).
• Spatial reasoning and spatial memory.
![Page 13: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/13.jpg)
Bearable computers• The laptop can serve as a “bearable” computer,
linked wirelessly to its owner.
Laptop in briefcase with wireless TV
and keyboard TXs.
Pocket-worn portable LCD TV
Double-mirror element in glassesHeads-up virtual image
Wireless chordal keyboard or Palmpilot in pocket for input.
![Page 14: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/14.jpg)
Advantages of Bearables vs. Wearables
• Short term:– Leverage higher performance of laptops and
mini-TV displays compared to wearable components.
• Long term:– No wires between components.– No power source to the head.– The laptop display is preferable sometimes. – Some optical benefits for augmented reality.
![Page 15: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/15.jpg)
Three takes on collaboration• Design media for natural (physical)
interaction: Desks, PRoPs, Bearables.• Model behavior: Activity-Based
Computing (ABC): – uses tacit data to infer structure in group
members’ activities.
• Learning as collaboration: – Large classes create opportunity via group
cooperation and student perspectives to help other learners.
![Page 16: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/16.jpg)
ABC: Activity-Based Computing
• How do you build a UI when the computer is invisible, e.g. a smart space?
• What is context and how do you use it?
• How does ABC help collaboration?
![Page 17: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/17.jpg)
ABC: Activity-Based Computing
• How do you build a UI when the computer is invisible, e.g. a smart space?
• Build a conceptual model instead.• What is context and how do you use it?
• How does ABC help collaboration?
![Page 18: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/18.jpg)
ABC: Activity-Based Computing
• How do you build a UI when the computer is invisible, e.g. a smart space?
• Build a conceptual model instead.• What is context and how do you use it? • Use Activities as the context.• How does ABC help collaboration?
![Page 19: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/19.jpg)
ABC: Activity-Based Computing
• How do you build a UI when the computer is invisible, e.g. a smart space?
• Build a conceptual model instead.• What is context and how do you use it? • Use Activities as the context.• How does ABC help collaboration?• Pro-active document sharing;
Understanding roles; Document context;
![Page 20: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/20.jpg)
ABC: Activity-Based Computing
• Activities are clusters with:– Users– Documents– Tools
• The model can be implemented as a GUI, or with speech, etc.
• Nearness encodes awareness.
![Page 21: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/21.jpg)
ABC: Motivation• Based on “activity theory”, a rich psychological
theory of human behavior, especially collaboration.
• AT Emphasizes on tools (such as computers) as mediators of activity.
• Includes the role of symbol systems (language, documents) as mediators.
• Ties together development (learning) and everyday activity.
• Rich models of context.
![Page 22: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/22.jpg)
ABC: Uses• Context (disambiguation) of person, object, tool.• Pro-active sharing of information. • Skill mining (tracking user expertise). • Document visibility and access rights. • Understanding individual’s roles in activities.• Managing work relationships.• Inferring quality of documents/tools.• Sensemaking for documents. • Perspectives on a document or meeting.• Attention management/awareness.
![Page 23: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/23.jpg)
ABC: Under development now• Context (disambiguation) of person, document,
tool.• Pro-active sharing of information. • Skill mining (tracking user expertise). • Document visibility and access rights. • Understanding an individual’s roles in activities.• Managing work relationships.• Inferring quality of documents/tools.• Sensemaking for documents. • Perspectives on a document or meeting.• Attention management/awareness.
![Page 24: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/24.jpg)
ABC: Tacit data sources• Direct communication: 1-1 email, phone, F2F.• Topical discussions, forums, F2F meetings.• Document access, reading, doc. markup.• Document search and browsing, who, when.
![Page 25: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/25.jpg)
Knowledgescapes: Info Retrieval with tacit data
InformationNeed
Query(terms)
SearchEngine
Document1
Document2
Document3
Document4
Rankings from reading time.Treat as probability of interest
or E(interest)
![Page 26: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/26.jpg)
Info Needs and tacit rankings
Infoneed1 Document1
Document2
Document3
Document4
Infoneed2
Infoneed3
Document5
P(D1|N1)
P(D5|N3)
![Page 27: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/27.jpg)
• Start with a query string and use all the information need nodes recorded for that query.
• Return highest weighted docs.
First use: Most popular hits
Document1
Document2
Document3
Document4
Infoneed2
Infoneed3
Document5
Query
![Page 28: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/28.jpg)
• The IN is usually more specific than the query, and this is encoded in the user’s tacit rankings.
Tacit knowledge in user queries
Document2
Document3
Document4
Infoneed1
Infoneed3 Document5
“Airlines” Info
need2
Document1
West to East Coast
US to France
![Page 29: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/29.jpg)
• Tacit user ranking while browsing boosts most probable info needs, improving recall.
Tacit knowledge in user queries
Document2
Document3
Document4
Infoneed1
Infoneed3 Document5
“Airlines” Info
need2
Document1
West to East Coast
US to France
![Page 30: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/30.jpg)
• Tacit user ranking while browsing boosts most probable info needs, improving recall.
Tacit knowledge in user queries
Document2
Document3
Document4
Infoneed1
Infoneed3 Document5
“Airlines” Info
need2
Document1
West to East Coast
US to France
![Page 31: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/31.jpg)
• Tacit user ranking while browsing boosts most probable info needs, improving recall.
Tacit knowledge in user queries
Document2
Document3
Document4
Infoneed1
Infoneed3 Document5
“Airlines” Info
need2
Document1
West to East Coast
US to France
![Page 32: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/32.jpg)
Current testbeds:
• Berkeley DigLibs (environmental) collections. Knowledgescapes on Dlib is running at: http://indios.cs.berkeley.edu/knowledgescapes.html
• IMDB• Philip Stark’s statistics course.• NEEDs: the ME courseware database.
Future:• My groups web and campus library access.
![Page 33: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/33.jpg)
Three takes on collaboration• Design media for natural (physical)
interaction: Desks, PRoPs, Bearables.• Model behavior: Activity-Based
Computing (ABC): – uses tacit data to infer structure in group
members’ activities.
• Learning as collaboration: – Large classes create opportunity via group
cooperation and student perspectives to help other learners.
![Page 34: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/34.jpg)
Education as collaboration:Opportunities of scale. • In lecture format classrooms, attention is the
critical resource (Norman, Papert...).• Attention is best gained by interaction: with
artifacts (the LOGO model) or with other students (the Stanford TVI model).
![Page 35: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/35.jpg)
An augmented reality classroomVirtual image with notes,
questions, private chat space
Physical space
Glasses to rotatethe laptop image
![Page 36: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/36.jpg)
Livenotes in the classroom• Students work in groups of 4; communicate
silently via pen or keyboard chat.
• Each group has one main note-taker; others add their own comments or questions to the transcript.
• Students can mark up a group transcript, the lecturer’s notes, or a non-archived window.
• One student per group works as facilitator or TA, posing questions to the others.
![Page 37: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/37.jpg)
• The group transcripts include notes, plus student comments and questions.
• Remote live participants should be equally engaged in the note-taking.
Using Livenotes
![Page 38: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/38.jpg)
• 4 Students used Livenotes in a grad course in F99 on IBM laptops running Netmeeting on a wireless net.
• Reactions:
– Overlay touch screens were bad, everyone used keyboard chat.
– Difficulty in listening and chatting simultaneously only in first lecture.
– After that, attention level higher. No chance of falling asleep.
– Many notes: two parallel threads, the note-taker and the group chat. Group chat periodically comes back to lecture content as new notes appear from the note-taker.
Initial feedback
![Page 39: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/39.jpg)
• Move to Vadem Clios with wireless:
– Support both keyboard and pen note-taking.
– Cheaper, lighter, batteries last all day.
• Develop custom software based on feedback:
– Support conversation threads.
– Include hyperlinks (or hyper-ink).
– Include timestamping to allow synchronization with MM transcript of the lecture.
– In-class “lecture rewind” was proposed as a useful feature.
Next Step
![Page 40: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/40.jpg)
• Offline students lose interaction, but gain through access to live student perspectives (their notes).
• By organizing live student notes according to expertise and a few dimensions of perspective, we can provide offline students with an ideal “scaffolding” perspective.
Further along...
![Page 41: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/41.jpg)
The End..
![Page 42: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/42.jpg)
PROPs and Bearables are complementary
• A user with a bearable display can see a video overlay of the PROPs pilot.
![Page 43: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/43.jpg)
PROPs and Bearables are complementary
• A user with a bearable display can see a video overlay of the PROPs pilot.
• This display can cover a much larger area than the PROPs built-in display, and provide body language cues.
![Page 44: Collaboration via the Info. Utility](https://reader036.fdocuments.us/reader036/viewer/2022062517/5681332c550346895d9a22b2/html5/thumbnails/44.jpg)
PROPs and Bearables are complementary
• A user with a bearable display can see a video overlay of the PROPs pilot.
• This display can cover a much larger area than the PROPs built-in display, and provide body language cues.
• In this display, the pilot is standing up, implying he is controlling the PROP with a wearable computer.