Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... ·...
Transcript of Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... ·...
![Page 1: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/1.jpg)
![Page 2: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/2.jpg)
![Page 3: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/3.jpg)
What AmI Doing? Where Am
I Going?
Who AmI With?
How Am I Feeling?
When DoI Need
To Leave?
Why AmI Here?
CONTEXT-AWARE
COMPUTING
![Page 4: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/4.jpg)
A Personal
VACATIONASSISTANT
Tim JarrellVice President & Publisher
Fodor's Travel
![Page 5: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/5.jpg)
![Page 6: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/6.jpg)
![Page 7: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/7.jpg)
Origins of Context-Aware Computing
The most profound technologies are
Mark Weiser (July 23, 1952 – April 27, 1999)
Xerox PARC, September 1991
those that disappear. They weave
themselves into the fabric of
everyday life until they are
indistinguishable from it.”
“
![Page 8: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/8.jpg)
Back to the Future ofUbiquitous
COMPUTING
Bo BegoleDirector
Ubiquitous Computing ResearchPalo Alto Research Center
![Page 9: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/9.jpg)
Ubiquitous Computing Was About How People Get Things Done in Real Life
SeamlessMulti-person
and Multi-device Collaboration
Context-aware Services
![Page 10: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/10.jpg)
Commercial Penetrationof Context-Aware Services
Location-basedServices
PARC Tab
PersonalAssistants
DNP
Machireko
Activity-
Based Information
Context
MiddlewareEasy Device
InteroperationIntelligent
Assistants
GPS-enabled
Smartphones
Indoor
locationEarly
Context-Aware
Services
Context-Aware Contextually Intelligent
1990 20102000 20051995
![Page 11: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/11.jpg)
Context-Aware Computing: How Does It Actually Work?
![Page 12: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/12.jpg)
The Art of Establishing
CONTEXTLama NachmanSenior Research Scientist
Interaction & Experience Research
Intel Labs
CONDITIONSACTIVITY
SIGHTS
SOUNDS
SurroundingsSocial Network
PreferencesCalendar
LOCATION
![Page 13: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/13.jpg)
Device Sensing Today
Flip UI Based on Accelerometers
Disable Touch Screen When Close to Ear
GPS Location
![Page 14: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/14.jpg)
Predicting Life-Threatening
Falls BeforeThey Happen
Beyond the Device:
Sensing Human Gait
Heel Strike
Toe Off
![Page 15: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/15.jpg)
• Unique button codes and sequences
• Button press rate
• Hand shake
• Angle the remote is held
Sensing Who’s Holding the Remote
TIME
BUTTON PRESS EVENT
BEFOREDURING
AFTER
WINDOW LENGTH
![Page 16: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/16.jpg)
Hard Sensing
Raw Data Feature Extraction Classification Inference
• Std dev (x,y,z)
• Mean, min, max
(gravity angle)Decision Tree
X
Z
Y
• Running• Sitting• Walking
Accelerometer
Decision Tree• GSR features
• HR features
• Stressed• Relaxed• Startled
Physiological
• MFCC
• Std dev
• Dynamic range
• Bandwidth
GMM• Chatting• Listening to music• Commuting
Audio
Video• John is in front of me• In the break room• Playing cards
• Intensity gradients
• Contours
• Color
• Kernel Machine• Bayesian Net• Sparse Bundle
Adjustment
The Inference Pipeline
![Page 17: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/17.jpg)
Fusing Hard Sensingwith Soft Sensing
Activity
Fusion
Algorithm
SOFT SENSINGHARD SENSING
Device Activity:
Call, Editing, Surfing,
Browsing
Calendar: free,
In meeting, etc
Running, Walking,
Sitting, etc
Commuting, Chatting,
Listening to Music, etc
Dark, Light,
Indoor, Outdoor
Location
(GPS, WIFI, BT)
In Front of Laptop
Social Networking
![Page 18: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/18.jpg)
Animating a Person’s Current Activity
![Page 19: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/19.jpg)
Aggregating Context …
… OverTime
… AcrossDevices
![Page 20: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/20.jpg)
ContextProxy Service
Cognitive Framework for Managing Context
Extensible Analyzing &Inferencing
Sensor Abstraction
SensorsPhysical , Application Data
and Webservices
Applications
Context Engine
ReleasePolicy
DataStore
![Page 21: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/21.jpg)
The Platform Implicationsof Context
Low-power sensors and I/O
Always-on sensing and computing
Effective workload partitioning
Optimized primitives for context
![Page 22: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/22.jpg)
Is the Market Ready For All of This Context?
![Page 23: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/23.jpg)
Experiencing
CONTEXT AWARENESS
Genevieve BellIntel Fellow and Director
Interaction & Experience ResearchIntel Labs
![Page 24: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/24.jpg)
Discovering What People LoveLearn from Experience
Make Senseof It All
Learn byAsking and
Seeing
Learn ThroughEngagement
Learn byDoing
![Page 25: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/25.jpg)
Designing Experiences They’ll Love
Validate & IterateIntegrate & BuildValidate & IterateConceptualize & Design
![Page 26: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/26.jpg)
You Say Context,I Say Life …
We often see “context” as a technical problem … but context is also everyday life
![Page 27: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/27.jpg)
The Future Computing Experience:
Context is Everything
![Page 28: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/28.jpg)
One more thing …
![Page 29: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/29.jpg)
The ultimate form of sensing
![Page 30: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/30.jpg)
This isgoing to be
BIG!
CONTEXT-AWARE
COMPUTING
![Page 31: Context: How it Will Really Change Everythingdownload.intel.com/newsroom/kits/idf/2010_fall/... · Multi-person and Multi-device Collaboration Context-aware Services. Commercial Penetration](https://reader031.fdocuments.us/reader031/viewer/2022011916/5fd6919be13b624c066fcbe4/html5/thumbnails/31.jpg)