Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft...
Transcript of Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft...
![Page 1: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/1.jpg)
Microsoft
Research
Multi-touch Interactions
on Small Input Devices
Hrvoje BenkoResearcher
Microsoft Research
DUB – February 2, 2011
![Page 2: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/2.jpg)
Microsoft
Research
My research
![Page 3: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/3.jpg)
Microsoft
Research
Multi-touch Interactions
![Page 4: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/4.jpg)
Microsoft
Research
Computing Today
Touch/Buttons
Touch Touch Keyboard &Touchpad
Keyboard &Mouse
Remote controller
![Page 5: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/5.jpg)
Microsoft
Research
Computing Today
Touch/Buttons
Touch Touch Keyboard &Touchpad
Keyboard &Mouse
Remote controller
Touch “No” Touch
![Page 6: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/6.jpg)
Microsoft
Research
Why “no” touch?
![Page 7: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/7.jpg)
Microsoft
Research
Ergonomics
![Page 8: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/8.jpg)
Microsoft
Research
Interaction at a distance
focus is NOT on the device
![Page 9: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/9.jpg)
Microsoft
Research
Existence of good input devices
![Page 10: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/10.jpg)
Microsoft
Research
Rather than replace the existing input
devices with touchscreens,
augment them with touch sensing to
enable novel interactive possibilities.
![Page 11: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/11.jpg)
Microsoft
Research
1. Sensing hardware
2. Interactions
3. Grip vs. gesture
4. Making a product
4 parts
![Page 12: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/12.jpg)
Microsoft
Research
SENSING HARDWARE
Part 1
![Page 13: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/13.jpg)
Microsoft
Research
Five mouse prototypes
Mouse 2.0: Multi-touch meets the mouse. UIST 2009
Nicolas Villar, Shahram Izadi, Dan Rosenfeld, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao, Billy Chen
![Page 14: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/14.jpg)
Microsoft
Research
Prototype 1: FTIR Mouse
![Page 15: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/15.jpg)
Microsoft
Research
Prototype 1: FTIR Mouse
![Page 16: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/16.jpg)
Microsoft
Research
Prototype 2: Orb Mouse
![Page 17: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/17.jpg)
Microsoft
Research
Prototype 2: Orb Mouse
![Page 18: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/18.jpg)
Microsoft
Research
Prototype 3: Cap Mouse
![Page 19: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/19.jpg)
Microsoft
Research
Prototype 3: Cap Mouse
![Page 20: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/20.jpg)
Microsoft
Research
Prototype 4: Side Mouse
![Page 21: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/21.jpg)
Microsoft
Research
Prototype 4: Side Mouse
![Page 22: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/22.jpg)
Microsoft
Research
Prototype 5: Articulated Mouse
![Page 23: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/23.jpg)
Microsoft
Research
Prototype 5: Articulated Mouse
![Page 24: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/24.jpg)
Microsoft
Research
• Biggest sensor area – Orb
• Best touch resolution – FTIR
• Most robust – Cap
• Most precise – Arty
• Dual purpose – Side
What is the best HW solution?
![Page 25: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/25.jpg)
Microsoft
Research
INTERACTIONS
Part 2
![Page 26: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/26.jpg)
Microsoft
Research
How to treat mouse + touch streams?
Independent
Mouse cursor used for
manipulations
Touch used for gesturing
Combined
Touches manipulate the on-
screen objects in addition to
the cursor
![Page 27: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/27.jpg)
Microsoft
Research
IND
EPEN
DEN
T
![Page 28: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/28.jpg)
Microsoft
Research
IND
EPEN
DEN
T
![Page 29: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/29.jpg)
Microsoft
Research
CO
MB
INED
![Page 30: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/30.jpg)
Microsoft
Research
CO
MB
INED
![Page 31: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/31.jpg)
Microsoft
Research
CO
MB
INED
![Page 32: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/32.jpg)
Microsoft
Research
CO
MB
INED
![Page 33: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/33.jpg)
Microsoft
Research
Design and Evaluation of Interaction Models for Multi-touch Mice. GI 2010
Hrvoje Benko, Shahram Izadi, Andrew D. Wilson, Xiang Cao, Dan Rosenfeld, and Ken Hinckley
How effective are multi-touch
manipulations on a mouse?
![Page 34: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/34.jpg)
Microsoft
Research
What is the focus model?
![Page 35: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/35.jpg)
Microsoft
Research
What is the activation model?
Touchscreen(implicit)
Mouse(explicit)
![Page 36: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/36.jpg)
Microsoft
Research
User Study Conditions
Cond. Technique Name Focus Activation
IT MT Mouse Independent Touches No Implicit
HC MT Mouse Hover Cursor Yes - Transient Implicit
CH MT Mouse Click ‘n’ Hold Yes - Transient Explicit
CS MT Mouse Click Selection Yes - Persistent Explicit
M Regular 3-button Mouse Yes - Transient Explicit
T Multi-touch Screen No Implicit
![Page 37: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/37.jpg)
Microsoft
Research
MT Mouse Click ‘n’ HoldFocus: Yes Activation: Explicit
![Page 38: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/38.jpg)
Microsoft
Research
Baseline 1: Regular Mouse
![Page 39: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/39.jpg)
Microsoft
Research
User Evaluation
• 12 participants (6 female)
• 2 tasks
• 90 min
6 techniques
x 2 rotations (± 60°)
x 2 scales (± 20%)
x 4 repetitions
= 96 trials/participant
CameraDell XT2
Standard Mouse
Cap Mouse
![Page 40: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/40.jpg)
Microsoft
Research
MT Mouse techniques were…
… slower,
… more error-prone,
… and less preferred!
![Page 41: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/41.jpg)
Microsoft
Research
Negative results
![Page 42: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/42.jpg)
Microsoft
Research
Lessons learned
• MT mice interactions are better with focus
and explicit touch activation
• Combining mouse and touch to facilitate
Surface-like interactions does not yield a
good experience
• Dexterity is in the thumb and index finger
![Page 43: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/43.jpg)
Microsoft
Research
• Controlling accidental activation is key to
user satisfaction
• Interactions that treat mouse and touch
streams independently do not suffer from
same problems
Lessons learned (2)
![Page 44: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/44.jpg)
Microsoft
Research
GRIPS AND GESTURES
PART 3
![Page 45: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/45.jpg)
Microsoft
Research
The device is continuously
held while interacting!
Fingers serve a dual
purpose: to grip and to
gesture
Challenge & Opportunity
![Page 46: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/46.jpg)
Microsoft
Research
Screen = interactive(touch)
Bezel = Non-interactive(grip, hold, support)
![Page 47: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/47.jpg)
Microsoft
Research
When the entire device is touch sensitive
one can sense the context of use!
– Engagement
– Handedness
– Different grips
However,…
![Page 48: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/48.jpg)
Microsoft
Research
MTPen
Grips and Gestures on a Multi-touch Pen. To appear in CHI 2011.
Hyunyoung Song, Hrvoje Benko, Francois Guimbretiere, Shahram Izadi, Xiang Cao, and Ken Hinckley
![Page 49: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/49.jpg)
Microsoft
Research
Grip vs. GestureRaw Dynamic
![Page 50: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/50.jpg)
Microsoft
Research
![Page 51: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/51.jpg)
Microsoft
Research
![Page 52: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/52.jpg)
Microsoft
Research
MAKING A PRODUCT
Part 4
![Page 53: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/53.jpg)
Microsoft
Research
![Page 54: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/54.jpg)
Microsoft
Research
Combines the virtues of a mouse with
the rich natural language of gesture,
bringing multi-touch gestures to
Windows 7.
Microsoft Touch Mouse
![Page 55: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/55.jpg)
Microsoft
Research
“Product Vision Lead” (?!?)
– Control end-to-end experience
– Design contact tracking and gesture
recognition algorithms
My role…
![Page 56: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/56.jpg)
Microsoft
Research
Grip Click Gesture
Great mouse +
![Page 57: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/57.jpg)
Microsoft
Research
Finding the right form
![Page 58: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/58.jpg)
Microsoft
Research
Form explorations
![Page 59: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/59.jpg)
Microsoft
Research
Design lineage
Arc Mouse Arc Touch Microsoft Touch Mouse
![Page 60: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/60.jpg)
Microsoft
Research
Curved Wireless Capacitive Sensor
12/7/2016Microsoft Confidential
![Page 61: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/61.jpg)
Microsoft
Research
1 FINGER
Manage documents
2 FINGERS
Manage windows
3 FINGERS
Manage desktop
Gesture vocabulary
![Page 62: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/62.jpg)
Microsoft
Research
Gesture vocabulary = 1,2,3
![Page 63: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/63.jpg)
Microsoft
Research
![Page 64: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/64.jpg)
Microsoft
Research
Color, material, finish
![Page 65: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/65.jpg)
Microsoft
Research
Reducing accidental activation
• Gesture recognition
• Contact tracking
• Understanding how the
user holds the device
12/7/2016Microsoft Confidential
![Page 66: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/66.jpg)
Microsoft
Research12/7/2016Microsoft Confidential
![Page 67: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/67.jpg)
Microsoft
Research
Best of CES 2011
![Page 68: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/68.jpg)
Microsoft
Research
In stores Summer 2011 - $79
![Page 69: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/69.jpg)
Microsoft
Research
SUMMARY
![Page 70: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/70.jpg)
Microsoft
Research
To augment existing devices with multi-touch
sensing:
• Extend interaction vocabulary
• Sense the context of their use
• Solve difficult problems (palm rejection)
Opportunity
![Page 71: Multi-touch on small devices - microsoft.com · T Multi-touch Screen No Implicit. Microsoft Research MT Mouse Click ‘n’ Hold Focus: Yes Activation: Explicit. Microsoft Research](https://reader034.fdocuments.us/reader034/viewer/2022050206/5f593f3cc3555b3920445077/html5/thumbnails/71.jpg)
Microsoft
Research
Hrvoje Benko [email protected] http://research.microsoft.com/~benko
Thanks to my collaborators