Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we...

56
Understanding & Modeling Input Devices

Transcript of Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we...

Page 1: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Understanding & Modeling

Input Devices

Page 2: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Questions

1. How do common input devices work?2. How can we think about the larger

space of all possible input devices?3. Can we predict human input

performance?4. What about uncommon input

devices (multitouch, tangible interfaces, …)?

5. Will this be on the exam? Yes.

Page 3: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Today’s lecture in graphic form

Page 4: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

I think my keyboard is broken. Whenever I have a few keys

pressed down, some keys suddenly don’t work anymore; at other times ‘phantom’ characters appear.

What’s going on?

Page 5: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Keyboard

Page 6: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 7: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 8: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 9: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Microprocessor and Controller

Page 10: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Row/Column Scanning

9 lines and 20 keys

http://v.youku.com/v_show/id_XMTI5NjE0OTQ4.html

Page 11: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Closeup

Page 12: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

One key down

Page 13: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 14: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

3 Keys Down

Page 15: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Encoding keyboard: Keys conflict

C1-R1-C2-R2 3 or 4 keys Q,W,A,S

http://www.upsdn.net/html/2006-10/760.html

Page 16: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

A Layered Framework

From: Hartmann, Follmer, Klemmer: Input Devices are like Onions

Page 17: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Mouse

Mouse. Engelbart and English ~1964

Page 18: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 19: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 20: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Encoder wheel for scrollingLeft button

Right button

Page 21: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

IR emitter IR detector

slotted wheel (between emitter & detector)

Page 22: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Sensing: Rotary Encoder

Page 23: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Sensing: Fwd rotation

Page 24: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Sensing: Backwd Rotation

Page 25: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Solutions: Use two Out-of-Phase Detectors

Page 26: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Sensing: Rotary Encoder

Page 27: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 28: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Transformation

cxt = max(0, min( sw, cxt-1+dx*cd )) cyt = … cxt: cursor x (horizontal) position in

screen coordinates at time t dx: mouse x movement delta in

mouse coordinates sw: screen width cd: control-display ratio

Page 29: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Device Abstraction

Click, DoubleClick, MouseUp, MouseDown, MouseMove …

Page 30: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

What about optical mice?

Source: http://spritesmods.com/?art=mouseeye

Page 31: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Source: http://spritesmods.com/?art=mouseeye

Page 32: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Trackball, Trackpad

Page 33: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Trackpoint

Indirect, force sensing, velocity control

Nonlinear transfer function

Page 34: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Joystick

Page 35: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

A design space of input devices…

Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991.A morphological analysis of the design space of input devices. ACM TOIS 9, 2 (Apr. 1991), 99-122.

Page 36: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 37: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 38: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Which is faster?

Page 39: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Which is faster?

Engelbart

Page 40: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Experiment: Mice are fastest!

Page 41: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Fitts’s law

Time Tpos to move the hand to target (size S) which is distance D away is given by:Tpos = a + b log2 (D/S + 1)

Index of Difficulty (ID) Only relative precision

matters

Exam Question Material!

Source: Landay, James. “Human Abilities”. CS160 UC Berkeley.

Page 42: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.
Page 43: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Tpos = a + b log2 (D/S + 1)

Device Characteristics(bandwidth of human muscle group & of

device)a: start/stop time (intercept) b: speed (slope)

Page 44: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Bandwidth of Human Muscle Groups

Page 45: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Why is mouse fastest? Why these results? Time to position mouse

proportional to Fitts’s Index of Difficulty ID.

[i.e. how well can the muscles direct the input device]

Therefore speed limit is in the eye-hand system, not the mouse.

Therefore, mouse is a near optimal device.

Page 46: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Fitts’s law example

Which will be faster on average? pie menu (bigger targets & less distance)

Page 47: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Fitts’s law in Windows &Mac OS

The Apple menu inMac OS X v10.4 Tiger.

Windows 95: Missed by a pixelWindows XP: Good to the last drop

Page 48: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

In office 2007

Larger, labeled controls can beclicked more quickly

Magic Corner: Office Button in theupper-left corner

Mini Toolbar: Close to the cursor

Source: Jensen Harris, An Office User Interface Blog : Giving You Fitts. Microsoft, 2007.

Page 49: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Uncommon Input Devices

Assumptions so far: Single user, working in front of a

desktop PC Main tasks are typing and pointing Efficiency rules

What if we change these assumptions? Design for enjoyment / engagement Design for multi-user scenarios

Page 50: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Position+Orientation: Nitendo Wii

Page 51: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Camera based input: IO Brush

Source: Kimiko Ryokai, http://web.media.mit.edu/~kimiko/iobrush/

Page 52: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Multi-touch

Jeff Han, Perceptive Pixel

http://www.tudou.com/programs/view/LfwscZ1iUXc/

Page 53: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Hybrids: Devices on Tables

Hartmann, Björn, Morris, M.R., Benko, H., and Wilson, A.Augmenting Interactive Tables with Mice & Keyboards. In Proceedings of UIST 2009.

Page 54: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

http://www.vid3o.net/view/v_AvkV286mI/uist09-augmenting-interactive-tables-with-mice-keyboards.html

Page 55: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Hybrids: Multi-touch on Mice

Mouse 2.0: Multi-touch Meets the MouseNicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges,Eyal Ofek, Alex Butler, Xiang Cao and Billy Chen. Proceedings of UIST 2009.

http://www.disclose.tv/action/viewvideo/31170/Mouse_2_0_from_Microsoft/

Page 56: Understanding & Modeling Input Devices. Questions 1. How do common input devices work? 2. How can we think about the larger space of all possible input.

Links

http://bjoern.org http://research.microsoft.com/apps/vi

deo/default.aspx?id=144849


Input Devices Input Devices Output Devices Output Devices BIOS BIOS Input Input Output Output Storage Devices Storage Devices Sequential.

Input Devices Input Devices Output Devices Output Devices BIOS BIOS Input Input Output Output Storage Devices Storage Devices Sequential.

C.S.3 Input and Output Devices Input Devices A. Keyboard.

C.S.3 Input and Output Devices Input Devices A. Keyboard.

Input devices , output devices & storage devices

Input devices , output devices & storage devices

ASHIMA KALRA. INPUT DEVICES INPUT DEVICES OUTPUT DEVICES OUTPUT DEVICES.

ASHIMA KALRA. INPUT DEVICES INPUT DEVICES OUTPUT DEVICES OUTPUT DEVICES.

Lesson 4: Using Input/Output Devices input/output devices common input devices common output devices specialized devices how a device connects what a port.

Lesson 4: Using Input/Output Devices input/output devices common input devices common output devices specialized devices how a device connects what a port.

INPUT DEVICES INPUT DEVICES Submitted by: Pradyumna Bhattarai 014BSCIT027.

INPUT DEVICES INPUT DEVICES Submitted by: Pradyumna Bhattarai 014BSCIT027.

Input Devices

Input Devices

1 Input and Interaction. 2 Input Devices Physical input devices Keyboard devices and pointing devices Logical input devices.

1 Input and Interaction. 2 Input Devices Physical input devices Keyboard devices and pointing devices Logical input devices.

IT Fundamentals1 Input and Output Describe input Input Devices Keyboard entry, pointing devices, scanning devices Image capture, digitizing, audio-input.

IT Fundamentals1 Input and Output Describe input Input Devices Keyboard entry, pointing devices, scanning devices Image capture, digitizing, audio-input.

Input Devices Input Devices Examples of Input Devices Examples of Input Devices Keyboard Keyboard Pointing Devices Pointing Devices Mouse Joystick.

Input Devices Input Devices Examples of Input Devices Examples of Input Devices Keyboard Keyboard Pointing Devices Pointing Devices Mouse Joystick.

Input Devices

Input Devices

ICT IGCSE Theory Revision Presentation 2.1 Input devices ... Input devices and their uses.… · 2.1 Input devices and their uses s Input Devices Device Use Advantages Disadvantages

ICT IGCSE Theory Revision Presentation 2.1 Input devices ... Input devices and their uses.… · 2.1 Input devices and their uses s Input Devices Device Use Advantages Disadvantages