Lecture3 Computer

8/13/2019 Lecture3 Computer

1/42

CS374 Human-Computer Interaction

Computer & Interaction

Monvorath Phongpaibul

Prapaporn Rattanatamrong

1


2/42

Input/Output Devices

There are many equivalent devices- Plus compatible, can simulate others

Some are more flexible/accurate for users/tasks- Equivalence may be only from the point of view ofthe software

Many trade-offs in devices- Should be chose based on task, users, economics

Device types- Input Devices many physical devices can providesimilar logical functions- Output Devices


3/42

Input DevicesLogical Input Devices

Locator (Indicate a position via mouse or arrow key) Pick (Select a displayed entity, e.g. selection button) Valuator (Supply a numerical value)

Keyboard (Input a string or function key input) Button (Choose menu selection item)

Physical Input Devices Voice (speech recognition) Keys

Button (used with many pointing devices, multi-press is common) Keyboard (styles next) Programmable function keys (hardware, software, or templateoverlays Cursor keys (e.g. hjkl, or arrow keys)


4/42

Keyboards

Sholes (QWERTY) Standard Layout

Dvorak Layout minimized finger movement

Alphabetic Aids search for novice users, but no much else

Chords For example, courtroom recorders

Point of sale Customized keyboards/cash registers


5/42

Standard vs. DvorakTraditional (standard)

keyboard folklore:

1) design avoidedmechanical key jamming

2) the letters T-Y-P-E-W-R-I- T-E-R are all on the firstrow for ease tosalespersons

Dvorak keyboard layout wasdesigned to minimize

finger movement (note thelocation of the vowels: A- E-I-O-U, and note Q & Z inthe corners


6/42

One-Handed Keyboard (for Mobile or Disabled Workers)www.frogpad.com


7/42

Input Devices (concluded) Joy Stick (2D and 3D) Thumb wheels Track ball (low space needs) Mouse (multi-button) Rat (foot mouse) Digitized tablet (puck in rink, exact input with cross- hairs on mouse) Pen and tablet (natural input) Light pen (synchronized with scan lines) Touch screen Touch pad (overlay templates) 3D devices (data glove, other devices for moving in space) Gesture/movement sensitive (projection; you select items by moving

Scanners, including text-to-speech Eye trackers Stylus on PDAs Trackpoint on laptops Have I forgotten any?

See eye tracker products athttp://www.naturalpoint.com/


8/42

Alphagrip.com


9/42

Input device example


10/42

Input device example 2

http://www.naturalinteraction.com/


11/42



12/42


http://www.emsense.com/


13/42


Dance Your Work Away: Exploring StepUser Interfaces, by Brian Meyers et al fromMicrosoft Research


14/42


NTT's Tangible-3Dprototype gives feeling to

on-screen imageryBased around an improved version of thecompany's original 3D display, this prototypesystem relies on a sophisticated array ofcameras and an actuator-stuffed glove that can

allow the wearer to "feel the image" that showsup on the LCD.

http://www.engadget.com/2007/06/21/ntts-tangible-3d-prototype-gives-feeling-to-on-screen-imagery/
http://translate.google.com/translate?u=http://www.nttcom.co.jp/news/pr07062001.html&langpair=ja|en&hl=en&ie=UTF-8&oe=UTF-8&prev=/language_tools


15/42


PentopFly Pen educational toy, also knows as the Fly Pentop Computer


16/42


Mini Pen Computerhttp://boldt.us/things/computers/pen-pc/?g2_jsWarning=true


17/42

Visual Keyboard


18/42

3D Hologram Display


19/42


Ohio Subway implements firstdrive-thru touchscreen kiosk

Please don't try this with other kiosks

http://www.kioskmarketplace.com/article.php?id=15926


20/42

Environments

Combination of the above in immersiveenvironments Will discuss more with respect to USC

IMSC & ICT


21/42

Speech RecognitionDiscrete Word Recognition

98% accuracy claimed Limited vocabulary Speaker dependent training Voice recognition, menu driven systems, e.g. United flightstatus line Commercially viable when you need hands free (e.g. baggagehandling, medicine, jet maintenance, inspectors, inventory, etc.)

Continuous Speech Recognition Becoming more common-place Research improving technology

Speech Generation Commercially viable, good quality, supplements screen display,phone systems, physically challenged applications

See translator products athttp://www.speechgear.com/


22/42

Output Devices

Visual output Indicator light Monitor/displays of varying sizes, from hand-held(PDA, cell phone), laptop LCD, monitors, large-screendisplay, projection systems including heads-updisplays, hardcopy

Auditory output

Voice generation Tone generation


23/42

Ready to Wear

(Ref: IEEE Spectrum, Oct. 2000)


24/42

Heads-Up Situation Display

http://www.microvision.com/nomad/


25/42

Paintinghttp://web.media.mit.edu/~kimiko/iobrush/iobrush_mpeg_medium.mpg


26/42

Gesturing

What's Next: Nice GestureThe next interface for information-laden displays could be at theend of your arm.

Raytheon and g-speak are developing "gesture-technology" systems, which use infrared camerasand reflective gloves rather than a mouse or

trackball to manipulate video, text, and otherinformation. Showcased in the 2002 sci-fi film"Minority Report," gesture technology could becommercially available within five years .

In the 2002 movie Minority Report, TomCruise plays a detective who conductsinvestigations by standing in front of achalkboard-sized display and using specialgloves to sort through videos, photos, and text. Itmay seem like science fiction, but it also lookslike a viable way to get a grip literally onmore information than you could make sense ofon a PC screen.

http://proav.pubdyn.com/2005_July/July20712005121700PM.htm http://www.minorityreportdvd.com/


27/42

Minority Report (Movie) and Matrix (Movie) The innovative use ofdirect manipulation for interacting with virtual objects as if they arereal objects

Thanks Sonali Joshi, Harishkumar Narayanan, Badri Rajan

Gesturing 2


28/42

Gesturing (concluded)Researchers from MIT have developed a computer interface that enables a user to manipulate

virtual shapes projected onto a screen using gestures Gestures such as pointing and spoken commands, Commands like "make a red cube in the middle of the screen."

Standing in front of cameras mounted above the screen, a user can create a virtual cube,rotate it, and change its color and size.

In one experiment, the researchers found that their gesture recognition system had an errorrate of 6 to 17 percent with some gestures, but a zero error rate when the gesture wascoupled with a corresponding spoken command.

Source: Demirdjian, D., T. Ko, and T. Darrell. 2005. Untethered gesture acquisition andrecognition for virtual world manipulation. Virtual Reality.

http://www.technologyreview.com/articles/05/10/issue/ftl_info.2.asp


29/42


30/42

Northrop Grumman & Applied Minds, Inc. TouchTablehttp://www.ms.northropgrumman.com/touchtable/

http://www.touchtable.com/


31/42

Mitsubishi has an analogous productrecently demod in multiple user game environments at the InternationalWorkshop on Pervasive Gaming Applications (PerGames)

http://www.merl.com/projects/DiamondTouch/DTflier.pdf


32/42

TouchTable examplehttp://seattlepi.nwsource.com/audio/bishop/tabletop.wmv

Also see: http://mblog.lib.umich.edu/~rdivecha/archives/2006/02/the_world_of_sm.html


33/42

Microsoft Corp. unveiled a coffee-table-shaped "surface computer"Wednesday in a major step towards co-founder Bill Gates' view of afuture where the mouse and keyboard are replaced by more naturalinteraction using voice, pen and touch.

Microsoft Surface, which has a 30-inch display under a hard-plastictabletop, allows people to touch and move objects on screen foreverything from digital finger painting and jigsaw puzzles to ordering off avirtual menu in a restaurant.

http://www.microsoft.com/surface/

Microsoft Table Surface Computer


34/42

Designing for multi-person multi-deviceenvironments - Interaction devices and methods

- Design theories and approach - Primary focus on explicit interaction, technical work - Experimenting with Interactive Room (iRoom)

with Terri Winograd (Stanford), Pat Hanrahan, ArmandoFox, Jan Borchers, Maureen Stone, ++

Interactive Workspace Project


35/42

An augmented dedicated space e.g. conference room can be used with teleconnected spaces

Task-oriented scenarios e.g. brainstorming meeting, design review

Multi-device, multi-user, multi-application Easy to (re)configure

Movement of information across multiple devices, and frompersonal to/from multi-user devices

Integration & augmentation of legacy apps

What is an Interactive Room?


36/42

http://iwork.stanford.edu/

Stanford iRoom


37/42

http://imsc.usc.edu/

USC VSoE IMSC conducts research in many technologies relevant tothis course: 3D Modeling, 3D Stereospopic, Audio, AugmentedReality/Virtual Reality, Data Management, Haptics, InteractiveEducation, Music Processing, Panoramic Video, SoftwareArchitectures, Speech, Streaming, Tracking, User Centered Sciences,Video Processing, Wireless


38/42

The Interaction


39/42

Interaction Framework

S U

O

I

Ergonomics

Dialogue


40/42

Ergonomics Study of the physical characteristics of the interaction

Focus on user performance and how interface enhancesor detracts from this

This course will consider a few of the issues addressedby ergonomics as an introduction Arrangement of controls and displays Physical environment Health issues Use of color


41/42

Dialog

Interaction Style Interaction is a dialogue between computer and the user

The choice of interface style can have a profound effecton the nature of this dialogue

Interaction Style Command line interface Menus Natural Language Question / answer and query dialogue Etc


42/42

- Question -

Lecture3 Computer

Documents

Transcript of Lecture3 Computer