Student Name Server Utah School of Computing slide 1 Utah School of Computing GesturesGestures...

Post on 29-Mar-2015

214 views 0 download

Tags:

Transcript of Student Name Server Utah School of Computing slide 1 Utah School of Computing GesturesGestures...

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 1slide 1

Utah School of Computing

Utah School of Computing

GesturesGestures

CS5540 HCI Rich Riesenfeld

Fall 2010

CS5540 HCI Rich Riesenfeld

Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 2slide 2

Gestures Studies Gestures Studies

Following Gesture material from: Following Gesture material from:

Hand Centered Studies of Human Movement Project, School of Kinesiology, Simon Fraser University, February 1996

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 3slide 3

Gestures-1Gestures-1

• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman

amphitheater (thumb up/down)

• Praying (two flat hands up together) • Begging (flat hand) • Expressing anger (raising a fist) • Derogation (middle finger up) • Accusation (index pointing) • Live or die decisions in the Roman

amphitheater (thumb up/down)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 4slide 4

Gestures-2Gestures-2Hitch hiking (thumb up, hand moving sideways)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 5slide 5

Gestures-3Gestures-3

Legal and business transactions (handshake, judge hammering)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 6slide 6

Gestures-4Gestures-4

Pointing to real and abstract objects and concepts (index, hand)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 7slide 7

Gestures-5Gestures-5

Waving and Saluting

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 8slide 8

Gestures-6Gestures-6

Waving and Saluting

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 9slide 9

Gestures-7Gestures-7

Finger Counting

Thumb often used for “1”, esp abroad

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 10slide 10

Gestures-8Gestures-8

Fall 2010Fall 2010

I beg of you …

I hope so …

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 11slide 11

Gestures-9Gestures-9

Fall 2010Fall 2010

Let’s hope its true

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 12slide 12

Gestures-10Gestures-10

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 13slide 13

Gestures-11Gestures-11

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 14slide 14

Gestures-12Gestures-12

Terminate / cut

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 15slide 15

Gestures-12Gestures-12

Love (Am Sign Language)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 16slide 16

Gestures-13Gestures-13

Fall 2010Fall 2010

Whoa, stop, …

End

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 17slide 17

Gestures-14Gestures-14

110 100

Trading Floor Hand Signals

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 18slide 18

Gestures-15Gestures-15

Fall 2010Fall 2010

juneseptember

callput out

Trading Floor Hand Signals

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 19slide 19

Gestures-16 Gestures-16

• Conducting an orchestra (variety of both gestures with arms and body)

• Traffic control of cars and airplanes (hands flat pointing or moving)

• Shaping of imagined objects (hands tracing out curves and shapes)

• Martial arts, fighting (variety of movements of arms and body)

• Conducting an orchestra (variety of both gestures with arms and body)

• Traffic control of cars and airplanes (hands flat pointing or moving)

• Shaping of imagined objects (hands tracing out curves and shapes)

• Martial arts, fighting (variety of movements of arms and body)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 20slide 20

Gestures-17 Gestures-17

• Dance (Balinese dancing) • Gesturing by singers (hand and body

movements) • Stock exchange operations (various

hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /

appreciative (hand clapping) gestures

• Dance (Balinese dancing) • Gesturing by singers (hand and body

movements) • Stock exchange operations (various

hand shapes) • Affective gestures (hand touching) • Rejective (index up moving left & right) /

appreciative (hand clapping) gestures

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 21slide 21

Gestures-18 Gestures-18

• Game playing (hand signs to communicate with partner in card games)

• Game scoring (cricket, basketball, soccer, rugby, football)

• Dinner table actions (commanding waiter to refill wine glass)

• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)

• Game playing (hand signs to communicate with partner in card games)

• Game scoring (cricket, basketball, soccer, rugby, football)

• Dinner table actions (commanding waiter to refill wine glass)

• Positioning of real (remote or close) Control Panel operations (mousing, steering a vehicle)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 22slide 22

Gestures-6 Gestures-6

• Moving, touching and interacting with objects

• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)

• “Italianate" gestures (two hands open shaking)

• Moving, touching and interacting with objects

• Silent and non-verbal communication (shrugging, holding one's own earlobe, scratching)

• “Italianate" gestures (two hands open shaking)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 23slide 23

Gestures-7 Gestures-7

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• sign language (a complete linguistic communication system)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

• sign language (a complete linguistic communication system)

• Mimicry and pantomime (actions and objects are depicted with hand/body movements)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 24slide 24

Gestures-8 Gestures-8

• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic

communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino

• Shimmering hand (maybe, maybe not)• Sign language (a complete linguistic

communication system) • Aircraft carrier landings• Dog training• Gambling signals at a casino

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 25slide 25

Pictograms - 1Pictograms - 1

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 26slide 26

Pictograms - 2Pictograms - 2

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 27slide 27

Pictograms - 3Pictograms - 3

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 28slide 28

Pictograms -4Pictograms -4

Pictgram standardMAYON OF LOND ON

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 29slide 29

Pictogram standardMAYOR OF LOND ON

Pictograms - 5Pictograms - 5

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 30slide 30

                             

                              

                              

Special Need Group: DiversSpecial Need Group: Divers

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 31slide 31

                             

                              

                              

“Help”

“Which direction?”

“Boat"

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 32slide 32

Underwater Communications and Hand Signals - 1

Underwater Communications and Hand Signals - 1

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 33slide 33

Underwater Communications and Hand Signals - 2

Underwater Communications and Hand Signals - 2

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 34slide 34

Underwater Communications and Hand Signals - 3

Underwater Communications and Hand Signals - 3

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 35slide 35

ARFF Emergency Hand Signals - 1ARFF Emergency Hand Signals - 1

Aircraft Rescue and Fire Fighting (ARFF) Communications

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 36slide 36

Recommend EvacuationRecommend Evacuation

ARFF Emergency Hand Signals - 2ARFF Emergency Hand Signals - 2

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 37slide 37

Recommend StopRecommend Stop

ARFF Emergency Hand Signals - 3ARFF Emergency Hand Signals - 3

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 38slide 38

Emergency ContainedEmergency Contained

ARFF Emergency Hand Signals - 4ARFF Emergency Hand Signals - 4

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 39slide 39

hear this,hear this,

Fall 2010Fall 2010

Now, Now,

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 40slide 40

hear this,hear this,Now, Now,

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 41slide 41

Aircraft Carrier Deck OperationsAircraft Carrier Deck Operations

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 42slide 42

Flight Deck Organization -1Flight Deck Organization -1

Fall 2010Fall 2010

Aircraft traffic flow using angle deck

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 43slide 43Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 44slide 44

Uniform Colors-1Uniform Colors-1

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 45slide 45Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 46slide 46

Uniform Colors-2Uniform Colors-2

Fall 2010Fall 2010

Yellow Shirts: Flight Deck Officers and Plane Directors

Green Shirts: Catapult and Arresting Gear people

Red Shirts: Aviation ordnance crews.

Checker Shirts: Squadron maintenance

White Shirts: (w Red Cross):

Flight deck medical corpsmen

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 47slide 47

Uniform Colors-3Uniform Colors-3

Fall 2010Fall 2010

Blue Shirts: Flight Deck Crew

Brown Shirts: Squadron personnel

Purple Shirts: Aviation fuels people

White Shirts: Mail and people handlers

White Shirts: (w Red Cross):

Flight deck medical corpsmen

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 48slide 48

Plane Director Uses Hand Signals to Give Directions to Pilots - 1

Plane Director Uses Hand Signals to Give Directions to Pilots - 1

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 49slide 49

Plane Director Using Hand Signals - 2Plane Director Using Hand Signals - 2

Fall 2010Fall 2010

<Flight_Deck.mht>

Cat video.avi

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 50slide 50

Ready for Launch Ready for Launch Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 51slide 51

B & O Touchless Remote - 1 B & O Touchless Remote - 1

Bang & Olufsen (see folder of neat material in resource folder)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 52slide 52

ConclusionsConclusions

• Like poetry, extraordinarily succinct• Can be highly Universal, International

- Subject to bad cultural misinterpretations

• Increasingly widespread use- Olympics- Travel- Commerce

• Like poetry, extraordinarily succinct• Can be highly Universal, International

- Subject to bad cultural misinterpretations

• Increasingly widespread use- Olympics- Travel- Commerce

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 53slide 53

Utah School of Computing

Utah School of Computing

End End

Gestures Gestures

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 54slide 54

BOOKMARKBOOKMARK

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 55slide 55

Complete Final Turn

Up(Instructions to pilot)

Suspend Catapult Operation

All Clear or Affirmative

Brakes off or Brakes

On

(Fist clenched = Suspend Operation)

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 56slide 56

I have control. (Taking over from previous controller)

Hang Fire(Pilot to hold on until further instructions)

Lower Launch Bar

or Raise Launch Bar

The pilot salutes when ready to launch.The Plane Director returns salute to acknowledge pilot's readiness.

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 57slide 57

BOOKMARKBOOKMARK

Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 58slide 58Fall 2010Fall 2010

<http://www.youtube.com/v/RmhtFk2zCmM?version=3

Logitech Harmony 900

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 59slide 59Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 60slide 60Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 61slide 61Fall 2010Fall 2010

Student Name ServerStudent Name ServerUtah School of ComputingUtah School of Computing slide 62slide 62Fall 2010Fall 2010