Wearable HCI Talk for U of R

1

Wearable Computing:

HCI Challenges and Opportunities

Daniel AshbrookAssistant Professor, RIT

http://danielashbrook.com

PhD Computer Science 2009

MS Computer Science 2005

BS Computer Science 2001

2009–2013 2013–2014

42014–

WHAT IS AWEARABLE COMPUTER?

6

• Always ready

• Senses & reacts; can act proactively

• Communication tool

• Respects wearer’s attention

• Intimate & personal

7

CHARACTERISTICS

HISTORY OFWEARABLE COMPUTING

9

THE FIRST WEARABLE COMPUTER

Ed Thorpe & Claude Shannon

1966

15

HP CALCULATOR WATCH

1977

16

SONY WALKMAN

1979

17

MIT BORGS 1993

18

EARLY 2000s

19

⬅ Xybernaut MA-V

Symbol barcode scanner

SMART WATCHES

Ruputer: 1998–2006 WristPDA: 2003–2005

21

IBM COMMERCIAL

22

RECENT WATCHES

2013

2012

2010

23

TODAY

24

WHAT IS AWEARABLE COMPUTER?

25

WHAT IS A WEARABLE COMPUTER FOR?

26

Superpower enhancements

Sensing

Proactive action

Instant interaction

27

BENEFITS

SUPERPOWERS

Better! Faster! Stronger!

Enhanced memory!

Instant knowledge!

SENSING

29

PERSONAL ASSISTANCE

30

INSTANT INTERACTION

31


Sensing

Proactive action

Instant interaction

32

BENEFITS COSTS

Ergonomics

Attention

Social weight

34

COSTS

Erogonomics Attention Social weight

ERGONOMICS

35

• Fit

• Size

• Weight

• Materials

• Storage & access

• Graspability

• Robustness

• sweat

• water

• impacts

• connectors

• wires

ERGONOMICS

WEIGHT POWER

HEAT

vs

functionality

form factor

battery life

36

ATTENTION

37

38

ATTENTION

39

ATTENTION

40

ATTENTION

41

Jared LetoScarlett Johansson

ATTENTION

SOCIAL WEIGHT

SW = CL + PP + SCCL → cognitive loadPP → physical presenceSC → social convention

42

Source:A. Toney, B. Mulley, B. H. Thomas, and W. Piekarski, “Social weight: designing to minimise the social consequences arising from technology use by the mobile professional,”

SOCIAL WEIGHTCognitive Load

Physical Presence

Social Convention

CL: •

PP: •

SC: •

CL: •••

PP: ••

SC: •

CL: ••••••

PP: •••

SC: ••

43

CL: •••

PP: •••

SC: •••

CL: •••

PP: ••••

SC: •••••

CL: ?

PP: ••••••••••

SC: ••••••••••••••••••••

44

SOCIAL WEIGHTCognitive Load

Physical Presence

Social Convention

WEARABLE INTERACTIONINPUT & OUTPUT

45


Sensing

Proactive action

Instant interaction

46

BENEFITS COSTS

Ergonomics

Attention

Social weight

MICROINTERACTIONS

47

WEARABLE INTERACTIONINPUT

48

REACTACTINPUT TEXT

Compose a

message

Enter data

(phone number,

web address)

WHY INPUT?

Take a photo

Check calendar

Share

something

React now:

phone call

React

eventually: text

message

49

TEXT INPUT

50

TEXT INPUT

51

ACTING & REACTING

53

WEARABLE INTERACTIONOUTPUT

54

VISUAL OUTPUT

55

AUDIO OUTPUT

56

HAPTIC OUTPUT

57

WEARABLE INTERACTIONMY WORK

58


Sensing

Proactive action

Instant interaction

59

BENEFITS COSTS

Ergonomics

Attention

Social weight

60

Ergonomics

Attention

Social weight

Fastsubtle

interaction

Fastsubtle

interaction

Nenya: Subtle and Eyes-

Free Mobile Input with a

Magnetically-Tracked

Finger RingDaniel Ashbrook, Patrick

Baudisch,

Sean White

Proceedings of CHI 2011

73

BitWear: A Platform for

Small, Connected,

Interactive Devices.Kent Lyons, David H. Nguyen,

Shigeyuki Seko, Sean White,

Daniel Ashbrook, Halley

Profita.

1-bit output1-bit input

design

language

pairing &

authentication

end-user

programming

Integration with other

platforms & devices

Discoverability of

functionality

How many

wearables/person?

Turning it off

and showing that state: e.g. Glass

vs Autographer

Where is data? 80

CHALLENGES

81

CURRENT WORK

New interfaces for wearable computing

Augmented digital fabrication

Studying barriers to & motivations for "making"

83

Thank you!

danielashbrook.com

Now recruiting PhD students:

http://tinyurl.com/rit-hci-phd

Wearable HCI Talk for U of R

Technology

Transcript of Wearable HCI Talk for U of R