Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins,...

69
patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo ramos phosphor

Transcript of Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins,...

Page 1: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

patrick baudischmicrosoft research, ASI, interaction focus

desney tan, maxime collomb, dan robbins, ken hinckley,maneesh agrawala, shen zhao, gonzalo ramos

phosphor

Page 2: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

demo

Page 3: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

visual language

Page 4: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

performance benefits

Page 5: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

motivation

Page 6: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

people operating

GUIs make mistakes…

Page 7: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

…asking every time can be slow…

Page 8: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

…andusers have trouble

following whatothers are doing

Page 9: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

[Expose]

animation can help…

Page 10: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

…but animation oftenforces users to wait

Page 11: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

animationanimatio

npast future

can we do without the “lag”?

Page 12: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

phosphor

Page 13: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

phosphor transition :=1. show outcome of the change instantly and

2. explain the change in retrospect usinga diagrammatic depiction

Page 14: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

animationanimationpast future

phosphorpast phosphor

future

Page 15: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

animationexplains transition first and then shows outcome

phosphorexplains transition and outcome at the same time

phosphor lets users choose whether to attendto a transition or to ignore it

Page 16: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

afterglow (specific case of phosphor effect) :=• show previous state and• show how it changed

Page 17: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

demoafterglowfades over timemultiple on screen

Page 18: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

1. afterglow = visual buffer for changes

helps users follow activities in bursts

2. afterglow has (almost) no notion of time

users read transitions at their own pace

3. afterglow can be read back and forth

helps undoing undesired changes

users benefit

Page 19: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

1. users choose to attend to transition; wait never

2. giving extra time (to the inexperienced) is cheap

3. free application designersfrom hand-optimizing animation speed(just pick reasonable upper bound)

designers benefit

Page 20: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

susceptible to clutter

however

Page 21: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

related

Page 22: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

cartoon animation

[thomas01]

animation

[chang93]

( )

Page 23: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

chrono photography

[marey 1878]

photography

Page 24: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

photography

Page 25: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

comics

Page 26: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

comics

[mccloud93]

understanding comics

Page 27: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

storyboards

[Joshua Siegel]

Page 28: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

[haller04]

games

non-photorealistic rendering

Page 29: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

APEX

[feiner85]

visualization

Page 30: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

visualization

lithium

[hobbler04]

Page 31: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

action synopsis

[assa05]

visualization

Page 32: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

chrono volumes

[woodring03]

visualization

Page 33: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

transient visual cues for scrolling

[kaptelinin02]

user interface

Page 34: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

[mac os x]

user interface

( )

Page 35: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

high density cursor

[baudisch03]

user interface

previous cursorposition

current cursorposition

Page 36: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

telepointer traces

[gutwin02]

user interface

Page 37: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

MAUI groupware toolkit

[hill&gutwin03]

user interface

Page 38: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

mnemonic rendering

[bezerianos5min ago]

user interface

Page 39: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

drag-and-pop

[baudisch03]

user interface

Page 40: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

•can we apply comic transitions to GUI widgets?

•what visual language?

•are there performance benefits?

questions

Page 41: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

phosphor

Page 42: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.
Page 43: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

space for time1. envision animated transitions

2.project along time axis

x

y

challenges

1. show temporal order

2. avoid occlusion

Page 44: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

initial state

path

target state

names

Page 45: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

stylesstrobe blur speed line

less clutter, better sense of direction,better readable if overlap,

Page 46: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

showing timefading stacking initial

Page 47: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

move copy

temporary

file extract

action

drag-and-pop

Page 48: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

initial animation[chang 93]

resultingphosphortransition

addingverticalmotion

stationary

Page 49: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

reveal initial

reveal initial state omit path

Page 50: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

out-of-band

transparentto opaque

50% alphato opaque

rotation ortransition?

rotation!

Page 51: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

multiple

overlap is not a problem avoidance

Page 52: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

multiple

shorten paths single path

[terveen: “clans”]

Page 53: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

implement

Page 54: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

extract

temporary move copy

rotate

avoidance

null operation

spawn child window

delphi

Page 55: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

flash

Page 56: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

study 1

Page 57: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

task

Page 58: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

interfaces

with phosphor vs. without phosphor

12 participants (1 female)

Page 59: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

performance benefits

Page 60: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

study 2

Page 61: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

task

Page 62: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

Time - Interface x Outcome

phosphor animation

Time - Interface x Task

phosphor animation

phosphor animation phosphor animation

Error

Error

Page 63: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

patrick baudischpatrickbaudisch.com

end

Page 64: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

tableclothdrag&popf+c screens mouse etherhd cursor

large screens

staticanimation

Page 65: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

...swooooosh

Page 66: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

the problemwith animation…

• animation in the UI can help users follow transitions

• right speed is crucial• too fast error rate++• too slow task time++

• right speed also depends on familiarity, distraction… we cannot determine the right speed

Expose

Media Player

Page 67: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

this time: generalize…

Page 68: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

visual language& prototype

opacity

scale

extract

temporary move copy

rotate

avoidance

null operation

spawn child window

Page 69: Patrick baudisch microsoft research, ASI, interaction focus desney tan, maxime collomb, dan robbins, ken hinckley, maneesh agrawala, shen zhao, gonzalo.

GUI manipulations…

help remotecollaboratortrack what I do