the humanperception and

cognition

computational analogy

input processing output

perception cognition(thinking and memory)

action(motor system)

a cycle of interaction

perception

cognition

action

the world

perception

‘the’ five senses

sightsoundsmelltouchtaste

complexpain, temperature,pressure, texture

largelysmell!

distant

closer

contact

inside!

‘the’ five senses

sightsoundsmelltouchtaste

not the whole story

outside and within

sight, sound, smell, touch,

taste

exteroception

sensing the outside

interoception

sensing the inside

headaches, hunger,

proprioception

outside and within

sight, sound, smell, touch,

taste

exteroception

sensing the outside

interoception

sensing the inside

headaches, hunger,

proprioception

most used sense in interfaces

(e.g. retina displays!)

around half the brain dedicated to vision

sight,sight,

sight and sound

in short

the eye(s) and vision

on the frontiris & pupil (lens) – adjust light level and focus two of them – 3D vision – but not the only way

at the backfovea – detailed and colour ... but very small,

peripheral vision – b&w, movement, grabs attention

insidetwo pathways – fast, old, unconscious

+ slower, newer, conscious

the ears and sound

inherently temporalno ‘still’ sound => issues for media

two of them & pinna directional ... stereo & full 3D

little physical focus, but ...attention – cocktail part effect

background – context and grab attention

eye & ear ... common

attention – focus limited

periphery – context, broader, but unconscious

grabbing attention

constructionfilling gapsmeaning

cognition

memory and thinking

memory

in short

types of memory

seconds

timescale

short-term memory (STM)

long-term memory (LTM)

mezzanine memory

sensory memory

minutes

hours/days

lifetime

comparison

short term long term mezzanine

capacity 7+/-2 chunks big! ?

decay ~30s lifetime ? mins–hoursneeds rehearsal

laying down implicit repetition implicit

neural electrical physical chemical?mechanismneuron firingsynapse growth LTP

types of LTM

episodicserial memory of events

may be hard to recall out of order

=> story and narrative

semantic / declarativefacts, concepts, skills

links and associations

=> recognition vs recall

http://en.wikipedia.org/wiki/File:The_Tyger_BM_a_1794.jpg

semantic not photographic

all memories are constructed

confabulation, false memories

perception

encode

memories

reconstruct

mezzanine memory

what have I been doing recently?short-term episodic memory

what am I doing now?context – activates LTM

cockpits and control roomssituation awareness

readinglong-term working memory

http://en.wikipedia.org/wiki/File:Swiss_Saab_2000_Cockpit.jpg

implicit / tacit as well as explicit

automatic reactionsmotor memoriesexpert knowledge

http://www.flickr.com/photos/protographer23/358987856/

implicit explicitactivation & context

introspection

& externalisation

proceduralisation

thinking

logical?

Aristotle & formal logic

Wason card testpossible rule: vowel one side ⇒ even on otheris it right?

all men are mortalSocrates is a man=> Socrates is mortal

EE 77 KK 22

4433 AAZZPPUU

reasoning – the real world

confirmationnot falsification

abductionnot deduction

satisficingnot optimality

special purpose intelligence

Wasonrule: vowel one side ⇒ even on other

socialrule: take newspaper ⇒ pay for it

EE 77 KK 22

paperpaper no no ££ nonopaperpaper ££

social rule: take newspaper ⇒ pay for it

below the surface

priming, insight

linear – single ‘stream of consciousness’interruptions = disruptionsmultitasking – really rapid switching

conscious

unconscious non-linear, fuzzy, intuitive, associativeshare with animals

into actionand

into the world

we live to act

perception

cognition

action

the world

low level

automatic reactionsinnate and learnt

e.g. heat reflex

hand–eye coordinationFitts’ Law:

time ~ log (distance/size)d

s

perception and action

attention

periphery

grabbing attention

single stream of consciousnesssingle stream of activity

often physical movement

feeds unconsciousnessassociations

higher level

longer–term conscious planning and activity

moment-to-momentNorman’s execution evaluation cycle

user establishes the goalformulates intentionspecifies actions at interfaceexecutes actionperceives system stateinterprets system stateevaluates system state with respect to goal

system

evaluationexecution

goal

Human error - slips and mistakes

slip understand system and goal correct formulation of action incorrect action

mistake may not even have right goal!

Fixing things?slip – better interface designmistake – better understanding of system

all in the mind?

reminders, lists,notes, workings

we think using the worlddistributed cognitionsituated actionextended mind