Infoception 6

Step by Step implementation

of the infoceptive profile

Clinical Biometrics/Cognitive parameters implementation

C.Agaya APSCONSEILS R-D.2011

Work in progress

Cognitive functions and Human computer interaction(HCI)

• The User’s cognitive system modelization is a key issue in HCI.• The problem is that , cognitive activity is hard to observe directly.• To get access to cognitive status of an individual , the experts design

representations of the cognitive system.• Most used in HCI studies and protocols are• Human Processor Model• D.A Norman Theory of Action • Card ,Moran,Newell GOMS and KEYSTROKE • D. KIERA’s EPIC

C.Agaya APSCONSEILS R-D.2011

Cognitive functions Assessment• Psychometry provide a variety of cognition testings.• In clinical studies most of these procedures are used for patients with

neurologic problems such as Alzheimer disease• The clinical assessment investigates mainly the memory modalities.• In the psychology area,investigation may include

1. User ‘s mental models of HCI2. Attention3. Awareness4. Decision making, problem solving, planification of action5. Metacognition

(Klein,cit. by Tadwalkar)

C.Agaya APSCONSEILS R-D.2011

Cognitive functions assessment via ophthalmic examination

• Eye examination provide precious information about the User’s cognitive status.

• Therefore , is it possible to assess the User’s mental work via ophthalmic screening?

C.Agaya APSCONSEILS R-D.2011

Eye Fixations as the reflect of cognitive activity

• Eye fixation is a critic time in User’s information treatment process during HCI

• Indeed , fixation allows:• Refresh short-term memory• Extend short term memory• Real-time exploitation of the data displayed on the

screen• Implementation of awarness system• Sustained attention

C.Agaya APSCONSEILS R-D.2011

Eye Fixation as a high-level function of the Ocular Complex

• The Ocular Complex is a systemic approach of the eye , including– Oculomotor skills– Ocular neurosensitive pathways– Ocular inflammatory reactions– Cornea– Tears production system– Blinks

Ocular complex is mobilized during fixation viaExtrinsec Oculomotors skills (saccades,convergence)Intrinsec oculomotor skills (accommodation)Control of blinks.Electro oculography applied to reading is a research tool for Ocular Complex

functions assessment (Perrier et all.) usable by both ophtalmologists and cognition experts.

C.Agaya APSCONSEILS R-D.2011

Ocular-Complex Functiuns Assessment

• Althought clinicians are familiar with electro oculography ,

• Eye tracking is the most adapted technique for Ocular-Complex functiuns assessment.• Eye Tracking Devices (ETDs) are mainly used in

research laboratories , but in the future it will be a standard for infoception studies.

• Applications of ETD results are raising in marketing studies , web analysis.

C.Agaya APSCONSEILS R-D.2011

User’s Cognitive assessment via ophthalmic procedures (EOG/ ETD)

Ocular ComplexFunctiun

iCognitive functon

Saccades Pursuits Convergence Accommodation Convergence Blink

Metacognition

Mental model of HCI

Working memory

XXX XXX XXX XXX XXX XX

Attention Xxx xxx xxx xxx XXX XXXAwareness XXX XXX XXX XXX XXX XXXInformation filtering

XXX XXX XX XX XX XX

Information seeking

XXX XXX XXX XXX XXX XXX

C.Agaya APSCONSEILS R-D.2011

Implementing Clinical Biometrics/Cognitive

Clinical/Biometrics Testings/CognitiveNumber of fixations

Gradient Scale 0 1 2 3 4 5

Examples of Ocular-Complex Testings for Cognition assessment with EYE Tracking Device (i)

Clinical/Biometrics Testings/CognitiveDuration of fixations(msec)

Gradient Scale 0 1 2 3 4 5

The ETD exploitation in infoception is still hard , due to the cost of this technology.The scientific community’ hope is to see for the next years a significant reduction of EDTS pricing (see Tobii)….

C.Agaya APSCONSEILS R-D.2011

Clinical/Biometrics Testings/CognitiveNumber of Saccades

Gradient Scale 0 1 2 3 4 5

Clinical/Biometrics Testings/CognitiveNumber of Pursuits

Gradient Scale 0 1 2 3 4 5

Implementing Clinical Biometrics/Cognitive

C.Agaya APSCONSEILS R-D.2011

Examples of Ocular-Complex Testings for Cognition assessment with EYE Tracking Device(ii)

C.Agaya APSCONSEILS R-D.2011

Work in progress