Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model
-
Upload
giacomo-veneri -
Category
Education
-
view
1.193 -
download
0
description
Transcript of Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model
![Page 1: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/1.jpg)
Evaluating Human Visual Search Performance by
Monte Carlomethods and Heuristic model
Giacomo Veneri, Elena Pretegiani, Pamela Federighi, Francesca Rosini, Antonio Federico & Alessandra Rufa
University of SienaDepartment of Nerurology & Neurosurgery and Behavioral
Sciences
![Page 2: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/2.jpg)
Human Visual System The main mechanisms of Human Brain
Eye Tracking Method How to register Eye movements
How to model Visual Search The Model Results of healthy subjects Results of patients Conclusions
Summary
60% of Brain is
dedicated
to Vision
![Page 3: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/3.jpg)
Human Visual System
Evaluating Human Visual Search Performance by Monte Carlo
methods and Heuristic model
![Page 4: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/4.jpg)
Saccade aprox 600deg/secSaccade aprox 600deg/sec
Exp1/5
![Page 5: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/5.jpg)
Human is foveate animalHuman is foveate animal
![Page 6: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/6.jpg)
E
E
E
EE
E
EESpot AttentionSpot Attention
Exp2/5
![Page 7: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/7.jpg)
SaliencySaliency
Exp4/5
![Page 8: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/8.jpg)
The optic radiations, one on each side of the brain, carry information from the thalamic lateral geniculate nucleus to layer 4 of the visual cortex.
The lateral geniculate nucleus (LGN) is a sensory relay nucleus in the thalamus of the brain. The LGN consists of six layers in humans and other primates starting from catarhinians, including cercopithecidae and apes.
The visual cortex is the most massive system in the human brain and is responsible for processing the visual image.
Human Visual System pathway
![Page 9: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/9.jpg)
Eye Movement
fixation, in which the eyes are directed toward a motionless object
saccades, in which the eyes move very rapidly from one location to another
Other smooth pursuit, in which the eyes
move steadily to track a moving object;
vergence, in which the eyes move simultaneously in opposite directions to obtain or maintain single binocular vision.
![Page 10: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/10.jpg)
Human Visual System
Where: where is the object? What: which object to see?
The overall system: Eye Movement
Saccade, vergence, fixation Attention Memory/Working memory Object
segmentation/identification Peripheral vision Saliency
Where
What
Visual Serach is Pseudo Random
![Page 11: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/11.jpg)
Visual processing pathways in monkeys. Areas in the dorsal stream, having primarily visuospatial functions, are shown in green, and areas in the ventral stream, having primary object recognition functions, are shown in red. Lines connecting the areas indicate known anatomical connections, with heavy arrowheads indicating feed-forward connections from lower-order areas to higher-order ones and open arrowheads indicating feedback connections from higher-order areas to lower-order ones. Solid lines indicate connections from both central and peripheral visual field representations, and dotted lines indicate connections restricted to peripheral field representations. Shaded region on lateral view of the brain indicates extent of cortex included in the diagram. (From ref. 85; for further details of the visual areas, see ref. 86.)
Monkey Visual System
Ungerleider L G et al. PNAS 1998;95:883-890
Where
What
![Page 12: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/12.jpg)
Main Block
Saliency of Image/scene Peripheral vision
AttentionInternal statusWorking memory
![Page 13: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/13.jpg)
The key idea
parameters
subjects
patients
![Page 14: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/14.jpg)
![Page 15: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/15.jpg)
Subject break away from latest fixation
The temporal window is about 1000ms (3 fixations)
[Veneri & Pretegiani 2010]
The role of latest fixations
12/04/23Giacomo Veneri - EVALab 15
![Page 16: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/16.jpg)
Periphera Vision
The probability to reach the target when the fixation is far 4degree
[Findlay 2000]
![Page 17: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/17.jpg)
Results
Evaluating Human Visual Search Performance by Monte Carlo
methods and Heuristic model
![Page 18: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/18.jpg)
Peripheral Vision Inhibited
![Page 19: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/19.jpg)
Normal subjects
![Page 20: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/20.jpg)
![Page 21: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/21.jpg)
Visual System Optimization
![Page 22: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/22.jpg)
Conclusion
Evaluating Human Visual Search Performance by Monte Carlo
methods and Heuristic model
![Page 23: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/23.jpg)
Conclusion
12/04/23 Giacomo Veneri - EVALab 23
![Page 24: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/24.jpg)
The model is able to emulate human visuals search exploration.
Human optimizes the exploration in order to reduce eye movements and energy consumptions.
The model explains the exploration of subjects
![Page 25: Evaluating Human Visual Search Performance by Monte Carlo methods and Heuristic model](https://reader035.fdocuments.us/reader035/viewer/2022062704/556221c1d8b42ad44d8b4cd4/html5/thumbnails/25.jpg)
Evaluating Human Visual Search Performance by
Monte Carlomethods and Heuristic model
Giacomo Veneri, Elena Pretegiani, Pamela Federighi, Francesca Rosini, Antonio Federico & Alessandra Rufa
Thank youThank you