Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have...
Transcript of Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have...
![Page 1: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/1.jpg)
Constancy factors in visual perception
Raffaella FolgieriDICo – Digital Information & Communication Departiment
Gjovik, Norway
![Page 2: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/2.jpg)
Why interest in visual perception?
• to investigate main factors in VR• to understand boundaries between
perception and cognitive processes• to find instruments and methods to
analyse human reaction to VR stimuli• to understand emotional and cognitive
involvement
![Page 3: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/3.jpg)
MOTIVATION
DICo
Aims: investigate emotions in VR
What are potentially influencing factors?
• Investigating emotions in VR
Virthualis project
Operators virtually immersed in production plant and in control room felt emotionally provenas immersed in real physical situation
AIMS: reduce hazards in production plants and storage sites by addressing end-users’ practical safety issues through merging Human Factors (HF) knowledge and Virtual Reality(VR) technologies
![Page 4: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/4.jpg)
VR AS A COMMUNICATION PROCESS
A coding whose purpose is to bring the observer to the conclusion that the VR set is verisimile, i.e. “similar-to-the-real-thing” (or involves similar sensation?)
DICo
• between human beings• mediated by computer systems
– interaction, visualization and other sensory stimuli to convey information
• Reality – is not a intrinsic characteristic of VR– is the result of a conventional way of coding
information.
![Page 5: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/5.jpg)
VISUAL PERCEPTION RELEVANCE
DICo
• Vision is the main sensorial system• We need to focus on visual perception key factors
– Colors
– Immersivity:
• is the emotional stimulus key factor
• needs all the visual field
– Observer needs to explore actively all the visual fiels moving head and eyes
• The space and the depth perceptions become foundamental
![Page 6: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/6.jpg)
DICo
Eat me, Drink me…What are key factors in spatial perception?
![Page 7: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/7.jpg)
SPACE, SIZE AND SHAPE
DICo
• Spatial perception depends on multiple aspects• We focus on three:
•Relative distances•Size•Shape
• We experiment some constancy effects, what are their origin? Perceptual? Cognitive?
![Page 8: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/8.jpg)
SPATIAL CONSTANCY
DICo
Perception viewpoint:• understand relative
distances and dimensions
• Interaction: foundamental role
![Page 9: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/9.jpg)
SHAPE CONSTANCY (1)
DICo
Cognitive viewpoint:
• mental rotation or translation
![Page 10: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/10.jpg)
SHAPE CONSTANCY (2)
DICo
• In shape constancy effect we have a major role
of high level brain activity: mental rotations!• We assume that this activity can be detected in
different brain areas, producing strong signals,
to be identified and classified
![Page 11: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/11.jpg)
11
EXPERIMENTS AND OBSERVATIONS
• To detect above activity we need to devise specific experiments
• To observe brain activity we could use:
– fMRI– Experiments on primate
• Both are invasive/difficult to use in VR environment
![Page 12: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/12.jpg)
12
INVESTIGATION OBJECTIVES
In a VR context:• fMRI not enough• Need: uninvasive and portable instrument to
investigate brain activity– to identify brain areas activated in space and depth
perception processes– to correlate brain areas to active interactive exploration
of spaces
• This will allows us to– understand if in VR similarity to phisical reality is
necessary– find boundaries between perception and cognitive
processes
![Page 13: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/13.jpg)
EEG in VR: WHAT AND HOW
DICo
• Experiments setup• VR similar to physical reality
• Reproducing stimuli through VR far from reality
![Page 14: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/14.jpg)
MODELS AND METHODS
DICo
• Computational models to analyse data from
brain-motion and emotion sensors:
– Brain activity, cardio frequency, sweat, eye,
arms and legs activities
• Data-fusion problem:
– Machine learning methods
![Page 15: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/15.jpg)
MACHINE LEARNING
DICo
Area of Artificial Intelligence concerned with the development of techniques which allow computers to "learn".
Machine Learning:design and development of algorithms that allow computers to evolve behaviors based on empirical data (sensor data or databases).
We want VR reacting to human perception!
![Page 16: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/16.jpg)
EXPECTED RESULTS
DICo
Indications on brain areas involved in
• VR perception:
• relative distances and dimensions
• interaction
• Cognitive viewpoint:
• objects (mental) recognition
![Page 17: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/17.jpg)
FINAL OBJECTIVE
DICo
Experiments with EEG foundamental for the
realization of algorithms allowing VR to
adapt to human and vice-versa
![Page 18: Constancy factors in visual perceptionSHAPE CONSTANCY (2) DICo • In shape constancy effect we have a major role of high level brain activity: mental rotations! • We assume that](https://reader033.fdocuments.us/reader033/viewer/2022050603/5faad5a9b4d376080e4c91fa/html5/thumbnails/18.jpg)
DICo
Thank you!