Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two...
Transcript of Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two...
![Page 1: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/1.jpg)
Hybrid Images
Aude Oliva & Antonio TorralbaMassachusetts Institute of Technology
Philippe G SchynsUniversity of Glasgow
![Page 2: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/2.jpg)
Hybrid ImagesHybrid Images
Angry man Neutral woman
![Page 3: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/3.jpg)
What you see…
Hybrid ImagesHybrid Images
It’s a woman!
I see anangry guy
From Far Away Up Close
![Page 4: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/4.jpg)
The quest forcreating images
with multiple meanings
![Page 5: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/5.jpg)
Multiple MeaningsOne global interpretationMultiple MeaningsOne global interpretation
Sivers, R. (1997). Photomosaics. Henry Holt and Company, Inc.
A sunflower Pieces of images
![Page 6: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/6.jpg)
Multiple MeaningsTwo global interpretationsMultiple MeaningsTwo global interpretations
Image Copyright Ian Butterworth (2002)
Two shoes or a butterfly
![Page 7: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/7.jpg)
Multiple MeaningsTwo global interpretationsMultiple MeaningsTwo global interpretations
Looking at the image one way, a skull appears, comprised of the woman's form and her reflection in a mirror (the outline of the skull itself).
"All Is Vanity", by C. Allan Gilbert 1873-1929.
Strong perceptof a skull
Strong perceptof a woman
![Page 8: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/8.jpg)
Subtle expressionLeonardo da Vinci’s Mona LisaSubtle expressionLeonardo da Vinci’s Mona Lisa
Livingstone, M. (2000). Science Setlur & Gooch (2004), NPAR
Smile Smile No smile
Spatial frequencyLow High
![Page 9: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/9.jpg)
Hybrid ImagesHybrid Images
![Page 10: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/10.jpg)
Hybrid ImagesHow do they work?
![Page 11: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/11.jpg)
Human Visual PerceptionHuman Visual Perception
Low spatial frequency
Medium spatial frequency
High spatial frequency
Spatial frequency channels
Blur image Sharp image
![Page 12: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/12.jpg)
Multiscale subbanddecompositionMultiscale subbanddecomposition
Spatial FrequencyLow High
8 11 17 25 38 57 85 128 c/i
Burt, D.C. & Adelson E. (1983) IEEE Trans. Com.
![Page 13: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/13.jpg)
Contrast Sensitivity FunctionContrast Sensitivity Function
Spatial FrequencyLow High
0.1 1 10010Spatial frequency (cycles/degree)
Con
trast
sen
sitiv
ity
Invisible
visible
Blackmore & Campbell (1969)
8 11 17 25 38 57 85 128 c/i
Low High
Low sensitivity
Low sensitivity
![Page 14: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/14.jpg)
Contrast Sensitivity FunctionContrast Sensitivity Function
Low High
0.1 1 10010Spatial frequency (cycles/degree)
Con
trast
sen
sitiv
ity
Invisible
visible
Blackmore & Campbell (1969)
Maximum sensitivity~ 6 cycles / degree of visual angle
Low High
![Page 15: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/15.jpg)
1 meter
20 cm10 deg.
8 11 17 25 38 57 85 128 c/i
Spatial Frequency
Peak sensitivity at 60 cycles/image
6 c/d * 10 deg/i
![Page 16: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/16.jpg)
6 meters
2 deg.
8 11 17 25 38 57 85 128 c/i
Spatial Frequency
20 cm
Peak sensitivity at 12 cycles/image 6 c/d * 2 deg/i
![Page 17: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/17.jpg)
Perception of hybrid imagesPerception of hybrid images
+
8 11 17 25 38 57 85 128 c/i
![Page 18: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/18.jpg)
Perception of hybrid imagesPerception of hybrid images
+
A man or a woman ?
Male dominance Female dominance
![Page 19: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/19.jpg)
1 meter
10 deg.
8 11 17 25 38 57 85 128 c/i
Spatial Frequency
20 cm
It’s a woman!
Peak sensitivity at 60 cycles/image
+
![Page 20: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/20.jpg)
6 meters
2 deg.
8 11 17 25 38 57 85 128 c/i
Spatial Frequency
20 cm+
Peak sensitivity at 12 cycles/image
I see anangry guy
![Page 21: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/21.jpg)
Perception of hybrid imagesPerception of hybrid images
0 50 1000
0.5
1
Cycles/image
Frequency domain
2- Frequency cut = 36 cycles/image
1- Frequency cut = 16 cycles/image
![Page 22: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/22.jpg)
Perception of hybrid imagesPerception of hybrid images
0 5 10 150
0.2
0.4
0.6
0.8
1
Distance (meters)Switch region
The distance of switch is a function of
• Image size
• Cut-off frequencies for the individual images
High SF dominate percept Low SF dominate percept
![Page 23: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/23.jpg)
Hybrid ImagesThe little details that matter
![Page 24: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/24.jpg)
Principles of PerceptionPrinciples of Perception
The challenge is to look good in close up
• Alignment• Perceptual Grouping• Color
![Page 25: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/25.jpg)
AlignmentAlignment
![Page 26: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/26.jpg)
AlignmentAlignment
Cheetah Tiger Aligned Tiger
![Page 27: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/27.jpg)
Not aligned Aligned
AlignmentAlignmentFar view
![Page 28: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/28.jpg)
Perceptual GroupingPerceptual Grouping
Shadows
![Page 29: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/29.jpg)
Reorganization of the shadows as a motorcycle
Perceptual GroupingPerceptual Grouping
![Page 30: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/30.jpg)
Color in high spatial frequencies
![Page 31: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/31.jpg)
A few examples of Applications
Especially, whenever you are “on the approach”
![Page 32: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/32.jpg)
Changing expressionChanging expression
Sad Surprised
![Page 33: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/33.jpg)
Texture superposition
![Page 34: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/34.jpg)
Texture superpositionTexture superposition
Original Cat mask Transparency Hybrid
![Page 35: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/35.jpg)
AdvertisingAdvertising
![Page 36: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/36.jpg)
Private fontPrivate font
Low spatial frequencies in anhybrid can be used to masktext that will be readable otherwise
![Page 37: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/37.jpg)
Private fontPrivate font
Low spatial frequencies in anhybrid can be used to masktext that will be readable otherwise
![Page 38: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/38.jpg)
Hybrid Images“A change on the approach”Hybrid Images“A change on the approach”
• Images that change interpretations as a function of viewing distance
• Hybrid images are based on the band-pass characteristics of human vision
![Page 39: Talk Hybrid Siggraph06olivalab.mit.edu/publications/Talk_Hybrid_Siggraph06.pdfMultiple Meanings Two global interpretations Looking at the image one way, a skull appears, comprised](https://reader034.fdocuments.us/reader034/viewer/2022050111/5f48c222b41df8300a72506b/html5/thumbnails/39.jpg)
AcknowledgmentsAcknowledgments
Acknowledgments
Edward Adelson, George Alvarez, Winston Chang, Michelle Greene, Rob Fergus, William Freeman, Barbara Hidalgo-Sotelo, Noah Jessop, Talia Konkle, Kimberley Reinhold
Contact
Aude Oliva ([email protected])Antonio Torralba ([email protected])