Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.
-
Upload
marshall-mcdonald -
Category
Documents
-
view
216 -
download
4
Transcript of Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.
![Page 1: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/1.jpg)
Announcements
Final Exam Friday, May 16th 8am
Review Session here, Thursday 11am.
![Page 2: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/2.jpg)
Lighting affects appearance
![Page 3: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/3.jpg)
![Page 4: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/4.jpg)
![Page 5: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/5.jpg)
Photometric Stereo: using this variability to reconstruct
Shape (normals only)Albedos
![Page 6: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/6.jpg)
Recognition: Accounting for this variability in matching
![Page 7: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/7.jpg)
Basics: How do we represent light? (1)
Ideal distant point source:
- No cast shadows
- Light distant
- Three parameters
- Example: lab with controlled
light
![Page 8: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/8.jpg)
Basics: How do we represent light? (2)
Environment map: l( - Light from all directions
- Diffuse or point sources
- Still distant
- Still no cast shadows.
- Example: outdoors (sky and sun)
Sky
![Page 9: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/9.jpg)
`
![Page 10: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/10.jpg)
Basics
How do objects reflect light?
Lambertian reflectance nl
lmax (cos, 0)
![Page 11: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/11.jpg)
Reflectance map
Reflected light is function of surface normal: i = f(Suitable for environment map.
Can be measured with calibration object.
![Page 12: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/12.jpg)
Photometric stereo
Given reflectance map:
i = f(each image constrains normal to one degree of freedom.
Given multiple images, solve at each point.
![Page 13: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/13.jpg)
Lambertian + Point Source
Surface normal
Light
l̂
normal surface isˆ
is
radiance is
)ˆ(,0max(
light ofintensity is
light ofdirection is
n
albedo
i
nli
l
llll
![Page 14: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/14.jpg)
Lambertian, point sources, no shadows. (Shashua, Moses)
Whiteboard
Solution linear
Linear ambiguity in recovering scaled normals
Lighting, reflectance map not known.
Recognition by linear combinations.
![Page 15: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/15.jpg)
Linear basis for lighting
Z YX
![Page 16: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/16.jpg)
Integrability
Means we can write height: z=f(x,y).
Whiteboard
Reduces ambiguity to bas-relief ambiguity.
Also useful in shape-from-shading and other photometric stereo.
![Page 17: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/17.jpg)
Bas-relief Ambiguity
![Page 18: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/18.jpg)
Shadows
Attached Shadow
Cast Shadow
![Page 19: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/19.jpg)
90.797.296.399.5#9
88.596.395.399.1#7
84.794.193.597.9#5
76.388.290.294.4#3
42.867.953.748.2#1
ParrotPhoneFaceBall
(Epstein, Hallinan and Yuille; see also Hallinan; Belhumeur and Kriegman)
5 2DDimension:
With Shadows: Empirical Study
![Page 20: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/20.jpg)
Attached Shadows
Lambertian
Environment mapn
l
lmax (cos, 0)
![Page 21: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/21.jpg)
Images
...
LightingReflectance
![Page 22: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/22.jpg)
0 1 2 30
0.5
1
0 1 2 30
0.5
1
1.5
2
r
Lighting to Reflectance: Intuition
![Page 23: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/23.jpg)
![Page 24: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/24.jpg)
(See D’Zmura, ‘91; Ramamoorthi and Hanrahan ‘00)
![Page 25: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/25.jpg)
Forming Harmonic Imagesnm nmb (p)=λr (X,Y,Z)
Z YX
2 2 22λ(Z -X -Y ) XZ YZ2 2λ(X -Y ) XY
![Page 26: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/26.jpg)
Models
Query
Find Pose
Compare
Vector: IMatrix: B
Harmonic Images
![Page 27: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/27.jpg)
Experiments 3-D Models of 42 faces
acquired with scanner.
30 query images for each of 10 faces (300 images).
Pose automatically computed using manually selected features (Blicher and Roy).
Best lighting found for each model; best fitting model wins.
![Page 28: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/28.jpg)
![Page 29: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/29.jpg)
Results
9D Linear Method: 90% correct.
9D Non-negative light: 88% correct.
Ongoing work: Most errors seem due to pose problems. With better poses, results seem near 97%.
![Page 30: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/30.jpg)
![Page 31: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/31.jpg)
![Page 32: Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.](https://reader035.fdocuments.us/reader035/viewer/2022070414/5697c0261a28abf838cd58fb/html5/thumbnails/32.jpg)
Summary
Linear solutions are good.For pose variation with points, each image is linear combination of 2 others.For Lambertian lighting no shadows, each image is linear combination of 3.With attached shadows, linear combination of 9.Only diffuse lighting affects images, unless there are shadows or specularities.