Quaternion Colour Texture By Lilong Shi and Brian Funt Presented by: Lilong Shi.
Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.
-
Upload
caroline-houston -
Category
Documents
-
view
223 -
download
0
Transcript of Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.
![Page 1: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/1.jpg)
Simon Fraser UniversityComputational Vision Lab
Lilong Shi, Brian Funt and Tim Lee
![Page 2: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/2.jpg)
Studies of factors affecting skin colour
Simple and linear model of skin
Modelling Skin appearance under lights
Applications: Estimate melanin and hemoglobin
concentrations Correct imaged skin tones for lighting
conditions
![Page 3: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/3.jpg)
Tone correctio
n
Preserve melanin
Skin tone correction
Melanin/Hemoglobin separation
![Page 4: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/4.jpg)
Appearance of human skin determined by Biological factors
▪ pigmentation, blood microcirculation, roughness, etc..
Viewing conditions▪ Inducing lights
Acquisition devices▪ Cones in retina, RGB sensors of CCD digital cameras
![Page 5: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/5.jpg)
Two-layered Skin Model [2] Epidermis Layer: melanin absorbance Dermis Layer: hemoglobin absorbance
A layer has properties of an optical filter
![Page 6: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/6.jpg)
Various skin colour <= melanin +
hemoglobin Genetic: Race Temporary:
▪ Exposure to UV ▪ Hot bath
Mixture varying by 2 independent factors Analyse melanin and hemoglobin factors
![Page 7: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/7.jpg)
Estimate melanin and hemoglobin
concentration
Independent Component Analysis (ICA)– Statistical technique for revealing “hidden”
factors– To “unmix” or “separate” signals composed of
multiple sources– Independent and linear mixing– Related to Eigen-vector analysis
![Page 8: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/8.jpg)
Original Source Signals Observed SignalsMixing
s1
s2
70%
30%
v1
s × A = v
20%
80%
v20%
100%
v3
![Page 9: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/9.jpg)
Melanin
Hemoglobin
Skin samples
Melanin
Hemoglobin
![Page 10: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/10.jpg)
Typical skin spectrum Visible wavelength 400nm – 700nm
Extract skin bases from observed spectrum by ICA
ICA
(left) 33 skin spectrum after normalization; (right) two independent basis spectrum – the melanin and hemoglobin, and the spectrum of chromophores other than melanin and hemoglobin pigments.
![Page 11: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/11.jpg)
Arbitrary skin spectrum can be approximated cσσ hhmm
constru
are variableshm ,
![Page 12: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/12.jpg)
Human vision▪ 3 types of
Photoreceptors L, M and S Cones
Digital Cameras▪ 3 sensors
Red, Green, and Blue
Reflectance spectrum recorded by 3 sensors => three values (R, G, B) for a skin colour
![Page 13: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/13.jpg)
cσσpixel hhmm
Possible skin colours lie within plane
Given a pixel from
skin, compute
by projecting
log(R,G,B) onto
hm ,
hm σσ ,
![Page 14: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/14.jpg)
Input Image [3]
Melanin Image
Hemoglobin Image
m
h
cσσ hhmm
![Page 15: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/15.jpg)
- Inverse melanin concentration- Inverse hemoglobin concentration
![Page 16: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/16.jpg)
Skin appearance greatly affected by lights
Reveal true skin colour by removing illum.
Common lights blackbody radiation e.g. tungsten/halogen lamps, sunrise/sunset, etc Varying colour temperature T
▪ Redish -> white -> bluish
![Page 17: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/17.jpg)
Colour: illumination times reflectance
In log space, multiplication => addition:
cωσσΠ τhhmmhm ),,(
Illum. basis
![Page 18: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/18.jpg)
In practice
Drop hemoglobin basis ▪ Small angle between Illum and hemoglobin axes
Ignore brightness Skin colour varying by T and
( , )m m m τ Π σ ω
m
![Page 19: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/19.jpg)
384 real skin reflectances times 67 real light sources
=> 25728 samples
( , )m m m τ Π σ ω
![Page 20: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/20.jpg)
Skin tone correction example (UOPB DB [4])
20
Tone correction
Preserve melanin
16 different illumination +
camera settings
![Page 21: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/21.jpg)
• Skin tone correction example (UOPB DB [4])
![Page 22: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/22.jpg)
Skin colour modelling: Melanin and Hemoglobin concentration Linear model in logarithm space Estimation by Independent Component
Analysis Skin appearance + Light modelling:
Estimates light source Preserves skin colour by melanin value
Applied to digital images from CCD cameras
![Page 23: Simon Fraser University Computational Vision Lab Lilong Shi, Brian Funt and Tim Lee.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649ceb5503460f949b5f3b/html5/thumbnails/23.jpg)
[1] Shi, L., and Funt, B., "Skin Colour Imaging That Is Insensitive to Lighting," Proc. AIC (Association Internationale de la Couleur) Conference on Colour Effects & Affects, Stockholm, June 2008
[2] Angelopoulou, E., Molana, R., and Daniilidis, K. “Multispectral skin color modeling,” In IEEE Conf. on Computer Vision and Pattern Recognition, volume 2, pages 635-642, Kauai, Hawaii, Dec. 2001.
[3] Shimizu, H., Uetsuki, K., Tsumura, N., and Miyake, Y. Analyzing the effect of cosmetic essence by independent component analysis for skin color images. In 3rd Int. Conf. on Multispectral Color Science, pages 65-68, Joensuu, Finland, June 2001.
[4] Martinkauppi, B. “Face color under varying illumination-analysis and applications,” Ph.D. Dissertation, University of Oulu, 2002.