Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.
-
Upload
phyllis-baldwin -
Category
Documents
-
view
228 -
download
0
Transcript of Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.
![Page 1: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/1.jpg)
Image Processing Lecture 2
-Gaurav Gupta-Shobhit Niranjan
![Page 2: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/2.jpg)
Today
Image Formation (More Details) Camera Models Perspective Geometry Color Models
![Page 3: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/3.jpg)
Human Visual System (HVS): The Eye Image is formed on
retina Photoreceptors (rods
and cones) are stimulated and generate visual signal
Received and processed by brain (Cortex)
![Page 4: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/4.jpg)
Pin Hole Camera Model
Light enters through small hole. Image plane is placed between focal point
and object (to have “non-inverted” projection)
![Page 5: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/5.jpg)
Perspective Geometry
Mapping from R3->R2
Convention image coordinate (u,v), object coordinate (x,y,z)
u = (f/z)x ; v = (f/z)y
f = focal length (by geometry)
The linear version is ( S = scale factor)
![Page 6: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/6.jpg)
Contd..
Concept of Vanishing Line, Point and Horizon is important for Reconstruction from 2D image to 3D information
Vanishing point : The point where parallel lines at particular direction meet .
Two sets of parallel lines in different directions will give two vanishing points.
Two vanishing points form a vanishing line for the collection of parallel planes defined by these two sets of parallel lines.
![Page 7: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/7.jpg)
![Page 8: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/8.jpg)
![Page 9: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/9.jpg)
![Page 10: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/10.jpg)
The Horizon
Vanishing Line for ground plane Anything below it will be below horizon and
above it will be above horizon Different heights of viewer ?? What would be
affect on the horizon?
![Page 11: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/11.jpg)
Interpretation of Calibration matrix It gives you location of the vanishing point. The homogeneous coordinate (x,y,0) is the
ideal point or point at infinity in the direction of (x,y). (how??) (guess how to represent point at infinity in x direction), where will this appear in Image
![Page 12: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/12.jpg)
Camera Calibration
Why? To find how the object coordinated are projected in image plane
Parameters: Intrinsic & Extrinsic Model
![Page 13: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/13.jpg)
contd..
From the figure, hence, In other words, =>
In some cases focal lengths can be different in x and y direction fu , fv
f, uo,vo are intrinsic parameters
![Page 14: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/14.jpg)
Extrinsic Parameters
In general, the three dimensional world coordinates of a point will not be specfied in a frame whose origin is at the centre of projection
So we can transform by a linear transformation ( Rotation and Scale)
Where T is 4x4 transformation matrix, R pure rotation (rigid body), t is the rigid body translation
![Page 15: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/15.jpg)
Types of Image Transformation (or Deformation)
![Page 16: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/16.jpg)
Color Models
Three independent quantities are used to describe any particular color. (HVS)
Achromatic light has no color - its only attribute is quantity or intensity. Greylevel is a measure of intensity.
On the other hand, brightness or luminance is determined by the perception of the color
Color depends primarily on the reflectance properties of an object.
![Page 17: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/17.jpg)
![Page 18: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/18.jpg)
contd…
The tristimulus theory of color perception seems to imply that any color can be obtained from a mix of the three primaries, red, green and blue
Color models provide a standard way to specify a particular color and specifies a 3D coordinate system or subspace
Any color that can be specified using a model will correspond to a single point within the subspace it defines
![Page 19: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/19.jpg)
RGB Model
![Page 20: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/20.jpg)
CMY Model
RGB model asks what is added to black to get a particular color, the CMY (cyan-magenta-yellow) model asks what is subtracted from white.
Appropriate to absorption of colors, used in printing devices and filters
![Page 21: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/21.jpg)
HSI Model
The hue is determined by the dominant wavelength The saturation is determined by the excitation purity,
and depends on the amount of white light mixed with the hue
the intensity is determined by the actual amount of light
![Page 22: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/22.jpg)
![Page 23: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/23.jpg)
YIQ
YIQ (luminance-inphase-quadrature) is Recoding of RGB for color television
![Page 24: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/24.jpg)
Some points to think about..
what is the best way to apply the image processing techniques color images ?
Which color space to choose ? If we want to increase the contrast in a dark
image by histogram equalization, can we just equalize each color independently?
![Page 25: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/25.jpg)
Some quick facts
Normally Image is array of RGB values of pixels in BGR order
N-bit , m channel Image => It has m color spaces having N bit quantized data per color space per pixel (Ex. 8 bit RGB Image)
Very Simple data structure is Bitmap Format and Raw
JPEG widely used to store/capture images but it is compressed form
![Page 26: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/26.jpg)
Home Work
Install OpenCV (Intel Open Source Lib) http://sourceforge.net/projects/opencvlibrary Check its documentation and see how image
is described by IplImage data structurehttp://www.cs.bham.ac.uk/resources/courses/robotics/doc/opencvdocs/
Try to write and run sample programs given
in OpenCV tutorial and see for different images loss in JPEG format I will mail you.
![Page 27: Image Processing Lecture 2 - Gaurav Gupta - Shobhit Niranjan.](https://reader035.fdocuments.us/reader035/viewer/2022062217/56649e305503460f94b20931/html5/thumbnails/27.jpg)
ThE eNd