Multimedia Systems -...
Transcript of Multimedia Systems -...
Multimedia Systems
Image I
(Acquisition and Representation)
Mahdi Amiri
April 2012
Sharif University of Technology
Course Presentation
Page 1 Multimedia Systems, Mahdi Amiri, Image I
Image Representation Color Depth
1bit
2bit
4bit
8bit
24bit
The number of bits used
to represent the color of
a single pixel.
bits per pixel (bpp).
1bit: Monochrome
24bit: Truecolor
Page 2
Image Representation Indexed Color, Palette
It is a form of vector quantization compression.
A 2-bit indexed
color image
Color table
(the palette)
8-bit (256-color)
Indexed image and
its own palette
8-bit Grayscale
image and palette
Multimedia Systems, Mahdi Amiri, Image I
Page 3
Image Representation, Palette Disadvantages
Limited set of simultaneous colors per image.
If the original color palette for a given indexed image is
lost, it can be nearly impossible to restore it.
4-bit 8-bit 24-bit Incorrect
palette
Multimedia Systems, Mahdi Amiri, Image I
Page 4
Image Representation Halftone
A technique that simulates continuous tone imagery through the use
of dots, varying either in size, in shape or in spacing.
How the human eye
would see this sort of
arrangement from a
sufficient distance.
Halftone
dots
Three examples of color halftoning with CMYK separations. From left to
right: The cyan separation, the magenta separation, the yellow separation, the
black separation, the combined halftone pattern and finally how the human eye
would observe the combined halftone pattern from a sufficient distance.
Colo
r Halfto
nin
g
Multimedia Systems, Mahdi Amiri, Image I
Page 5
Image Representation, Dithering Definition
An intentionally applied form of noise used to randomize
quantization error.
Etymology: …Mechanical computers performed more accurately
when flying on board the aircraft, and less well on ground!
Application: Increasing color depth without adding new bits
1-bit
black and white thresholding
24-bit 1-bit,
with Floyd-Steinberg dithering
Multimedia Systems, Mahdi Amiri, Image I
Page 6
Image Representation, Dithering Floyd–Steinberg Algorithm
Distribute the quantization residual to neighboring
pixels that have not yet been processed.
Pseudocode:
for each y from top to bottom
for each x from left to right
oldpixel := pixel[x][y]
newpixel := find_closest_palette_color(oldpixel)
pixel[x][y] := newpixel
quant_error := oldpixel – newpixel
pixel[x+1][y] := pixel[x+1][y] + 7/16 * quant_error
pixel[x-1][y+1] := pixel[x-1][y+1] + 3/16 * quant_error
pixel[x][y+1] := pixel[x][y+1] + 5/16 * quant_error
pixel[x+1][y+1] := pixel[x+1][y+1] + 1/16 * quant_error
Distribution matrix
Multimedia Systems, Mahdi Amiri, Image I
Page 7
Image Representation, Dithering Color Banding Artifact
Dithering prevents large-scale patterns such as "banding" in images.
Web-safe color palette
with no dithering
Web-safe color palette
with Floyd–Steinberg
dithering
Multimedia Systems, Mahdi Amiri, Image I
Page 8
Image Resolution Image Resolution
Image Resolution, Most Common Display Resolutions
Asp
ect Ratio
Multimedia Systems, Mahdi Amiri, Image I
New iPad: 2048× 1536 (QXGA)
Page 9
Image Resolution Megapixel (MP)
One million pixels
To express:
The number of pixels in an image
The number of image sensor elements of digital cameras
The number of display elements of digital displays
2048×1536 sensor elements, or QXGA display
3.1 MP (2048 × 1536 = 3,145,728)
8 MP Phone
Camera
160 MP
Camera
Multimedia Systems, Mahdi Amiri, Image I
Page 10
Image Resolution Pixels per inch (ppi)
Pixels per inch (PPI) or pixel density is a measurement of the
resolution of devices in various contexts; typically computer displays,
image scanners, and digital camera image sensors.
18 ppi
Multimedia Systems, Mahdi Amiri, Image I
72 ppi 150 ppi
Page 11
Image Resolution Pixels per inch (ppi)
The average human eye can only detect 300 ppi.
iPhone 4, 4s
3.5"
640x960
326 ppi
Multimedia Systems, Mahdi Amiri, Image I
iPad, iPad2
9.7"
1024x768
132 ppi
List of displays by pixel density
http://en.wikipedia.org/wiki/List_of_displays_by_pixel_density
Nokia N95
2.6"
240x320
153 ppi
Google Nexus One
3.7"
480x800
254 ppi
New iPad
9.7"
2048x1536
264 ppi
Nokia Lumia 800
3.7"
800x480
252 ppi
Samsung I9100 Galaxy S II
4.27"
480x800
219 ppi
Page 12
Image Vision Histogram
Multimedia Systems, Mahdi Amiri, Image I
Plots the number of pixels for each tonal value. By looking at the histogram for a specific
image a viewer will be able to judge the entire tonal distribution at a glance.
Intensity (tonal value)
Count (Number of
pixels for each
different intensity
value)
Image
histogram
Page 13
Image Vision Contrast
Multimedia Systems, Mahdi Amiri, Image I
Typ. histogram of
a low contrast image
Typ. histogram of
a high contrast image
Contrast is the difference in visual properties that
makes an object distinguishable from other objects
and the background.
Formula
Page 14
Image Vision Histogram Equalization
Multimedia Systems, Mahdi Amiri, Image I
Histogram equalization is a method in image processing of
contrast adjustment using the image's histogram.
Page 16
Image File Formats Raster and Vector Graphics
Raster Graphics (Bitmap)
.BMP, .JPG, .PNG, .GIF
Vector Graphics
.CGM, .SVG Both
.AI, .CDR, .PSD, .TIFF
Multimedia Systems, Mahdi Amiri, Image I
Page 17
Image Representation Panorama
Stitching images captured
above Milad Tower
Example Software:
“Hugin” and “AutoStitch”
Multimedia Systems, Mahdi Amiri, Image I
Page 18
Image Representation AutoStitch Process
Example algorithm: SIFT Keypoint detection and matching
Multimedia Systems, Mahdi Amiri, Image I
Page 20
Image Acquisition High-Dynamic-Range (HDR)
HDR, Accurately
representing the range
of intensity levels
found in real scenes
4 Images captured with
different Exposure
Values (EV or stop)
Multimedia Systems, Mahdi Amiri, Image I
Page 21
Image Acquisition HDR Movie Demo
Play HDR movie demo
Multimedia Systems, Mahdi Amiri, Image I
Page 22
Image Acquisition, HDR Algorithm: Tone Mapping
To overcome the limited dynamic
range of current standard digital
imaging techniques
Tone mapped HDR image
A simple version of tone mapping:
Mean Value Mapping
This is
Exposure Bracketing
Multimedia Systems, Mahdi Amiri, Image I
Page 23
Image Acquisition Focus Bracketing
Focus stacked image
A sequence of 5 incrementally focused images
Example Software:
“CombineZP”
Multimedia Systems, Mahdi Amiri, Image I
Bracketing is the general technique of taking several shots of the same subject using different camera settings.
Page 24
Image Acquisition Focus Bracketing
The resulting focus stacked image with an
extended depth of field
The three source image
slices at three focal depths
Contributions in the final
"focus stacked" image
Example Application:
Microscopy
Multimedia Systems, Mahdi Amiri, Image I