Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf ·...
Transcript of Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf ·...
![Page 1: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/1.jpg)
Understanding Regions and Region Segmentation
By
Nayan Khinvasara
![Page 2: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/2.jpg)
2
Overview
• Introduction to Regions
• Region Segmentation – Approaches
• Thresholding - Automatic
• Region Representation
• Data Structures
• Split and Merge
• Color Image Segmentation
• Morphological Watersheds
![Page 3: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/3.jpg)
3
What is a Region?
• Basic definition :- A group of connected pixels with similar properties.
• Important in interpreting an image because they may correspond to objects in a scene.
• For correct interpretation, image must be partitioned into regions that correspond to objects or parts of an object.
![Page 4: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/4.jpg)
4
Partitioning – How?
• Partitioning into regions done often by using gray values of the image pixels.
• Two general approaches :-
Region-based segmentation
Boundary estimation using edge detection
![Page 5: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/5.jpg)
5
Region-based Approach
• Pixels corresponding to an object grouped together and marked.
• Important principles:-
1. Value similarity
Gray value differences
Gray value variance
![Page 6: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/6.jpg)
6
Region-based Approach (continued)
2. Spatial Proximity Euclidean distance Compactness of a region
Assumption: Points on same object will projectto spatially close pixels on the image with similar gray values.
![Page 7: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/7.jpg)
7
Limitation
• The assumption does not hold true in all cases.
• To overcome this, group pixels using given principles and use domain-dependent knowledge.
• Match regions to object models.
![Page 8: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/8.jpg)
8
Edge Detection Approach
• Segmentation by finding pixels on a region boundary.
• Edges found by looking at neighboring pixels.
• Region boundary formed by measuring gray value differences between neighboring pixels
![Page 9: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/9.jpg)
9
Segmentation versus Edge Detection
• Closed boundaries
• Multi-spectral images improve segmentation
• Computation based on similarity
• Boundaries formed not necessarily closed
• No significant improvement for multi-spectral images
• Computation based on difference
![Page 10: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/10.jpg)
10
Region Segmentation
• Problem Statement:-
Given a set of image pixels and a homogeneity predicate P(.), find a partition of the image into a set of n regions Ri such that
n
i
TrueRi1=
=
![Page 11: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/11.jpg)
11
Region Segmentation – Problem Statement (Continued)
• P(Ri) = True , for all i
i.e any region satisfies the homogeneity predicate
• Any two adjacent regions cannot be merged into a single region
( ) FalseRjRiP =
![Page 12: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/12.jpg)
12
Original Image Region Segmented Image
![Page 13: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/13.jpg)
13
Thresholding – A Key Aspect
• Most algorithms involve establishing a threshold level of certain parameter.
• Correct thresholding leads to better segmentation.
• Using samples of image intensity available, appropriate threshold should be set automatically in a robust algorithm i.e. no hard-wiring of gray values
![Page 14: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/14.jpg)
14
Automatic Thresholding
• Use of one or more of the following:-
1. Intensity characteristics of objects
2. Sizes of objects
3. Fractions of image occupied by objects
4. Number of different types of objects
• Size and probability of occurrence – most popular
• Intensity distributions estimate by histogram computation.
![Page 15: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/15.jpg)
15
Automatic Thresholding Methods
• Some automatic thresholding schemes:
1. P-tile method
2. Mode method
3. Iterative threshold selection
4. Adaptive thresholding
5. Variable thresholding
6. Double thresholding
![Page 16: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/16.jpg)
16
Thresholding Methods
• P-tile Method:- If object occupies P% of image pixels the set a threshold T such that P% of pixels have intensity below T.
• Iterative Thresholding:-
Successively refines an approx. threshold to get a new value which partitions the image better.
( )212
1 µµ +=T
![Page 17: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/17.jpg)
17
Thresholding Methods (Continued)
• Adaptive Thresholding:- Used in scenes with uneven illumination where same threshold value not usable throughout complete image.
• In such case, look at small regions in the image and obtain thresholds for individual sub-images. Final segmentation is the union of the regions of sub-images.
• Variable Thresholding:- Approximates the intensity values by a simple function such as a plane or biquadratic. It is called background normalization.
![Page 18: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/18.jpg)
18
Even more thresholding methods
• Mode method:-
Assume that gray values are drawn from two normal distributions with parameters ( ) ( )2,2,1,1 σµσµ
If the standard deviations are zero, there will be two spikes in the histogram and the threshold can be placed anywhere between them.
For non-ideal cases, there will be peaks and valleys and the threshold can be placed corresponding to the valley.
![Page 19: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/19.jpg)
19
Histograms• They are applied globally to
the entire image. This can be a drawback in complex scenes.
• Very useful in initial segmentation on the basis of gray levels.
• Spatial information about intensity values is thrown away.
• Very different scenes may give a strikingly similar
histogram representation.
Histogram for both images
![Page 20: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/20.jpg)
20
Region Representation
• Different representations suitable to different applications.
• Three general classes:-
1. Array representation
- same size arrays, membership arrays
2. Hierarchical representation
- pyramid, quad tree
3. Symbolic representation
![Page 21: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/21.jpg)
21
Array representation
• Uses array of same size as original image with entries indicating the region to which a pixel belongs.
• Simplest example – binary image
Image Data
Array Region Representation
![Page 22: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/22.jpg)
22
Membership Arrays
• Membership arrays (images) commonly called masks. Each region has a mask that indicates which pixels belong to which region.
• Advantage – a pixel can be allowed to be a member of more than one region.
![Page 23: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/23.jpg)
23
• Preserves all details of regions required in most applications
• Very popular method with lots of hardware support available
• Symbolic information is not explicitly represented.
Characteristics of array representation method
![Page 24: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/24.jpg)
24
Hierarchical Representation
• Images represented at many resolutions• As resolution , array size and some data is
lost. More difficult to recover information.• But, memory and computation requirements are
also decreased.• Used to accommodate various segmentation
algorithms which operate at different resolutions.
![Page 25: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/25.jpg)
25
Pyramids
• An ‘n x n’ image represented by the image and ‘k’ reduced versions of the image.
• Pixel at level ‘l’ has combined information from several pixels at level ‘l+1’
• Top level – level 0 – single pixel
• Bottom level – original image
• Simplest method for resolution reduction is averaging .
![Page 26: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/26.jpg)
26
Pyramid Structure
![Page 27: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/27.jpg)
27
Quad Trees
• Extension of pyramids for binary images.
• Three types of nodes – white, black, gray. • White or black node – no splitting.
• Gray node – split into 4 sub-regions.
• Each node is either a leaf or has 4 children.
![Page 28: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/28.jpg)
28
Quad Tree ExampleBinary Image
NW
SW SE
NE
![Page 29: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/29.jpg)
29
Quad Tree ExampleNon-binary image
1122 3344
1122 3344
1122 3344
Not uniformNot uniform
uniformuniform
![Page 30: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/30.jpg)
30
Symbolic Representations
• Commonly used symbolic characteristics: 1. Enclosing rectangle 2. Centroid 3. Moments 4. Euler number
![Page 31: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/31.jpg)
31
Data Structures for Segmentation
• Data structures used for storing region information during operations like splitting and merging.
• Commonly used data structures:-
1. RAG – Region Adjacency Graph
2. Picture trees
3. Super grid
![Page 32: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/32.jpg)
32
RAG
• Nodes represent regions; arcs between nodes represent a common boundary between regions.
• Different properties of regions stored in node data structure.
• After initial segmentation, results stored in RAG and regions combined to obtain a better segmentation.
![Page 33: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/33.jpg)
33
RAG Example
![Page 34: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/34.jpg)
34
Picture Trees
• Emphasize inclusion of a region within another region.
• Recursive splitting of an image into component parts. Splitting stops with constant characteristic conditions.
• Quad tree is a special case.
![Page 35: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/35.jpg)
35
Super Grid
• Problem of boundaries becoming actual pixels of a region instead of being between pixels of two regions.
• For NxN image, super grid will be (2N+1) x (2N+1).
• Each pixel surrounded by 8 non-pixel points which are used to indicate boundary.
• Simplifies merge and split operations.
![Page 36: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/36.jpg)
36
Super grid Example
![Page 37: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/37.jpg)
37
Split and Merge
• Refining and reforming regions.
• Need : O/p of thresholding algorithm may contain many extra regions. Also, used after RAG representation.
• Eliminate false boundaries and spurious regions.
• Add missing boundaries
![Page 38: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/38.jpg)
38
Region Merging
• Combine regions considered similar based on a few region characteristics.
• Determining similarity between two regions is most important step.
• Approaches for judging similarity based on: Gray values Color Texture Size Shape Spatial proximity and connectedness
![Page 39: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/39.jpg)
39
Region Merging A Statistical Approach
• Assumption:- Regions have constant gray values corrupted by statistically independent, zero-mean Gaussian noise
Gray values are now taken from normal distributions.• Suppose two adjacent regions R1 and R2 contain points m1 and
m2 respectively. Possible hypotheses are:
H0 : Both regions belong to same object. Intensities are all drawn from a single Gaussian distribution with parameters
H1: Regions belong to different objects. Intensities are drawn from separate Gaussian distributions with parameters
• These parameters are generally not know, but estimated using the available samples.
( )0,0 σµ
( ) ( )2,2,1,1 σµσµ
![Page 40: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/40.jpg)
40
Statistical Approach (Continued)
• Assume a region contains n pixels having gray levels, gi, i =1,2,….n given by
• The Maximum Likelihood Estimation can be used to determine parameters like mean and variance.
•Under H0, the joint probability density can be found. Similarly, under H1, assuming normal distributions for regions R1 and R2, the joint probability density can be obtained.
( )2
2
2
2
1)( σ
µ
σπ
−−
=gi
egip
![Page 41: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/41.jpg)
41
Statistical Approach (Another slide!!)
• The likelihood ratio, L, is the defined as the ratio of the probability densities under the two hypotheses:
( ) 21
21
21
0
0|,....2,1
)1|,....2,1(mm
mm
Hggp
HggpL
σσσ +
==
• If L < threshold T, strong likelihood that there is only one region and the two regions may be merged.
•NOTE: Can also be applied for edge detection.
•Modifications: Possible to assume planar or quadratic intensity distributions instead of constant gray values.
![Page 42: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/42.jpg)
42
Removing Questionable Edges for Region Merging
• Merge regions if boundary is weak.
• Length of common boundary is considered.
• Weak boundary – intensities of either side differ by less than amount T
• Imp:- Consider relative lengths of the weak and complete boundaries between regions.
• Two main approaches:-
1. Merge adjacent regions R1 and R2 if
W = length of weak part of boundary
S = min(S1,S2) is minimum of two perimeters
= a threshold
• If is too small too many region merges
is big very conservative algorithm; valid candidates for merging might be ignored.
τ>S
W
![Page 43: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/43.jpg)
43
Removing edges (Continued) 2. Merge adjacent regions R1 and R2 if
where S = common boundary W = length of weak part of
boundary = threshold
τ>S
W
Approach 1
Approach 2
![Page 44: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/44.jpg)
44
Region Splitting
• Property of a region is not constant - SPLIT• Segmentation starts with large regions. Whole image can
be used to start with.• Important decisions before splitting:-
1. Is a property not constant over a region?
- Variance of intensity values
- Function fitting and error calculation
2. Where to split a region? (tough one!)
- Measures of edge strength within region
- Regular decomposition methods
![Page 45: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/45.jpg)
45
Split and Merge Application on same image
• Yes! Both can be used together• Segmentation using thresholding succession
of splits and merges to refine segmentation.• Useful in complex scenes.• Image partitioned into regions {Rk}, k=1,2,…..m
• Predicate H applied to the region. ex: variance of gray values as a predicate gives H(R) = 1, if variance is small = 0, otherwise
![Page 46: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/46.jpg)
46
Region Growing
• Groups pixels or sub-regions into larger regions based on pre-defined criteria.
• “Seed” points – append neighboring pixels.
• No a priori knowledge – compute properties at every pixel; centroids of clusters as seeds.
• Similarity criteria - application and type of image data available.
![Page 47: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/47.jpg)
47
Similarity Criteria for Region Growing
• Satellite imagery – color
• Monochrome images – Descriptors : Gray levels, moments, texture Connectivity or adjacency information
• Size and shape
![Page 48: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/48.jpg)
48
Trouble Spots
• Grouping without connectivity information.
• Stopping rule
![Page 49: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/49.jpg)
49
Example – Region Growing
• Fig. shows x-ray image of a weld with defects and a histogram of the image.
• Defects have max. value (255). All these point are used as seed regions.
• Clean multimodal histogram
![Page 50: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/50.jpg)
50
Example (continued)
• Criteria for region growing:
Absolute gray level difference less than 65.
Pixel 8-connected to at least one pixel in the region.
• Figs. show seed points and results of region growing
![Page 51: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/51.jpg)
51
Color Image Segmentation
• Unsupervised or Supervised• Supervised:- - Down-sampling Blurring by LPF color
quantization• Unsupervised:- - Palettized format Wavelet transform hue and
chroma operations recognize main colors match color palettes
![Page 52: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/52.jpg)
52
Segmentation by Morphological Watersheds
• Stable segmentation; continuous segmentation boundaries.
• Topographic - Visualizing in 3 dimensions: two spatial coordinates versus gray levels
![Page 53: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/53.jpg)
53
Watershed 101
• Three types of points:
1. regional minimum
2. drop of water fall to single minimum
3. drop of water fall to more than one minimum
• Catchment basin or watershed
• Divide lines or watershed lines
![Page 54: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/54.jpg)
54
Watersheds: Concept and Method
• Watershed lines hold the key.• Basic idea: Hole in regional minimums topography uniformly
flooded from below build dams to prevent merging dam boundaries correspond to divide lines.
• Process continued till max. level of flooding (corresponding to highest gray-level value) is reached.
• Watershed lines form connected path – continuous boundaries.
• Often applied to gradient of image rather than image.
![Page 55: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/55.jpg)
55
Example of Watershed Segmentation
Initial Image Topographic Surface
Final watersheds
![Page 56: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/56.jpg)
56
Drawbacks
• Concept difficult to understand!!
• Over-segmentation in gradient method.
• Modification:
Markers
Internal – associated with objects of interest
External – associated with background
![Page 57: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/57.jpg)
57
Summary
• Segmentation – essential preliminary step in most scene analysis and automatic pictorial pattern recognition problems.
• Choice of technique depends on peculiar characteristics of individual problems.
![Page 58: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/58.jpg)
58
Further Reading
• Watershed method using markers
• Hierarchical segmentation using watersheds
• Use of motion in segmentation
![Page 59: Understanding Regions and Region Segmentationlecturer.ukdw.ac.id/~mahas/dossier/comvis_07a.pdf · 2012. 4. 18. · Symbolic representation . 21 Array representation • Uses array](https://reader036.fdocuments.us/reader036/viewer/2022062604/5fc176914f7c914305378bf7/html5/thumbnails/59.jpg)
59
References
• Jain R., Rangachar K., Schunk B. “Machine Vision” McGraw-Hill 1995
• Gonzalez R., Woods R. “Digital Image Processing” 2nd Ed. Pearson Education
• http://cmm.ensmp.fr/~beucher/wtshed.html