Outline

30
A graph, non-tree representation of the topology of a gray scale image Peter Saveliev Marshall University, USA

description

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev Marshall University , USA. Outline. A new (directed) graph representation of the topology of a gray scale image is presented. - PowerPoint PPT Presentation

Transcript of Outline

Page 1: Outline

A graph, non-tree representation of the topology of a gray scale image  Peter SavelievMarshall University, USA

Page 2: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

2

OutlineA new (directed) graph representation of the

topology of a gray scale image is presented. This graph combines the inclusion trees of

the lower and upper level sets of the gray level function.

These sets are captures by cycles: simple closed curves.

Algorithm is based on cell decomposition: the image is represented as a combination of pixels as well as edges and vertices;

A graph representation of the topology of a color image is presented.

Page 3: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

3

Topology of binary images via cycles

Cycles capture components and holes.

Page 4: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

4

Topology of gray scale images

Cycles capture components and holes of the lower level sets

Page 5: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

5

Topology of gray scale images

Page 6: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

6

Gray scale function

The connected components of upper and lower level sets are building blocks of segmentation.

Peter
fffdfdgdfg
Page 7: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

7

Inclusion treeThe connected components

of the lower level sets form a tree structure based on inclusion.

Page 8: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

8

Lower level set inclusion tree

Page 9: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

9

Lower and upper level inclusion trees

.

Page 10: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

10

Inclusion treesTo represent the topology of the image

we need both inclusion trees, combined in some way.

Page 11: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

11

Combined inclusion treeBased on inclusion of the contours.

+ = + =

The lower level sets are mixed with the upper level sets.

The gray levels are also mixed.

Page 12: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

12

The topology graph of the image

+ = + =

Page 13: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

13

Topology graph

The lower and upper inclusion trees remain intact within the graph.

The graph breaks into layers that coincide with the topology graphs of the corresponding binary images.

Page 14: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

14

Topology graph

The nodes of the topology graph are the objects and holes in the thresholded image and there is an arrow from node A to node B if:

object B has hole A, provided A and B correspond to consecutive gray levels.

object B has hole A, provided A and B correspond to the same gray level.

And vice versa.

Page 15: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

15

Cell decomposition A binary image is a rectangle

covered by black and white pixels arranged in a grid.

A pixel is a square: [n, n + 1] × [m, m + 1].

Page 16: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

16

Cell decomposition

a vertex {n}×{m} is a 0-cell,an edge {n}×(m, m + 1) is a 1-cell, anda face (n, n + 1)×(m, m + 1) is a 2-cell.

Page 17: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

17

Cell decomposition

Two adjacent edges are 1-cells and they share a vertex, a 0-cell;

Two adjacent faces are 2-cells and they share an edge, a 1-cell.

Page 18: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

18

Cycles in image segmentation

Both connected components and holes are captured by cycles:

a 0-cycle as a sequence of vertices that follows the outer boundary of an object;

a 1-cycle as a sequence of edges that follows the outer boundary of a hole.

Page 19: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

19

Image segmentation via cycles

Page 20: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

20

Outline of the algorithmAll pixels in the image are ordered according to the

gray level. Following this order, each pixel is processed:

A. add its vertices, unless those are already present as parts of other pixels;

B. add its edges, unless those are already present as parts of other pixels;

C. add the face of the pixel.At every step, the graph is given a new node and

arrows to represent the merging and the splitting of the cycles:D. adding a new vertex creates a new component;E. adding a new edge may connect two components, or

create, or split a hole;F. adding the face eliminates the hole.

Page 21: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

21

Adding an edge

Page 22: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

22

Stages of analysis

Page 23: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

23

PerformanceN is the number of pixels in the

image. The memory is O(N). The complexity is O(N2).

Page 24: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

24

Pixcavator

See demo session

Page 25: Outline

A graph, non-tree representation of the topology of a gray scale image Peter Saveliev

25

Analysis of color images

If only one of the three primary color is changing, the topology is the same as of a gray scale image

Page 26: Outline

Thresholding - RGB

26

A graph, non-tree representation of the topology of a gray scale

image Peter Saveliev

Page 27: Outline

27

A graph, non-tree representation of the topology of a gray scale

image Peter Saveliev

Color imagesThe RGB color space: S={ (r, g, b) : 0 ≤ r, g, b ≤ 255}Partial order on S: (r, g, b) ≤ (r’,

g’, b’) ifr ≤ r’, g ≤ g’, b ≤ b’.

Page 28: Outline

28

Outline of the algorithmAll pixels in the image are ordered according to

partial order of the RGB space. Following this order, each pixel is processed:

◦ add its vertices, unless those are already present as parts of other pixels;

◦ add its edges, unless those are already present as parts of other pixels;

◦ add the face of the pixel.At every step, the graph is given a new node and

arrows that connect the nodes in order to represent the merging and the splitting of the cycles:◦ adding a new vertex creates a new component;◦ adding a new edge may connect two components, or

create, or split a hole;◦ adding the face to the hole eliminates the hole.

A graph, non-tree representation of the topology of a gray scale image

Peter Saveliev

Page 29: Outline

29

Topology graph of a color image

The nodes of the topology graph are the objects and holes in the thresholded image and there is an arrow from node A to node B if:

object B has hole A, provided A and B correspond to consecutive colors.

object B has hole A, provided A and B correspond to the same color.

And vice versa. A graph, non-tree representation of the topology of a gray scale image

Peter Saveliev

Page 30: Outline

31

Thank you

A graph, non-tree representation of the topology of a gray scale image

Peter Saveliev