Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain...

40
1 1 Sketch-based Terrain Modeling Sang-Won Ghyme Next-generation Visual Research Division ETRI

Transcript of Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain...

Page 1: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

1 1

Sketch-based Terrain Modeling

Sang-Won Ghyme

Next-generation Visual Research Division

ETRI

Page 2: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

2 2

Outline

•Known Methods Landform Sketching Terrain Synthesis

•New Methods Landform Composition Land-Outline Sketching

•Special Research RBF-based Terrain Modeling

Page 3: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

3 3

Known methods

Landform Sketching

Terrain Synthesis A sketch line + patch comp.

A set of sketch lines Silhouette

Shadow

BoundaryDown

BoundaryUp

Page 4: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

4 4

Previous Works of Landform Sketching

Harold: A World Made of Drawings(2000) Only Silhouette line

A Sketching Interface for Terrain Modeling(2004)

Boundary lines and Noise

Page 5: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

5 5

Landform Sketching (1)

Terrain Sketching(2009) Silhouette Line Sketching First

Page 6: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

6 6

Landform Sketching (2)

Shadow Line Sketching First

Page 7: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

7 7

Landform Sketching (3)

Multi-resolution Deformation and

Noise Propagation

Low High

Page 8: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

8 8

Landform Sketching (4)

Results

Page 9: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

9 9

Landform Sketching (5)

Data Format #Header dHeightMap [sPathFile] [nRows] [nColumns]; the reference Height Map nLandforms [n] #Landform 0 nPoints [n]; number of points of all sketch lines except BP and EP vBP [fX] [fY] [fZ]; the begin point of all sketch lines vEP [fX] [fY] [fZ] ; the end point of all sketch lines avSI { [fX] [fY] [fZ], … }; the silhouette sketch line avSH { [fX] [fY] [fZ], … } ; the shadow sketch line avBD { [fX] [fY] [fZ], … } ; the boundary down sketch line avBU { [fX] [fY] [fZ], … } ; the boundary up sketch line aiParents [n] { [i] }; index list of parent landforms aiChildren [n] { [i] } ; index list of children landforms #Landform 1 …

Page 10: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

10 10

Landform Sketching (6)

Analysis

All points of sketch lines must be in between

begin and end point

It is very difficult to combine 3D landforms

for a complex terrain

Page 11: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

11 11

Terrain Synthesis (1)

Terrain Synthesis from DEM (2007)

Sketch Image Input DEM Image Input

Page 12: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

12 12

Terrain Synthesis (2)

Feature Line Extraction

Profile Recognition and Polygon-

Breaking Algorithm(PPA)

Page 13: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

13 13

Terrain Synthesis (3)

Feature-based Patch Extraction

Page 14: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

14 14

Terrain Synthesis (4)

Feature Patch Matching and Placement

Page 15: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

15 15

Terrain Synthesis (5)

Patch Merging

Overlapped Region Optimal Seam Finding Seam Removing

Page 16: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

16 16

Terrain Synthesis (6)

Result

Page 17: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

17 17

Terrain Synthesis (7)

Data Format: Feature Line #Header dHeightMap [sPathFile] [nRows] [nColumns]; the reference Height Map eType [ridge | valley | all]; a type of feature line nConnects [n] #Data { [iX] [iY] [iD], … } ; (iX, iY) is the center point ; (iD) is the direction of connection, has the value [0, 7]

0 1

2

3 4 5

6

7

(iX, iY) (D)

Page 18: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

18 18

Terrain Synthesis (8)

Data Format: Patch Set #Header nPatches [n] nPatchSize [n] #Patch 0 [nEPs] { [iX] [iY], …}; number of End-Points and list of End-Points { [iH], … }; Height Map of the Patch, Size [nPatchSize*2+1]^2 …

Page 19: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

19 19

Terrain Synthesis (9)

Analysis

Only 2D sketches are allowed

Can control only a shadow line

except Silhouette, Boundaries

Page 20: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

20 20

New methods

Landform Composition

Land-Outline Sketching

Chain of Land-Outlines

Landform + patch comp.

Page 21: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

21 21

Landform Composition (1)

Situation

• Landform has flat surface

• Noise delivers less reality

Goal • Terrain has more reality

Idea • Use DEM patches

Page 22: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

22 22

Landform Composition (2)

Process

Landform Generation

Set Region DEM Patch Composition

Load the reference DEM

Page 23: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

23 23

Landform Composition (4)

DEM Patch Composition

Without seam removing

With seam removing

Page 24: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

24 24

Landform Composition (5)

Result

Landform Generation

Load DEM

DEM Patch Composition

Page 25: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

25 25

Land-Outline Sketching (1)

Situation

• Landform is too simple to complex terrain

Goal • More useful method for complex terrain

Idea • Regard a terrain as a set of primitive shape

Page 26: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

26 26

Land-Outline Sketching (2)

Land-Primitive Structure Land-Primitive is a sort of Landform Unit

Page 27: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

27 27

Land-Outline Sketching (3)

Land-Outline Sketching Concept Land-Outline is converted into the chain of Land-Primitives

Shadow Line Sketching

Silhouette Line Sketching

Page 28: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

28 28

Land-Outline Sketching (4)

Process

Shadow Line Sketching

Silhouette Line Sketching Convert into Land-Primitives

Page 29: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

29 29

Land-Outline Sketching (5)

Shadow Line Editing

Page 30: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

30 30

Land-Outline Sketching (6)

Land-Primitive Editing One-by-One or Series

Page 31: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

31 31

Land-Outline Sketching (7)

Convert Features into Primitives

Load Feature Lines Conversion

Page 32: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

32 32

Land-Outline Sketching (8)

Land-Outline and Land-Primitive Editing

Page 33: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

33 33

Land-Outline Sketching (9)

Data Format #Header dHeightMap [sPathFile] [nRows] [nColumns]; the reference Height Map nPrimtives [n] #Primitive 0 [iX] [iY] [iZ]; position [iNext]; next pointer to form the chain [bData]; each bit determine whether next parameter is inherited from the previous [eType]; type of feature { Ridge | Valley } [fSize]; bottom radius [fTheta] [fPhi]; normal vector [fGain]; gain value to control the shape of form …

Page 34: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

34 34

RBF-based Terrain Modeling (1)

Someone said to me,

“Land-Primitive looks like a RBF”

what is RBF?

New research begins

Page 35: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

35 35

RBF-based Terrain Modeling (2)

Reconstruction and Representation of 3D Objects with RBFs (2001)

Using RBF-based Implicit Surfaces

convert point cloud into mesh

Page 36: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

36 36

RBF-based Terrain Modeling (3)

RBF node reduction

Original: 544,000 point cloud is

Represented by 80,000(14.7%) to a max error 0.0005

Page 37: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

37 37

RBF-based Terrain Modeling (3)

RBF-based Terrain Modeling

Map Size: 259 X 203, Nodes: 52577

Page 38: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

38 38

RBF-based Terrain Modeling (4)

Highlights • Terrain Data Compression (under experiments)

The performance is depended on the choice of RBF

• High-weighted RBF nodes are located on feature lines

Land-Outline represents the outline of terrain

Page 39: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

39 39

RBF-based Terrain Modeling (4)

Data Format

#Header of ArcInfo ASCII grid format ncols [n]; x size nrows [n]; y size xllcorner [f]; x coordinate of most left grid point yllcorner [f]; x coordinate of most bottom grid point cellsize [f]; distance between grid points NODATA_values [i]; flag value to point out no height #Extended Header afImprove [fC1] [fC2] [fC3]; low degree polynomial constants to improve accuracy nNodes [n]; number of RBF nodes #Data { [iX] [iY] [iH], … } ; ([iX], [iY]) is the coordinate of RBF nodes ; ([iH]) is the real height of RBF node ; Order of RBF nodes is important, high-weighted RBF node is placed in the head

Page 40: Sketch-based Terrain Modeling - SEDRIS - … 2 Outline •Known Methods Landform Sketching Terrain Synthesis •New Methods Landform Composition Land-Outline Sketching •Special Research

40 40

Conclusion

• Proposals 3D landform data format

Terrain feature line data format

Terrain patch composition data format

Land-Primitive data format

RBF-based terrain model data format