Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe...

31
Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1 , Shigeru Owada 1,2 , Takeo Igarashi 1,3 The University of Tokyo 1 , Sony CSL 2, JST PRESTO 3

Transcript of Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe...

Page 1: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing

Makoto Okabe1, Shigeru Owada1,2 , Takeo Igarashi1,3

The University of Tokyo1, Sony CSL2,

JST PRESTO3

Page 2: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Introduction– Motivation– Previous Work– Our method

• User Interface

• Details

• Result

• Discussion

Page 3: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Motivation

• 3D trees are important in– Cityscape design– Virtual reality– Consumer games

• 3D tree modeling is difficult– Enormous structural complexity

Page 4: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Previous Work

• Rule-based approaches– L-systems– Xfrog– SpeedTree

Difficult for novices

• 3D tree libraries– Maya - Paint Effects

Difficult to design an arbitrary tree

Page 5: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

2D sketch 3D model

Sparse Dense

• For quick and easy design of trees, we propose– Sketch-based modeling

Our method

– Example-based modeling

Page 6: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Introduction

• User Interface– Modeling Process– Demonstration

• Details

• Result

• Discussion

Page 7: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Modeling Process

(a) 2D Sketch (b) 3D Construction (c) Multiplication

(e) Propagation(d) Leaf-arrangement

Page 8: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Demonstration

Page 9: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Introduction• User Interface• Details

– Creating a 3D Tree from a 2D Sketch– Extension of the Basic Algorithm– Creating a Branch with Spiral Structure– Example-based Leaf Arrangements

• Result• Discussion

Page 10: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Creating a 3D Tree from a 2D Sketch

• Decide depths of branches• Keep the appearance from the view point• Resulting shape has infinite possibility

Page 11: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Creating a 3D Tree from a 2D Sketch

• Observation of natural trees– A natural tree spreads their branches to absorb sun

light as efficiently as possible

– The distances between a branch and other branches tend to be as large as possible

Page 12: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Creating a 3D Tree from a 2D Sketch

• Decide depths of branches one by one• Compute distances between branch shadows• Maximize distances among branches

Page 13: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Other constraints– A 3D hull obtained from the 2D convex hull

• Keep the overall shape of a tree

– Length of a branch– Angle between two branches

Creating a 3D Tree from a 2D Sketch

2D Convex Hull 3D Hull

Page 14: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Extension of the Basic Algorithm

• Problem of the described algorithm– Front view is kept– Side view is strange

side view

front view

People omit branches spreading backward or forward

Page 15: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Extension of the Basic Algorithm

• simple ad hoc trick

basic algorithm

rotated version(by 90 degrees)

mergingmerging

90 degrees

Page 16: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Extension of the Basic Algorithm

• The resulting 3D tree– Front and side views look similar

front view

side view

Page 17: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Creating a Branch with Spiral Structure

• Decide depth values so that the branch stroke has a constant 3D curvature

– [Floral diagrams and inflorescences, Ijiri et al, SIGGRAPH 2005]

(a) (b) (c)

Calculate yi so that

Page 18: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Resulting 3D Trees

• 2D sketch resulting 3D tree models

Page 19: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Three types of leaf arrangements

AlternatingGeminatus Whorled

Example-based Leaf Arrangements

Page 20: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Geminatus

Whorled

Alternating

Example-based Leaf Arrangements

Page 21: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Introduction

• User Interface

• Details

• Result– Designed by Experts– Designed by Test Users – Comparison to Other Systems

• Discussion

Page 22: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Designed by Experts

(a) young tree (b) zelkova (c) maidenhair

7,900 nodes 30,000 nodes 4,300 nodes

Page 23: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Designed by Test Users

(d) 9 min (e) 6 min (f) 6 min

(a) 6 min (b) 8 min (c) 7 min

Page 24: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• L-system, Xfrog and our system

• Recruited 3 novice users(A, B, C)– L-system (A and B together)– Xfrog (C)– Our system (A, B, C individually)

• Photograph of a target tree

Comparison to Other Systems

Page 25: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Comparison to Other Systems

Photograph L-system ( 60 min ) XFrog ( 30 min )

Page 26: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Photograph Our method (10 min) Our method (10 min)

Comparison to Other Systems

Page 27: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Our system– The major branching structures by sketching

• The other systems– Detailed structures produced by rules

Comparison to Other Systems

Page 28: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

• Introduction

• User Interface

• Details

• Result

• Discussion– Summary– Limitations and Future Work

Page 29: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Summary

• We proposed a system for quick and easy design of 3D trees– Creating a 3D Tree from a 2D Sketch– Example-based modeling

• The user can design a tree intuitively, especially major branching structures– User Tests– cf) Rule-based systems

Page 30: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Limitations and Future Work

• Incorporating more natural phenomena– e.g.) Tropisms from user-defined branches

• Construction of forest

• Editing operations

– move, rotate, or bend

Page 31: Interactive Design of Botanical Trees using Freehand Sketches and Example-based Editing Makoto Okabe 1, Shigeru Owada 1,2, Takeo Igarashi 1,3 The University.

Thanks

• contact information– Makoto Okabe ([email protected])

• www for this project– http://www-ui.is.s.u-tokyo.ac.jp/~makoto21

• Thanks very much– This work was funded in part by the Japanese

Information-Technology Promotion Agency (IPA)– Eurographics reviewers