Optimal Design : Surrogate Models

12
Optimal Design : Surrogate Models Kuei-Yuan Chan National Taiwan University 1

Transcript of Optimal Design : Surrogate Models

Page 1: Optimal Design : Surrogate Models

Optimal Design : Surrogate Models

Kuei-Yuan ChanNational Taiwan University

1

Page 2: Optimal Design : Surrogate Models

A good model should represent reality in the simplest meaningful manner.

A surrogate model is a simpler analysis model extracted from the more sophisticated ones using a variety of data-handling techniques.

2

Page 3: Optimal Design : Surrogate Models

Model forms

• Analytical models in mathematical form : based on fundamental science with proper assumptions. Generally easier to calculate but with limited applications.

• Computer simulations : most commonly used in engineering practice. These codes are wrapped within a graphical user interface (GUI). One must understand the limitations and assumptions behind these computer logics.

• Experiment data fitting : also one of the most common practice in engineering. Although in math forms, it does not provide basic science and usually limited to interpolations.

3

Page 4: Optimal Design : Surrogate Models

Wind Tunnel with Fluid Dynamics Modeling

4

credit to 陳亮宇、沈育儒、柯曼德、楊敦仁、徐征宇

Page 5: Optimal Design : Surrogate Models

Curve fitting with various models

5

0

5

10

15

20

0 3 6 9 12

Page 6: Optimal Design : Surrogate Models

Linear and Quadratic Fits and Least Squares

• Let be the approximation function.

• The least square best linear fit is the function such that

6

Expensive

x1

x2

...xm

y1

y2

...ym

y

mina0,a1

�m⇤

i=1

yi � yi

⇥2

subject to yi = aT1 xi + a0

Page 7: Optimal Design : Surrogate Models

Neural Network Modeling

7

Page 8: Optimal Design : Surrogate Models

Basic Neuron

• Basic neuron without bias

• Basic neuron with bias

8

Page 9: Optimal Design : Surrogate Models

General Neural Network Model

9

y(x) = �

�n⇤

i=1

wixi + b

⇥weights

activation function

Page 10: Optimal Design : Surrogate Models

Kriging Modeling

10

Page 11: Optimal Design : Surrogate Models

Kriging Model

11

y(x) = f(x) + z(x)

f(x) = � = (IT R�1I)�1IT R�1yR(xi,xj) = e

n�

k=1

�k|xik � xj

k|2

� = argmin�|R| 1

m ⇥2⇥

⇥2 =1m

(y � �I)R�1(y � �I)

is in the form

where

with

Page 12: Optimal Design : Surrogate Models

Matlab Functions

• NEWFF

• TRAIN

• kriging demo.zip

• kriging-ych.zip

12