Theoretical and practical aspects of linear and nonlinear model order reduction techniques
-
Upload
algernon-cousin -
Category
Documents
-
view
34 -
download
5
description
Transcript of Theoretical and practical aspects of linear and nonlinear model order reduction techniques
![Page 1: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/1.jpg)
Theoretical and practical aspects of linear and nonlinear model order reduction techniques
Dmitry Vasilyev
Thesis supervisor: Jacob K White
December 19, 2007
![Page 2: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/2.jpg)
2
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
Nonlinear
Linear
![Page 3: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/3.jpg)
3
Main motivation for MOR: system-level simulation
System to simulate
Device 1
Device 3
Device 2
Device 10
…
…
Q: How to reduce the cost of
simulating the big system? A: Reduce the
complexity of each sub-system, i.e.approximate input-output behavior of the system by a system of lower complexity.
The goal of MOR in a nutshell
![Page 4: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/4.jpg)
4
Main motivation for MOR: system-level simulation
Modern processor or system-on-a chip
> Millions of transistors> Kilometers of interconnects> Linear and nonlinear devices
inBvvGdt
dvvC )()(
4 2 2
4 2 20
( )w
elec a
u u uEI S F p p dy
x x t
3 ( )((1 6 ) ) 12
puK u p p
t
Figures thanks to Mike Chou, Michał Rewienski
![Page 5: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/5.jpg)
5
Model reduction problem
• Reduction should be automatic • Must preserve input-output properties
Many (> 104) internal states
inputs outputs
few (<100) internal states
inputs outputs
![Page 6: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/6.jpg)
6
Differential equation model
Original complex model:
Model can represent: Finite-difference spatial discretization of
PDEs Circuits with linear capacitors and
inductorsNeed accurate input-output behavior
![Page 7: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/7.jpg)
7
Nonlinear model reduction problem
Requirements for reduced model Want q << n (cost of simulation is q3) f r should be fast to compute Want yr(t) to be close to y(t)
Original complex model: Reduced model:
![Page 8: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/8.jpg)
8
A – stable, n x n (large)
Linear Model
Model can represent: Spatial discretization of linear PDEs Circuits with linear elements
- state
- vector of inputs
- vector of outputs
![Page 9: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/9.jpg)
9
Transfer function of LTI system
Transfer function:
Laplace transform of the
output
Laplace transform of the
input
Matrix-valued rational function of s
![Page 10: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/10.jpg)
10
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 11: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/11.jpg)
11
Linear MOR problem
n – large(thousands)!
Need the reduction to be automatic and preserve input-output properties (transfer function)
q – small (tens)
![Page 12: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/12.jpg)
12
Approximation error Wide-band applications: model should have
small worst-case error
ω
maximal difference over all frequencies
![Page 13: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/13.jpg)
13
Approximation error Narrow-band approximation: need good
approximation only near particular frequency:
ωfrequency response
Elmore delay: preserved if the first derivative at zero frequency is matched.
![Page 14: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/14.jpg)
14
Linear MOR methods roadmap
Linear MOR
Projection-based Non projection-based
Most widely used. Will be the central topic of this work.
![Page 15: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/15.jpg)
15
Projection-based linear MOR Pick projection matrices V and U:
such that VTU=I
Uz x
x
n x zU q
VTAUz
Ax
![Page 16: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/16.jpg)
16
Projection-based linear MOR
Uzx
0
BuAx
dt
dxV T
Important: reduced system depends only on
column spans of V and UD = Dr, preserves response at infinite frequency
![Page 17: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/17.jpg)
17
Linear MOR methods roadmap
Linear MOR
Projection-based Non projection-based
Proper Orthogonal Decomposition methods
Balancing-based (TBR)
V = U = {x(t1)… x(tq )}
V, U =eig{PQ, QP}
Krylov-subspace methods
V, U =K((si I-A)-1,B), K((si I-A)-T,CT)
![Page 18: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/18.jpg)
18
Linear MOR methods roadmap
Linear MOR
Projection-based
Krylov-subspace methods
Proper Orthogonal Decomposition methods
Balancing-based (TBR)
V = U = {x(t1)… x(tq )}
V, U =K((si I-A)-1,B), K((si I-A)-T,CT)
Will describenext.
Non projection-based
![Page 19: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/19.jpg)
19
LTI SYSTEM
X (state)
tu
t
y
input output
P (controllability)Which states are easier to reach?
Q (observability)Which states produce more output?
Reduced model retains most controllable and most observable states
Such states must be both very controllable and very observable
TBR idea
![Page 20: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/20.jpg)
20
Reduced system: (VTAU, VTB, CU, D)
Compute controllability and observability
gramians P and Q :
(~n3)AP + PAT + BBT =0 ATQ + QA + CTC = 0
Reduced model keeps
the dominant eigenspaces of PQ : (~n3)
PQui = λiui vT
iPQ = λivTi
Balanced truncation reduction (TBR)
Very expensive. P and Q are dense even for sparse models
![Page 21: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/21.jpg)
21
TBR benefits Guaranteed stability In practice provides more reduction than
Krylov H-infinity error bound => ideal for wide-band
approximations
Hankel singular values
![Page 22: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/22.jpg)
22
Linear MOR methods roadmap
Linear MOR
Projection-based Non projection-based
Singular perturbationapproximation
Transfer function fitting methods
Hankel-optimal MORTwice better errorbound than TBR [Glover ’84]
Match at zero frequency instead of infinity [Liu ‘89]
Promising topicof ongoing research [Sou ‘05]
![Page 23: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/23.jpg)
23
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 24: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/24.jpg)
24
Nonlinear MOR framework Consider original (large) system:
Projection of the nonlinear operator f(x):substitute x ≈ Uz and project residual onto VT
Problem: evaluation of V Tf(Uz) is still expensive
![Page 25: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/25.jpg)
25
Nonlinear MOR framework
Problem: evaluation of V Tf(Uz) is still expensiveTwo solutions:
Use Taylor series of f
Use TPWL approximation
![Page 26: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/26.jpg)
26
Taylor series for nonlinear MOR
Problem: evaluation of V Tf(Uz) is still expensiveTwo solutions:
Use Taylor series of f
Use TPWL approximation
Accurate only near expansion point or weakly nonlinear systems Storing of dense tensors is expensive; limits the series to orders no more than 3.
![Page 27: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/27.jpg)
27
Nonlinear MOR framework
Problem: evaluation of V Tf(Uz) is still expensiveTwo solutions:
Use Taylor series of f
Use TPWL approximation
Will be discussed next
![Page 28: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/28.jpg)
28
Trajectory piecewise linear (TPWL) approximation of f( ) [Rewieński, 2001]
Training trajectory
x0
x1x2
xs
…
Simulating trajectory
wi(x) is zero
outside circle
0
( ) ( ) ( )( ( ))n
TPWLi
iii if xf x w x x xA
0
( ) 1n
ii
w x
![Page 29: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/29.jpg)
29
Projection and TPWL approximation yields
efficient f r( )
q x 1 Air
VT Ai =U Air q
q
nn
Evaluating fTPWLr( ) requires only O(sq2) operations
![Page 30: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/30.jpg)
30
1.Compute A1
2.Obtain V1 and U1 using linear reduction for A1
3.Simulate training input, collect and reduce linearizations Ai
r = W1TAiV1
f r (xi)=W1Tf(xi)
TPWL approximation of f( ).
Extraction algorithm
Non-reduced state space
Initial system position
Training trajectory
x0
x1x2
xs
…
![Page 31: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/31.jpg)
31
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 32: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/32.jpg)
32
The matter of this contribution
Krylov-subspace methods Balanced-truncation method
What are projection options for TPWL?
Used in the original work[Rewienski ‘02]
Can we use it?
![Page 33: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/33.jpg)
33
Example problem
Linearized system has non-symmetric, indefinite Jacobian
RLC line
![Page 34: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/34.jpg)
34
0 2 4 6 8 100
0.005
0.01
0.015
0.02
0.025Full linearized model, N=800Full nonlinear model, N=800TPWL model, q=4, TBR basisTPWL model, q=30, Krylov basis
Input:training
input
testinginput
Numerical results – nonlinear RLC transmission line
System response for input current i(t) = (sin(2π/10)+1)/2
Vo
ltage
at n
ode
1 [V
]
Time [s]
![Page 35: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/35.jpg)
35
0 5 10 15 20 25 3010
-4
10-3
10-2
10-1
100
TBR TPWL modelKrylov TPWL model
Numerical results –RLC transmission line
Error in transient
||yr –
y|| 2
Order of the reduced model
TBR-based TPWL beat Krylov-based
4-th order TBR TPWL reaches the limit of TPWL representation
![Page 36: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/36.jpg)
36
Micromachined switch example
4 2 2
4 2 20
3
ˆ ( )
( )((1 6 ) ) 12
w
elec a
u u uEI S F p p dy
x x t
d puK u p p
dt
non-symmetric indefinite Jacobian
Finite-difference model of order 880
Model description [Hung ‘97]
![Page 37: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/37.jpg)
37
0 5 10 15 2010-3
10-2
10-1
100
101
102
TBR TPWL modelKrylov TPWL model
TPWL-TBR results– MEMS switch example
Errors in transient
Order of reduced system
||yr –
y|| 2
Odd order models unstable!
Even order models beat Krylov
Why???
Unstable!
![Page 38: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/38.jpg)
38
Explanation of even-odd effect – Problem statementConsider two LTI systems:
Initial: Perturbed:
TBR reduction
TBR reduction
Projection basis V Projection basis V
Define our problem: How perturbation in the initial system
affects TBR projection matrices?
~
![Page 39: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/39.jpg)
39
Perturbation behavior of TBR basis is similar to symmetric eigenvalue problem
Eigenvectors of M0 :
Eigenvectors of M0 + Δ :
Mixing of eigenvectors (assuming small perturbations):
cik large when λi
0 ≈ λk0
0
1
Nk
k i ii
e c e
0 0
0 0
( ),
Tk k ii
k i
e ec k i
0 0 01 2, , ..., Ne e e
![Page 40: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/40.jpg)
40
0 5 10 15 20 25 30
10 -6
10 -5
10 -4
10 -3
Hankel singular value
Hankel singular values, MEMS beam example
# of the Hankel singular value
This is the key to the problem.
Singular values are arranged in pairs!
![Page 41: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/41.jpg)
41
Explaining even-odd behavior
The closer Hankel singularvalues lie to each other, the
more corresponding eigenvectorsof V tend to intermix!
Analysis implies simple recipe for using TBR Pick reduced order to ensure that
Remaining Hankel singular values are small enough The last kept and the first removed Hankel singular
values are well separated
0 0
0 0
( ),
Tk k ii
k i
e ec k i
Helps to ensure that linearizations are stable
![Page 42: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/42.jpg)
42
Summary We used TBR-based linear reduction
procedure to generate TPWL reduced models
Order reduced 5 times while maintaining comparable accuracy with Krylov TPWL method (efficiency improved 125 times!)
Simple recipe found which helps to ensure stability.
![Page 43: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/43.jpg)
43
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 44: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/44.jpg)
44
Reduced system: (VTAU, VTB, CU, D)
Compute controllability and observability
gramians P and Q :
(~n3)AP + PAT + BBT =0 ATQ + QA + CTC = 0
Reduced model keeps
the dominant eigenspaces of PQ : (~n3)
PQui = λiui vT
iPQ = λivTi
Balanced truncation reduction (TBR)
Very expensive. P and Q are dense even for sparse models
![Page 45: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/45.jpg)
45
• Arnoldi [Grimme ‘97]:U = colsp{A-1B, A-2B, …}, V=U , approx. Pdom only
• Padé via Lanczos [Feldman and Freund ‘95]colsp(U) = {A-1B, A-2B, …}, - approx. Pdom colsp(V) = {A-TCT, (A-T )2CT, …}, - approx. Qdom
• Frequency domain POD [Willcox ‘02], Poor Man’s TBR [Phillips ‘04]
Most reduction algorithms effectively separately approximate dominant eigenspaces of P and Q :
However, what matters is the product PQ
colsp(U) = {(jω1I-A)-1B, (jω2I-A)-1B, …}, - approx. Pdom
colsp(V) = {(jω1I-A)-TCT, (jω2I-A)-TCT, …}, - approx. Qdom
![Page 46: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/46.jpg)
46
RC line (symmetric circuit)
Symmetric Jacobian, B=CT, P=Q
all controllable states are observable and vice versa
V(t) – inputi(t) - output
![Page 47: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/47.jpg)
47
RLC line (nonsymmetric circuit)
P and Q are no longer equal! By keeping only mostly controllable
and/or only mostly observable states, we may not find dominant eigenvectors of PQ
Vector of states:
![Page 48: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/48.jpg)
48
Lightly damped RLC circuit
Exact low-rank approximations of P and Q of
order < 50 leads to PQ ≈ 0
R = 0.008, L = 10-5
C = 10-6
N=100
y(t) = i1
![Page 49: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/49.jpg)
49
AISIAD model reduction algorithm
Idea of AISIAD approximation:Approximate eigenvectors using power iterations:
Ui converges to dominant eigenvectors of PQ
Need to find the product (PQ)Ui
Xi = (PQ)Ui Ui+1
= qr(Xi)
“iterate”
How?
![Page 50: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/50.jpg)
50
Approximation of the product Ui+1 =qr(PQUi), AISIAD algorithm
Vi ≈ qr(QUi) Ui+1
≈ qr(PVi)
Approximate using solution of Sylvester equation
Approximate using solution of Sylvester equation
![Page 51: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/51.jpg)
51
More detailed view of AISIAD approximation
Right-multiply by Vi
X X H, qxq (original AISIAD)
M, nxq
![Page 52: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/52.jpg)
52
X X H, qxq
Modified AISIAD approximation
Right-multiply by Vi
Approximate!
M, nxq
^
![Page 53: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/53.jpg)
53
Modified AISIAD approximation
Right-multiply by Vi
We can take advantage of various methods, which approximate P and Q
M, nxq
X X H, qxqApproximate!
^
![Page 54: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/54.jpg)
54
n x qn x n
Specialized Sylvester equation
A X + X H =-M
q x q
Need only column span of X
![Page 55: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/55.jpg)
55
Solving Sylvester equation
Schur decomposition of H :
A X + X =-M~ ~
Solve for columns of X~
~
X
![Page 56: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/56.jpg)
56
Solving Sylvester equation
Applicable to any stable A Requires solving q times
Schur decomposition of H :
Solution can be accelerated via fast MVPOriginal method suggests IRA, needs A>0 [Zhou ‘02]
![Page 57: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/57.jpg)
57
1.Obtain low-rank approximations of P and Q2.Solve AXi +XiH + M = 0, => Xi≈ PVi
where H=ViTATVi, M = P(I - ViVi
T)ATVi + BBTVi
3. Perform QR decomposition of Xi =UiR
4. Solve ATYi +YiF + N = 0, => Yi≈ QUi
where F=UiTAUi, N = Q(I - UiUi
T)AUi + CTCUi
5.Perform QR decomposition of Yi =Vi+1 R to get new
iterate. 6.Go to step 2 and iterate.7.Bi-orthogonalize V and U and construct reduced model:
Modified AISIAD algorithm
(VTAU, VTB, CU, D)
LR-sqrt^ ^
^
^
![Page 58: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/58.jpg)
58
RLC line example resultsH-infinity norm of reduction error (worst-case discrepancy over all frequencies)
N = 1000,1 input
2 outputs
![Page 59: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/59.jpg)
59
Summary of the modified AISIAD
Fast approximation to TBR Especially useful if gramians do not
share common dominant eigenspace Improved accuracy and extended
applicability over AISIAD Generalized to the systems in
descriptor form
![Page 60: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/60.jpg)
60
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 61: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/61.jpg)
61
Features of the method
Cost of reduction
Reduction quality
TBR
Hankel-optimal
Krylov-subspace methods
Graph-based reduction:manipulates RC network by removing nodes and inserting new elements
![Page 62: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/62.jpg)
62
Linear RC network description
Jk
Jm
vm
vk
vs
External ports
State-space model in the frequency domain:
Vector of node voltages (state):
symmetric
Conductance matrix is analogous, ground node is excluded.
![Page 63: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/63.jpg)
63
Low-frequency approximation for reduced circuit
Consider removing a single internal node (Nth), partition matrices and vectors:
Substitute vN in the system equations (one step of Gaussian elimination):
Where
![Page 64: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/64.jpg)
64
Node elimination
Added conductance
Capacitance-like
Problem: last capacitance term is negative! Potentially inserting a negative capacitor???
The term was ignored in the TICER algorithm [Sheehan ‘99]. Leads to inconsistent diagonal update.
![Page 65: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/65.jpg)
65
Node elimination – Theorem 1
Claim: keeping the exact Taylor series is OK:
Proof: Define projection:
Gnew Cnew
Congruence transform
Model is alwaysstable and passive
![Page 66: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/66.jpg)
66
Node elimination criteria When is it safe to eliminate a node?
Denominator expansion:(used in TICER)
Numerator term ~s2 (element-by-element)
Using these criteria the reduced order will be chosen on-the-fly
(overlooked in TICER)
![Page 67: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/67.jpg)
67
Resulting algorithm: Given the initial circuit and maximal frequency of
interest Using lowest-degree ordering (minimize fill-ins) Perform the elimination of the “qualified” nodes
by inserting new capacitors and resistors:
(for every nodes i and j which were connected via the node N)
Until no nodes satisfy elimination conditions.
![Page 68: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/68.jpg)
68
Results: testing substitution rules
Testing only substitution rules, 1-CDF of the reduction error
tested more than 30,000 circuits
![Page 69: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/69.jpg)
69
Results: testing elimination conditions
Narrower distribution Better worst-case accuracy
Same elimination rules, same average reductiondifferent elimination criteria:
![Page 70: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/70.jpg)
70
Summary of the new method
Improved accuracy and error control over TICER by using correct Taylor series and elimination criteria
Preserves stability and passivity Generalized to parameter-dependent
case Fastest, though conservative
![Page 71: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/71.jpg)
71
Outline Motivation Overview of existing methods:
Linear MOR Nonlinear MOR
TBR-based trajectory piecewise-linear method
Modified AISIAD linear reduction method Graph-based model reduction for RC circuits Case study: microfluidic channel Conclusions
![Page 72: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/72.jpg)
72
r1
w
V
u(t) = Cin(t)
(input)
y1(t) =<Cout>(t)
y2(t)
y3(t)
Inside the carrying fluid, marker fluid spreads governed by 3D convection-diffusion equation:
Using mapped-domain finite-difference volume discretization, obtained model has 2842 unknowns (large)
(outputs)
Electro-osmotic flow in the 3D U-shaped microchannel
![Page 73: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/73.jpg)
73
How the marker spreads
C(t)
t0
C(r,t)
t
r
C(r,t)
t
r
12
3
r
1 2 3
![Page 74: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/74.jpg)
74
Linear reduction techniques are extremely efficient for such models
[Vasilyev, Rewienski, White ‘06]
Linear case In case of constant mobility and diffusivity the model is
linear:
![Page 75: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/75.jpg)
75
Modified AISIAD reduction - results
![Page 76: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/76.jpg)
76
TBR, Arnoldi and mAISIAD
Modified AISIADruntime:73sTBR runtime:2207s
(Matlab implementation)
![Page 77: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/77.jpg)
77
Comparison with other reduction methods
![Page 78: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/78.jpg)
78
For arbitrary nonlinearity in convection and diffusion coefficients and TPWL, this problem is very challenging!
[Vasilyev, Rewienski, White ‘06]
However, the problem becomes more tractable, if one considers a quadratic problem
This is the case for affine μ and D:
μ(C) = μ0C+ μ1
D(C) = D0C+ D1
Nonlinear microchannel problem
![Page 79: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/79.jpg)
79
Quadratic model of microchannel system
Affine mobility and diffusivity leads to quadratic model:
Use orthogonal projection V = U, V TV = I
Reduced quadratic system
![Page 80: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/80.jpg)
80
Projected reduced quadratic model of size 60 approximates original system of size 2842 quite well:
Quadratic microchannel problem - result
Krylov-subspace basis,Quadratic reduction
![Page 81: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/81.jpg)
81
Conclusions Performed applicability analysis of TBR-
based TPWL models based on matrix perturbation theory
Developed modified AISIAD method which is aimed at approximating TBR for the cases where gramians do not necessarily share common dominant eigenspaces
Developed graph-based parameterized RC reduction method and improved nominal reduction
![Page 82: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/82.jpg)
82
I extend my sincere thanks to:
Prof. Jacob White – my supervisor,Profs. Luca Daniel and Alexandre Megretski,Profs. Karen Willcox, John Kassakian, John Wyatt,
Dr. Yehuda Avniel, Dr. Joel Phillips, Dr. Mark ReicheltMy groupmates: Anne, Bo, Brad, Carlos, Dave, Jay,
Jung Hoon, Homer, Kin, Laura, Lei, Michał, Shihhsien, Steve, Tarek, Tom, Xin, Zhenhai
My wife, Patrycja
Thank you! Спасибо! Grazie! Dziękuje! Komapsumnida! Xie Xie! Dua Netjer en ek!
![Page 83: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/83.jpg)
83
For systems in the descriptor form
Generalized Lyapunov equations:
Lead to similar approximate power iterations
![Page 84: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/84.jpg)
84
mAISIAD and low-rank square root
Low-rank gramians
LR-square root
mAISIAD
(inexpensive step) (more expensive)For the majority of non-symmetric cases,
mAISIAD works better than low-rank square root
(cost varies)
![Page 85: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/85.jpg)
85
RLC line example resultsH-infinity norm of reduction error (worst-case discrepancy over all frequencies)
N = 1000,1 input
2 outputs
![Page 86: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/86.jpg)
86
Steel rail cooling profile benchmark
Taken from Oberwolfach benchmark collection, N=1357 7 inputs, 6 outputs
![Page 87: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/87.jpg)
87
mAISIAD is useless for symmetric models
For symmetric systems (A = AT, B = CT) P=Q, therefore mAISIAD is equivalent to LRSQRT for P,Q of order q
RC line example
^ ^
![Page 88: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/88.jpg)
88
Cost of the algorithm Cost of the algorithm is directly
proportional to the cost of solving a linear system:
(where sjj is a complex number)
Cost does not depend on the number of inputs and outputs
(non-descriptor case)
(descriptor case)
![Page 89: Theoretical and practical aspects of linear and nonlinear model order reduction techniques](https://reader037.fdocuments.us/reader037/viewer/2022102707/56812f1d550346895d94b6ac/html5/thumbnails/89.jpg)
89
Lightly damped RLC circuit
Union of eigenspaces of P and Qdoes not necessarily approximate
dominant eigenspace of PQ .
Top 5 eigenvectors of P Top 5 eigenvectors of Q