Radial Basis Function Collocation Method
Transcript of Radial Basis Function Collocation Method
![Page 1: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/1.jpg)
Radial Basis Function Collocation Method
Alexander ChengUniversity of Mississippi
Keynote presented at Methods of Fundamental SolutionsAyia Napa, Cyprus, June 11-13, 2007
Collaborators: Zi-Cai LeeJason HuangEdward KansaJaime Cabral
![Page 2: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/2.jpg)
An Engineer’s Apology
• No proof (only numerical experiments)• Sales pitch (like a used car salesman)• This is not a MFS presentation
![Page 3: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/3.jpg)
Why Collocation Method?
• Accuracy• Simplicity• Solve ill-posed BVP directly• Meshless
![Page 4: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/4.jpg)
Accuracy
![Page 5: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/5.jpg)
Accuracy
• Its accuracy is impossible to match by FEM or FDM.
• In an example solving Poisson equation, an accuracy of the order 10-16 is reached using a 20x20 grid.
![Page 6: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/6.jpg)
To Make It Dramatic
• Assume that in an initial mesh, FEM/FDM can solve to an accuracy of 1%.
• Using a quadratic element or central difference, the error estimate is h2
• To reach an accuracy of 10-16, h needs to be refined 107
fold• In a 3D problem, this means 1021 fold more degrees of
freedom• The full matrix is of the size 1042
• The effort of solution could be 1063 fold• If the original CPU is 0.01 sec, this requires 1054 years• The age of universe is 2 x 1010 years
![Page 7: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/7.jpg)
Why Is Collocation Method So Accurate?
• First, It is not supposed to be the most accurate method, Galerkin method is better.
• It beats FEM/FDM because it uses global, rather than local, interpolation.
• Let’s look at an example.
![Page 8: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/8.jpg)
Method of Weighted Residuals
• Governing equation
• Essential and natural boundary conditions
![Page 9: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/9.jpg)
Minimizing Weighted Residual• Approximation
• Satisfying governing equation
• Satisfying boundary conditions
![Page 10: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/10.jpg)
Galerkin Method
• Weight: Wi = Ni
• Satisfying governing equation
![Page 11: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/11.jpg)
Collocation Method
• Weight
• Collocate for governing equation
• Collocate for boundary condition
![Page 12: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/12.jpg)
Other Methods
• Subdomain method• Moving least square method• Trefftz method• Method of fundamental solutions• Etc.
![Page 13: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/13.jpg)
A Simple Example
![Page 14: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/14.jpg)
Solution Strategy
• Approximate solution
• Solved by collocation, subdomain, and Galerkin method
• Integration performed exactly
![Page 15: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/15.jpg)
Solution Error
![Page 16: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/16.jpg)
Comments
• Galerkin method is the most accurate, collocation the least.
• Integration tends to distribute the error and point collocation concentrates the error.
• So why collocation method is the best?
![Page 17: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/17.jpg)
Errors
• Approximation (truncation) error• Round off error • Integration error
![Page 18: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/18.jpg)
In Multi-Dimensional Geometry
• Integration requires the division of domain into cells
• Geometric approximation error O(hn)• Quadrature error O(hn)• When truncation error decreases
(exponentially for collocation method), the above errors dominate.
• Hence point collocation is the most accurate!
![Page 19: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/19.jpg)
FEM Mistake
• FEM made a mistake by switching from global interpolation to local interpolation.
• It uses low degree polynomials within each element.
• Linear interpolation needs weak formulation• Higher degree interpolation still violates the
derivative requirement on edges of elements• It can never do better than hn error convergence,
while collocation method can have exponential error convergence.
![Page 20: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/20.jpg)
Example — Poisson Equation
![Page 21: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/21.jpg)
Exact SolutionHbL
00.25
0.50.75
1x0
0.25
0.5
0.75
1
y
-0.2
0
0.2
u
00.25
0.50.75
1x
![Page 22: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/22.jpg)
MQ and FD Solutions
![Page 23: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/23.jpg)
Simplicity
![Page 24: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/24.jpg)
BVP (Well and Ill-Posed)
• Governing equation
• Boundary condition
• Interior condition
![Page 25: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/25.jpg)
Well- and Ill-Posed BVP
• Well-posed problem
and
• Ill-posed problem
or
![Page 26: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/26.jpg)
• Assume the approximate solution is given by
![Page 27: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/27.jpg)
( )φ x( )φ xChoices of Basis Functions
• Monomial• Chebyshev polynomial• Fourier series• Wavelet• Fundamental solutions• Non-singular solution (Trefftz)• Radial basis function
![Page 28: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/28.jpg)
Point Collocation
![Page 29: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/29.jpg)
Examples of Ill-Posed Problems
• Harbor wave field
![Page 30: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/30.jpg)
Examples
• Groundwater field
![Page 31: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/31.jpg)
Examples
• Geoprospecting
![Page 32: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/32.jpg)
Examples
• Non-Destructive Testing
![Page 33: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/33.jpg)
Problem 1: Onishi (1995) FEM
• Governing equation
• BC
• Internal values: u(1,1) = 0, u(2,1) = 3, u(1,2) = -3, u(2,2) = 0
![Page 34: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/34.jpg)
Problem 1
• Onishi (1995), FEM– Governing equation
– BC
– Internal values: u(1,1) = 0, u(2,1) = 3, u(1,2) = -3, u(2,2) = 0
![Page 35: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/35.jpg)
Collocation Nodes
![Page 36: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/36.jpg)
Result
![Page 37: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/37.jpg)
Problem 2: Lesnic (1998) BEM
![Page 38: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/38.jpg)
Lesnic Result
![Page 39: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/39.jpg)
RBF Result
![Page 40: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/40.jpg)
Problem 3: “Groundwater”Exact potential9 data given
![Page 41: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/41.jpg)
Kriging
![Page 42: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/42.jpg)
Solving Ill-Posed Problem
![Page 43: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/43.jpg)
Error Estimate(Experimental)
![Page 44: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/44.jpg)
Test Problem
![Page 45: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/45.jpg)
Solution method
• Approximation by inverse multiquadric
Watch out for the “c”
![Page 46: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/46.jpg)
What Is the Role of c?
• People observe that as c increases, error decreases
• It is generally believed that as c →∞, ε →0 • If this is true, we have a dream method:
higher and higher precision without paying a price
• However, matrix ill-condition gets in the way; the dream cannot be fulfilled.
![Page 47: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/47.jpg)
What Is the Role of c?
• What if we can compute with infinite precision?
• Then, is it true that as c →∞, ε →0?• (Or, is it true that for MFS, as R →∞, ε→0?)
![Page 48: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/48.jpg)
Error Estimate
• 0 < λ < 1, a > 0• What is our clue?
![Page 49: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/49.jpg)
MQ Interpolation Error Estimate
• for interpolation of smooth function: – Madych & Nelson [1992]: O(λ(1/h)), 0<λ<1– Madych [1992]: O(eac λ(c/h)), 0<λ<1– Wendland [2001]: O(λ◊(1/h)), 0<λ<1
• for solving PDE– O(???)
![Page 50: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/50.jpg)
• Use 6x6 mesh (h = 0.2, 4x4 interior collocation)
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1collocation nodes (x-governing eqn, o-bc)
![Page 51: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/51.jpg)
Result: h = 1/5
![Page 52: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/52.jpg)
Result: h = 1/10
![Page 53: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/53.jpg)
Find Error Estimate Constants by Data Fitting
![Page 54: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/54.jpg)
Error Estimate Fit
![Page 55: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/55.jpg)
Optimal c
• If the error estimate
is true, then there exists an optimal cwhere error is minimum
![Page 56: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/56.jpg)
Revised Error Estimate
• If we can always use optimal c with a given mesh, what is the new error estimate?
![Page 57: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/57.jpg)
Effective Error Estimate If cmax Is Used
• h = 1/5, ε ~ 10-2
• h = 1/10, ε ~ 10-6
• h = 1/20, ε ~ 10-15
![Page 58: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/58.jpg)
But Wait!
• How can I find optimal c, given a realproblem and a mesh?
• I need the two constants λ and a.• I cannot get them by fitting the error data
because I do not know the error!• What is the remedy?• Use residual error to estimate!
![Page 59: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/59.jpg)
Residual Error
• Residual error is not solution error!• It is however proportional to solution error
by a (big and unknown) constant
![Page 60: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/60.jpg)
Solution Strategy
• Select a mesh, find solution with a given c.• Calculate residual on a sparse monitoring
grid.• Fix the mesh, solve the problem again with
two more c values and calculate residual.• a and ln λ can be determined from the
following formula with 3 data points
![Page 61: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/61.jpg)
Result
![Page 62: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/62.jpg)
Comment
• Residual error and solution error have the same trend.
• Three point fit produces a reasonable prediction of residual error.
• It captures the optimal c value.• That c will be used in the computation to
produce the best result with that mesh.• The actual error with that computation is
still not known!
![Page 63: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/63.jpg)
Conclusion
• For a continuous function, global basis function is much, much better than local, piecewise continuity interpolation.
• Point collocation is better than weighted integration.
• Some basis functions, such as multiquadric and Gaussian (fundamental solution too), have exponential convergence property.
![Page 64: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/64.jpg)
• For basis functions that have a parameter to adjust its shape, the flatter the basis function is, the more accurate the solution.
• Varying the parameter, instead of refining the mesh, is the better strategy to achieve better accuracy, as it is without cost.
• The error does not goes to zero by pushing the parameter value, as there is an error bound for a given mesh.
![Page 65: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/65.jpg)
• Once that limit is reached, the mesh needs to be refined, then the parameter value can be pushed further.
• The combined error convergence rate is AMAZING!
• Practical way that utilizes the residual error can be devised to predict the optimal parameter value, thus achieving optima accuracy.
![Page 66: Radial Basis Function Collocation Method](https://reader031.fdocuments.us/reader031/viewer/2022021211/620651ac8c2f7b1730069a95/html5/thumbnails/66.jpg)
Final Comment
• Is infinite (high) precision computation possible?
• Mathematica, Fortran, and C code exist.