Numerical Analysis / Scientific Computing
Transcript of Numerical Analysis / Scientific Computing
![Page 1: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/1.jpg)
Numerical Analysis / Scientific ComputingCS450
Andreas Kloeckner, Xiaoyu Wei
Fall 2021
![Page 2: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/2.jpg)
OutlineIntroduction to Scientific Computing
NotesNotes (unfilled, with empty boxes)About the ClassErrors, Conditioning, Accuracy, StabilityFloating Point
Systems of Linear Equations
Linear Least Squares
Eigenvalue Problems
Nonlinear Equations
Optimization
Interpolation
Numerical Integration and Differentiation
Initial Value Problems for ODEs
Boundary Value Problems for ODEs
Partial Differential Equations and Sparse Linear Algebra
Fast Fourier Transform
Additional Topics
![Page 3: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/3.jpg)
What’s the point of this class?’Scientific Computing’ describes a family of approaches to obtainapproximate solutions to problems once they’ve been statedmathematically.Name some applications:
![Page 4: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/4.jpg)
What do we study, and how?
Problems with real numbers (i.e. continuous problems)
What’s the general approach?
![Page 5: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/5.jpg)
What makes for good numerics?
How good of an answer can we expect to our problem?
How fast can we expect the computation to complete?
![Page 6: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/6.jpg)
Implementation concerns
How do numerical methods get implemented?
![Page 7: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/7.jpg)
Class web page
https://bit.ly/cs450-f21
� Assignments� HW1!� Pre-lecture quizzes� In-lecture interactive content (bring computer or phone if possible)
� Textbook� Exams� Class outline (with links to notes/demos/activities/quizzes)� Virtual Machine Image� Piazza� Policies� Video� Inclusivity Statement
![Page 8: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/8.jpg)
Programming Language: Python/numpy
I Reasonably readableI Reasonably beginner-friendlyI Mainstream (top 5 in ‘TIOBE Index’)I Free, open-sourceI Great tools and libraries (not just) for scientific computingI Python 2/3? 3!I numpy: Provides an array datatype
Will use this and matplotlib all the time.I See class web page for learning materials
Demo: Sum the squares of the integers from 0 to 100. First withoutnumpy, then with numpy.
Do
![Page 9: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/9.jpg)
Supplementary Material
� Numpy (from the SciPy Lectures)� 100 Numpy Exercises� Dive into Python3
![Page 10: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/10.jpg)
Sources for these Notes
� M.T. Heath, Scientific Computing: An Introductory Survey, RevisedSecond Edition. Society for Industrial and Applied Mathematics,Philadelphia, PA. 2018.
� CS 450 Notes by Edgar Solomonik� Various bits of prior material by Luke Olson
![Page 11: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/11.jpg)
Open Source <3These notes (and the accompanying demos) are open-source!
Bug reports and pull requests welcome:https://github.com/inducer/numerics-notes
Copyright (C) 2020 Andreas Kloeckner
Permission is hereby granted, free of charge, to any person obtaining a copy of this software andassociated documentation files (the “Software”), to deal in the Software without restriction,including without limitation the rights to use, copy, modify, merge, publish, distribute,sublicense, and/or sell copies of the Software, and to permit persons to whom the Software isfurnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies orsubstantial portions of the Software.
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESSOR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OFMERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE ANDNONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERSBE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN ANACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR INCONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THESOFTWARE.
![Page 12: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/12.jpg)
What problems can we study in the first place?
To be able to compute a solution (through a process that introduceserrors), the problem. . .
If it satisfies these criteria, the problem is called well-posed. Otherwise,ill-posed.
Have a sold y
Unique so he
aunt depends cont on
![Page 13: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/13.jpg)
Dependency on Inputs
We excluded discontinuous problems–because we don’t stand much chancefor those.. . . what if the problem’s input dependency is just close to discontinuous?
Large error
x
x
![Page 14: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/14.jpg)
Approximation
When does approximation happen?
Demo: Truncation vs Rounding
rounding error
over under flow
truncation error IMA
![Page 15: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/15.jpg)
Example: Surface Area of the Earth
Compute the surface area of the earth.What parts of your computation are approximate?
![Page 16: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/16.jpg)
Measuring Error
How do we measure error?Idea: Consider all error as being added onto the result.
![Page 17: Numerical Analysis / Scientific Computing](https://reader031.fdocuments.us/reader031/viewer/2022012407/616a2ae611a7b741a34f8ad1/html5/thumbnails/17.jpg)
Recap: NormsWhat’s a norm?
Define norm.