Intelligent Numerical Computation1 Center:Width:.

20
Intelligent Numerical Com putation 1 Center: Width:

description

Intelligent Numerical Computation3 Find an interpolation function with N RBFs

Transcript of Intelligent Numerical Computation1 Center:Width:.

Page 1: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 1

Center: Width:

Page 2: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 2

Radial basis function network

Page 3: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 3

Find an interpolation function with N RBFs

Page 4: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 4

Or

Solve

Page 5: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 5

A class of RBFs

Page 6: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 6

Generalization to multi-dimensional target

Interpolation conditions

Interpolation function

Page 7: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 7

M<<N

Adapted by an algorithm

Adapted by an algorithm

A bias

Page 8: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 8

A RBF network

Or in matrix

Page 9: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 9

Universal approximation

Page 10: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 10

Extended basis functions

Page 11: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 11

where

Page 12: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 12

Minimize the cost function

Page 13: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 13

Page 14: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 14

I

Page 15: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 15

Advanced clustering algorithms

II LVQIII K-means algorithmIV Kohonen self-organizing algorithm

Page 16: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 16

to

where

Page 17: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 17

Assignment #3

Implement a training algorithm for a RBF network•Multi-dimensional input space•One-dimensional output space•You can select supervised training or two-stage training or more advanced training algorithm•Your program should be able to read a training file and a testing file to evaluate performance. The last column of the training file will be the desired output.

Page 18: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 18

Variants

Page 19: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 19

Model size vs generalization

Minimal model size and maximal generalization

Page 20: Intelligent Numerical Computation1 Center:Width:.

Intelligent Numerical Computation 20

Applications

http://lib.stat.cmu.edu/datasets/

http://www.cs.toronto.edu/~delve/data/datasets.html

http://www.phys.uni.torun.pl/neural/node12.html

Radial basis function interpolation for 3-D ultrasound

http://svr-www.eng.cam.ac.uk/~ahg/rnr20/publications.html