I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept....
-
date post
20-Dec-2015 -
Category
Documents
-
view
213 -
download
1
Transcript of I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept....
![Page 1: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/1.jpg)
![Page 2: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/2.jpg)
I welcome you all to this I welcome you all to this presentationpresentation
On:On:
![Page 3: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/3.jpg)
Neural Network ApplicationsNeural Network Applications
Systems Engineering Dept. KFUPMSystems Engineering Dept. KFUPM
Imran Nadeem & Naveed R. ButtImran Nadeem & Naveed R. Butt
220504 & 230353220504 & 230353
![Page 4: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/4.jpg)
Part II: LMS & RBFPart I: Introduction to Neural NetworksPart III: Control Applications
![Page 5: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/5.jpg)
Part I: Introduction to Neural Networks
Part I: Introduction to NN’sPart I: Introduction to NN’s There is no restriction on the
unknown function to be linear. Thus, neural networks provide a logical extension to create nonlinear adaptive control schemes.
Universal Approximation Theorem: neural networks can reproduce any nonlinear function for a limited input set.
Neural networks are parameterized nonlinear functions whose parameters can be adjusted to achieve different shaped nonlinearities.
In essence, we try to adjust the neural network to serve as an approximator for an unknown function that we know only through its inputs and outputs
![Page 6: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/6.jpg)
Human NeuronHuman Neuron
Part I: Introduction to Neural Networks
![Page 7: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/7.jpg)
Artificial NeuronArtificial Neuron
Part I: Introduction to Neural Networks
![Page 8: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/8.jpg)
Adaptation in NN’sAdaptation in NN’s
Part I: Introduction to Neural Networks
![Page 9: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/9.jpg)
Single Layer Feedforward Single Layer Feedforward NN’sNN’s
Part I: Introduction to Neural Networks
![Page 10: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/10.jpg)
Part I: Introduction to Neural Networks
Multi-Layer Feedforward Multi-Layer Feedforward NN’sNN’s
![Page 11: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/11.jpg)
Recurrent (feedback) NN’sRecurrent (feedback) NN’s
Part I: Introduction to Neural Networks
A recurrent neural network distinguishes itself from the feed-forward network in that it has at least one feedback loop. For example, a recurrent network may consist of a single layer of neurons with each neuron feeding its output signal back to the input of all input neurons.
![Page 12: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/12.jpg)
Recurrent (feedback) NN’sRecurrent (feedback) NN’s
Part I: Introduction to Neural Networks
The presence of feedback loops has a profound impact on the learning capability of the network and on its performance.
![Page 13: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/13.jpg)
Applications of NN’sApplications of NN’s
Part I: Introduction to Neural Networks
Neural networks are applicable in virtually every situation in which a relationship between the predictor variables (independents, inputs) and predicted variables (dependents, outputs) exists, even when that relationship is very complex and not easy to articulate in the usual terms of "correlations" or "differences between groups”
![Page 14: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/14.jpg)
Applications of NN’sApplications of NN’s
Part I: Introduction to Neural Networks
Detection of medical phenomena
Stock market prediction
Credit assignment
Condition Monitoring
Signature analysis
Process control
Nonlinear Identification & Adaptive Control
![Page 15: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/15.jpg)
End of Part IEnd of Part I
![Page 16: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/16.jpg)
Part II: LMS & RBF
Part II: LMS & RBFPart II: LMS & RBF
LMS: The Adaptation Algorithm
RBF: Radial Bases Function NN
![Page 17: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/17.jpg)
Part II: LMS & RBF
LMS: The Adaptation Algo.LMS: The Adaptation Algo.
][~][][ nsndne
2{| [ ] | }J E e n
Jnwnw w2
][]1[
Estimation Error
Actual Response Estimated Response
Cost FunctionMean Square Error
Weight Updates
Adaptation Step Size
![Page 18: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/18.jpg)
Part II: LMS & RBF
RBF-NN’sRBF-NN’s
Radial functions are a special class of functions. Their characteristic feature is that their response decreases (or increases) monotonically with distance from a central point and they are radially symmetric.
![Page 19: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/19.jpg)
Part II: LMS & RBF
RBF-NN’sRBF-NN’s
GaussianRBF
![Page 20: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/20.jpg)
Part II: LMS & RBF
RBF-NN’sRBF-NN’s
Neural Networks based on radial bases functions are known as RBF Neural Networks and are among the most commonly used Neural Networks
![Page 21: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/21.jpg)
Part II: LMS & RBF
RBF-NN’sRBF-NN’s Two-layer feed-forward
networks.
Hidden nodes: radial basis functions.
Output nodes : linear summation.
Very fast learning
Good for interpolation, estimation & Classification
![Page 22: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/22.jpg)
Part III: Control Applications
Part III: Control ApplicationsPart III: Control Applications
Nonlinear System Identification
Adaptive Tracking of Nonlinear Plants
![Page 23: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/23.jpg)
Nonlinear System Nonlinear System IdentificationIdentification
Part III: Control Applications
![Page 24: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/24.jpg)
Nonlinear System Nonlinear System IdentificationIdentification
Part III: Control Applications
2 3 4
2 3 2
2 2 2 3 3
( 1) 0.8606 ( ) 0.0401 ( ) 0.0017 ( ) 0.000125 ( ) 0.0464 ( )
0.045 ( ) ( ) 0.0034 ( ) ( ) 0.00025 ( ) ( ) 0.0012 ( )
0.0013 ( ) ( ) 0.0001458 ( ) ( ) 0.00002083 ( ) 0.00002083 ( ) ( )
y t y t y t y t y t u t
y t u t y t u t y t u t u t
y t u t y t u t u t y t u t
Continuously Stirred Tank Reactor
![Page 25: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/25.jpg)
Nonlinear System Nonlinear System IdentificationIdentification
Part III: Control Applications
0 20 40 60 80 100 120 140 160 180 200-0.8
-0.6
-0.4
-0.2
0
0.2
0.4
0.6
Time
Plant OutputNN Output
Simulation ResultsUsing SIMULINK
![Page 26: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/26.jpg)
Adaptive Nonlinear TrackingAdaptive Nonlinear Tracking
Part III: Control Applications
![Page 27: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/27.jpg)
Adaptive Nonlinear TrackingAdaptive Nonlinear Tracking
Part III: Control Applications
)(2.0)()(1)(
)2(1.0)1()1(5.0)(32 tutututx
txtxtyty
Hammerstein Model
![Page 28: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/28.jpg)
Adaptive Nonlinear TrackingAdaptive Nonlinear Tracking
Part III: Control Applications
0 10 20 30 40 50 60 70 80 90 100-2
-1.5
-1
-0.5
0
0.5
1
1.5
2
Time
ReferencePlant OutputModel Output
Simulation ResultsUsing SIMULINK
![Page 29: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/29.jpg)
Adaptive Nonlinear TrackingAdaptive Nonlinear Tracking
Part III: Control Applications
Simulation ResultsUsing SIMULINK
0 10 20 30 40 50 60 70 80 90 100
-1
-0.8
-0.6
-0.4
-0.2
0
0.2
0.4
0.6
0.8
1
Time
Co
ntr
ol
Sig
nal
![Page 30: I welcome you all to this presentation On: Neural Network Applications Systems Engineering Dept. KFUPM Imran Nadeem & Naveed R. Butt 220504 & 230353.](https://reader031.fdocuments.us/reader031/viewer/2022032800/56649d405503460f94a1a82c/html5/thumbnails/30.jpg)
Thank youThank you