International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College...
-
Upload
shona-young -
Category
Documents
-
view
221 -
download
0
Transcript of International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College...
![Page 1: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/1.jpg)
International Workshop on Resonance Oscillations and Stability ofNonsmooth Systems
Imperial College LondonLondon, United Kingdom
June 16–25, 2009
A joint work with M. U. AKHMET and D. ARUGASLAN
Method of Lyapunov Functions for Differential Equations with Piecewise Constant Delay and Its Application to
Neural Networks Model
Enes YILMAZInstitute of Applied Mathematics, Middle East Technical University
TURKEY
![Page 2: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/2.jpg)
Outline
Introduction and preliminaries Main results Application to Neural
Networks model Summary and Conclusion
![Page 3: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/3.jpg)
Aims Investigate the second Lyapunov Method for differential
equations with piecewise constant argument of generalized type (EPCAG).
Although, these equations include delay, stability conditions are only given in terms of Lyapunov functions; that is no functionals are used.
Apply Lyapunov method to Recurrent neural networks, especially, Cellular Neural Networks (CNNs) and Hopfield-type Neural Networks (HNNs).
L. O. Chua and L. Yang, Cellular neural networks: Theory, IEEE Trans. CircuitsSyst. 35 (1988), pp. 1257-1272. L. O. Chua and L. Yang, Cellular neural networks: Applications, IEEE Trans.Circuits Syst. 35 (1988), pp. 1273-1290. J. J. Hopfield, Neurons with graded response have collective computational properties like those of two-stage neurons, Proc. Nat. Acad. Sci. Biol. 81 (1984), pp. 3088-3092.
![Page 4: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/4.jpg)
1. Introduction and preliminaries
The main novelties of this talk are the followings: Reduction to discrete equations Total stability: originate from a special
theorem by MalkinW. Hahn, Stability of Motion, Berlin, Springer-Verlag, 1967.
N. Rouche, P. Habets and M. Laloy, Stability theory by Liapunov’s direct method, NewYork, Springer-Verlag, 1977.
I. G. Malkin, Stability in the case of constantly acting disturbances, Prickl. Mat., 8, (1944) 241-245.
Comparison of stability of EPCAG and ODE
![Page 5: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/5.jpg)
1. Introduction and preliminaries
![Page 6: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/6.jpg)
1. Introduction and preliminaries
![Page 7: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/7.jpg)
1. Introduction and preliminaries
![Page 8: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/8.jpg)
1. Introduction and preliminaries
M. U. Akhmet, Stability of differential equations with piecewise constant arguments of generalized type, Nonlinear Analysis 68 (2008) 764-803.
![Page 9: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/9.jpg)
1. Introduction and preliminaries
M. U. Akhmet, Integral manifolds of differential equations with piecewise constant argument of generalized type, Nonlinear Analysis 66 (2007) 367-383.
M. U. Akhmet, On the reduction principle for differential equations with piecewise constant argument of generalized type, J. Math. Anal. Appl. 336 (2007) 646-663.
![Page 10: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/10.jpg)
2. Main results
![Page 11: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/11.jpg)
2. Main results
![Page 12: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/12.jpg)
2. Main results
If Change with
![Page 13: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/13.jpg)
2. Main results
Theorems provide criteria for stability which are entirely constructed by Lyapunov functions. As for the functionals, they appear only in the proof of theorems. We see that conditions of our result, which guarantee stability, are definitely formulated without functionals…
![Page 14: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/14.jpg)
2. Main results
M. U. Akhmet and D. Arugaslan, Lyapunov-Razumikhin method for differential equations with piecewise constant argument, Discrete Contin. Dyn. Syst., (in press)
![Page 15: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/15.jpg)
2. Main results
![Page 16: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/16.jpg)
2. Main results
So what is the advantage of this method?
We can see that theorems obtained by Lyapunov-Razumikhin method provide larger class of equations . However
From the perspective of the constructive analysis, the present method may be preferable, since, for example, in the proof of uniform stability theorems, it is possible to evaluate the domains of attraction.
![Page 17: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/17.jpg)
2. Main results
Besides above theorems, the following assertions may be useful for analysis of the stability of EPCAG.These theorems are important and have their own distinctive values with the newly required properties of the Lyapunov function.
If Change with
![Page 18: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/18.jpg)
2. Main results
Apply to recurrent neural networks model…
![Page 19: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/19.jpg)
3. Application to Neural Networks Model
Typical Neuron
![Page 20: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/20.jpg)
3. Application to Neural Networks Model
The Hopfield Neural Network (1982-1984)
C: total input capacitance a: voltage input p: input conductance w: conductance x: output voltage
![Page 21: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/21.jpg)
3. Application to Neural Networks Model
The input voltage is determined by
C: total input capacitance a: voltage input p: input conductance w: conductance x: output voltage
while the output voltage is
![Page 22: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/22.jpg)
3. Application to Neural Networks Model
Consider the following RNNs model described by EPCAG
The following assumptions will be needed throughout the talk:
![Page 23: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/23.jpg)
3. Application to Neural Networks Model
First, let us give the existence of a unique equilibrium as fallows:
S. Mohammad and K. Gopalsamy, Exponential stability of continuous-time and discrete-time CNNs with delays, Appl. Mat. and Comp., 135 (2003), pp. 17-38
![Page 24: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/24.jpg)
3. Application to Neural Networks Model
Next, the existence of uniqueness of solutions:
![Page 25: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/25.jpg)
3. Application to Neural Networks Model
In order to get the stability theorems, we give the following important lemma…
Now, we establish several criteria for global exponential stability based on the method of Lyapunov functions…
![Page 26: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/26.jpg)
3. Application to Neural Networks Model
Define a Lyapunov function by
![Page 27: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/27.jpg)
3. Application to Neural Networks Model
If we choose a different Lyapunov function defined as
We find new stability conditions for RNNs…
![Page 28: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/28.jpg)
3. Application to Neural Networks Model
Let us give an example with simulations to illustrate our results
![Page 29: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/29.jpg)
3. Application to Neural Networks Model
![Page 30: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/30.jpg)
3. Application to Neural Networks Model
![Page 31: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/31.jpg)
3. Application to Neural Networks Model
![Page 32: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/32.jpg)
4. Summary and Conclusion
It is the first time that the method of Lyapunov functions for EPCAG is applied to the model of RNNs.
Our method gives new ideas not only from the modeling point of view, but also from that of theoretical opportunities since RNNs involves piecewise constant argument of delay type.
Lyapunov functions give an opportunity to estimate domains of attraction which allows us particular interest to evaluate the performance of RNNs.
The method given in this talk may be extended to study more complex systems.
M. U. Akhmet, Dynamical synthesis of quasi-minimal sets, Inter. Journal of Bif. And Chaos, (Accepted)
![Page 33: International Workshop on Resonance Oscillations and Stability of Nonsmooth Systems Imperial College London London, United Kingdom June 16–25, 2009 A joint.](https://reader035.fdocuments.us/reader035/viewer/2022062314/5697bf701a28abf838c7d603/html5/thumbnails/33.jpg)
References
M. U. Akhmet and E. Yilmaz, Hopfield-type neural networks systems with piecewise constant argument, Int. Journal of Q. Diff. and Appl. (Accepted).
M. U. Akhmet and E. Yilmaz, Impulsive Hopfield-type neural networks systems with piecewise constant argument, (Submitted).
M. U. Akhmet, D. Arugaslan and E. Yilmaz, Stability in cellular neural networks with piecewise constant argument, (Submitted).
M. U. Akhmet, D. Arugaslan and E. Yilmaz, Stability analysis of recurrent neural networks with deviated argument of mixed type, (Submitted).
M. U. Akhmet, D. Arugaslan and E. Yilmaz, Method of Lyapunov functions for differential equations with piecewise constant delay, (Submitted).
M. U. Akhmet and E. Yilmaz, Global attractivity in impulsive neural networks with piecewise constant delay, (in preparation).THANKS FOR YOUR
ATTENTION!