(Kpi summer school 2015) theano tutorial part1
-
Upload
sergii-gavrylov -
Category
Science
-
view
937 -
download
1
Transcript of (Kpi summer school 2015) theano tutorial part1
![Page 1: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/1.jpg)
Theano tutorialpart 1
AACIMP 2015Sergii Gavrylov
![Page 2: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/2.jpg)
Overview● Introduction
● Symbolic variables
● Functions
● Shared variables / updates
● Gradients
● Substitution
● Random streams
![Page 3: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/3.jpg)
What is Theano?
● Python library
● Computer algebra system
● Compiler
![Page 4: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/4.jpg)
Where to find more info?
● Website: deeplearning.net/software/theano
● User mailing list: groups.google.com/group/theano-users
● Deep learning tutorials: deeplearning.net/tutorial
![Page 5: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/5.jpg)
Tutorial environment
1. Go to XX.XX.XXX.XXX:XXXX to determine your workspace
id that you will use through this tutorial
2. Go to XX.XX.XXX.XXX:XXXX to use your workspace
3. password: xxxxxxxxx
https://github.com/sergii-gavrylov/theano-tutorial-AACIMP2015
![Page 6: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/6.jpg)
Scalar math
![Page 7: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/7.jpg)
Symbolic variablesX
+
Z
Y
![Page 8: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/8.jpg)
Symbolic variablesX
+
Z
Y
compilation add_fun(_ , _)
37, 5
42
![Page 9: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/9.jpg)
Task scalars
![Page 10: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/10.jpg)
Data types
![Page 11: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/11.jpg)
Data types
![Page 12: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/12.jpg)
Vector math
![Page 13: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/13.jpg)
Matrix math
![Page 14: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/14.jpg)
Task vectors_matrices
![Page 15: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/15.jpg)
Shared variables
X
+
Z
Y
42
![Page 16: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/16.jpg)
Shared variables
X
+
Z
Y
42
compilation add_fun(_)
1
43
![Page 17: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/17.jpg)
Shared variables
![Page 18: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/18.jpg)
Updates
![Page 19: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/19.jpg)
Task shared_updates
![Page 20: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/20.jpg)
Symbolic differentiation
![Page 21: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/21.jpg)
Task grad
![Page 22: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/22.jpg)
![Page 23: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/23.jpg)
Task logistic_regression
![Page 24: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/24.jpg)
Substitution
![Page 25: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/25.jpg)
Substitution
![Page 26: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/26.jpg)
Task substitution
![Page 27: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/27.jpg)
Random streams
![Page 28: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/28.jpg)
Task random_stream
![Page 29: (Kpi summer school 2015) theano tutorial part1](https://reader031.fdocuments.us/reader031/viewer/2022022202/5883f0cb1a28ab34428b6309/html5/thumbnails/29.jpg)
Conclusion● Theano is a tool that combines the best of both worlds: it is easy
to code and fast to execute!
● It is used in both academia and industry.
● Symbolic paradigm is extremely flexible, but it might be not
suitable for everyone.
● Part 2 is coming.