Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta
-
Upload
withthebest -
Category
Technology
-
view
25 -
download
0
Transcript of Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta
![Page 1: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/1.jpg)
Hierarchical Temporal Memory
Computing Like the BrainMatt Taylor
Principle Engineer Open Source Community Flag-Bearer
![Page 2: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/2.jpg)
– ROBERT MCMILLAN (from a Wired article title, 01.16.15)
“AI Has Arrived”
![Page 3: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/3.jpg)
![Page 4: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/4.jpg)
Machine Learning ≠
Intelligence
![Page 5: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/5.jpg)
Oriol VinyalsStaff Research ScientistGoogle DeepMind
![Page 6: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/6.jpg)
Neuron Models
![Page 7: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/7.jpg)
Current ML techniques based upon this simple neuron model
probably won’t produce strong AI
![Page 8: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/8.jpg)
Numenta’s Dual Mission
1. Understand how intelligence works in the mammalian neocortex
2. Create software based upon those principles
![Page 9: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/9.jpg)
Biologically-constrained methods of creating
intelligence might produce strong AI
![Page 10: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/10.jpg)
Hopefully you are hear to learn about another approach to intelligence, based on the
neocortex.
![Page 11: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/11.jpg)
Let’s talk about brains
![Page 12: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/12.jpg)
Let’s talk about brains
![Page 13: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/13.jpg)
Let’s talk about brains
![Page 14: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/14.jpg)
Sparse Distributed
Representations
![Page 15: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/15.jpg)
• each bit represents a neuron • on == neuron is active • each bit has semantic meaning
![Page 16: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/16.jpg)
Encoding data into SDRs
with semantic meaning
![Page 17: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/17.jpg)
Spatial Pooling
![Page 18: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/18.jpg)
Temporal Memory
![Page 19: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/19.jpg)
These are just the foundational aspects of neocortically-inspired
intelligence
![Page 20: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/20.jpg)
This is the future of AI
intelligent machines
![Page 21: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/21.jpg)
HTM School
![Page 22: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/22.jpg)
It’s all open source
Join our community
Help build truly intelligent machines
![Page 24: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/24.jpg)
LeCun
Ng
Bengio
Hinton
![Page 25: Hierarchical Temporal Memory: Computing Like the Brain - Matt Taylor, Numenta](https://reader035.fdocuments.us/reader035/viewer/2022070515/587984541a28ab6c358b615b/html5/thumbnails/25.jpg)
Jeff Hawkins