Aristote final-20181206-pour...
Transcript of Aristote final-20181206-pour...
![Page 1: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/1.jpg)
Fin de l’ère ‘Logique binaire-‐architecture Von Neumann-‐CMOS’: tapage ou véritable
nouveau monde ?
Alain Cappy
IEMN-‐IRCICA
![Page 2: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/2.jpg)
50 years ago…. (July 21, 1969) The Apollo flight computer ü 2800 ICs, each with dual three-‐
input NOR gates ü ICs implemented using resistor–
transistor logic (RTL) ü 2048 words of erasable magne\c-‐
core memory and 36 kilowords of read-‐only memory.
ü Clock frequency: 80 kHz
ü 55W and 32kg
![Page 3: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/3.jpg)
Nowadays : the Data Deluge !
![Page 4: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/4.jpg)
Architecture for Informa\on Processing • The success of present processing machines is due to three
factors: – Boole algebra and associate algorithms – Turing machine/ Von Neumann architecture – CMOS with scalability proper\es
![Page 5: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/5.jpg)
40 Years of Microprocessor trend data
![Page 6: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/6.jpg)
The Main Limita\on: Air Fan Cooling
Pmax < 100 W/cm2
100W/cm2 = 10 \mes a hotplate !
![Page 7: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/7.jpg)
SUMMIT Supercomputer (IBM)
![Page 8: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/8.jpg)
50 years ago…. (September 27, 1968)
![Page 9: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/9.jpg)
Lee Sedol vs Alpha Go
1202 CPU 176 GPU > 300 kW
20-‐30 W
![Page 10: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/10.jpg)
The Autonomous Car
• On board processing power 50 to 100 processors ≈ 2-‐5 kW
+ Off board power ( Vehicule to Vehicule, Vehicule to infra…) es\mated at 5kWh per Gigabytes of data
![Page 11: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/11.jpg)
An Old Fashion Driven Car
• 20-‐30 W of power only, needed for the driver…
![Page 12: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/12.jpg)
End of Moore’s Law: What Next ?
!!
!
![Page 13: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/13.jpg)
What are the needs ?
• High compu\ng power
• New fonc\onnali\es. More ‘intelligence’. Processing of natural data (image, sound…..)
![Page 14: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/14.jpg)
• Why such a large wasted energy-‐power?
– CMOS ? – Von Neumann architecture ? – Binary logic ?
Ques\ons
![Page 15: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/15.jpg)
CMOS Power Dissipa\on
• Dynamics power : the state variable is a charge ( or a voltage at a capacitance terminals). Informa\on processing needs charge and discharge of capacitances
• ½ CLVdd
2 is lost at each transi\on (for constant Vdd)
• Two key parameters : CL and Vdd
CL Vdd Q=CL Vdd
![Page 16: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/16.jpg)
Interconnects and gate capacitances
Cinterconnects Cgate Cgate >>
Fetching operands costs more than compu\ng on them !
![Page 17: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/17.jpg)
![Page 18: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/18.jpg)
CMOS Power Dissipa\on
• Three reasons for the large power dissipa\on: – The state variable is a charge. Moving charges provides energy dissipa\on
– In Von Neumann architecture, memory and informa\on processing are separated. Large number of memory access to perform complex calcula\on
– MOS transistors cannot be scaled anymore. The bias voltage cannot be significantly smaller than 1 V.
![Page 19: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/19.jpg)
The post Von Neumann-‐CMOS Era
• Evolu\onary concepts: ( new switch, state variable other than charge),….. but binary logic
• Revolu\onary concepts (liquid state, quantum, neuromorphic, …
Two objec\ves: bever energy efficiency and new func\onali\es
![Page 20: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/20.jpg)
• Improved Von Neuman (Adiaba\c logic, compu\ng in memory)
• Improved switching device (new transistor, other technology)
• New state variable (New hardware) • New informa\on processing paradigm (quantum compu\ng, neuromorphic)
Evolu\onary Concepts: Possible Ways
![Page 21: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/21.jpg)
Post ‘Von Neumann-‐ CMOS’ Era
Binary
Von Neumann
CMOS
Adiaba\c logic, Compu\ng in memory
✔ ✔ ✔
New switches ✔ ✔ TFET, SET…
New state variables ✔ ✔ Dipole, molecule, spin….
Quantum Compu\ng
Quantum state Quantum Turing machine
Photons, ions, atoms, RMN, superconduc\ng
Neuromorphic Spikes ANNs, learning ✔, memristors
![Page 22: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/22.jpg)
Capacitance charging at constant voltage: an energe\c disaster!
If V= constant , Ed=1/2 CV2
The principle of adiaba\c logic is to reduce the power dissipa\on during switching using a \me variable voltage source instead of a DC-‐voltage source.
ts>>RC, Ed= 1/2CV2*(RC/ts)
V
If V(t)
![Page 23: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/23.jpg)
New Switch Zoology
• The goal is to reduce Vdd • New transistors: to decrease the threshold voltage Vth and to obtain steep switching
• Tunnel FETs (TFET) • Ioniza\on FETS (i-‐MOS) • Exitonic FETs ( ExFET) • Bilayer spin FETs ( BiSFET) • Resonant tunneling FETs (RIEFET) • Modula\on velocity transistors ( VMT)
– New switching devices • NEM Switches
![Page 24: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/24.jpg)
New transistors
Tunnel FET
![Page 25: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/25.jpg)
NEMS
2010 ISSCC Jack Raper award for outstanding technology direc\ons
![Page 26: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/26.jpg)
State variable other than charge • The problem of power dissipation is partly related to the
fact that the state variable is a charge ( E=QV). Other state variables can be proposed – Spin – photons, phonon – Quantum state – Quantum magne\c flux – Mechanical deforma\on – Dipolar orienta\on – Molecular state – …….
![Page 27: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/27.jpg)
Advanced VN Technologies
during the last decades • 1000’s of scien\sts worldwide • 1000’s of journal papers • 1000’s of conference presenta\ons No solu\on found !
![Page 28: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/28.jpg)
• Improved Von Neuman (Adiaba\c logic, compu\ng in memory)
• Improved switching device (new transistor, other technology)
• New state variable (New hardware)
New informa\on processing paradigm
Evolu\on or Revolu\on ?
![Page 29: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/29.jpg)
New Informa\on Processing Paradigms
• Non binary coding : analog, quantum, spikes… • At least two possible approaches…..
– Quantum compu\ng – Neuromorphic compu\ng
• Mul\disciplinary approach mandatory: physicist, informa\on theory, computer architecture, neuroscien\sts ….
• Proof of concepts needed at system level.
![Page 30: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/30.jpg)
Quantum Informa\on Processing
• Qbits
• The outcomes of measurements on quantum systems are random.
• Quantum systems evolve according to linear equa\ons. Solu\ons obey a superposi\on principle: linear combina\ons of solu\ons are s\ll solu\ons.
| i = ↵|0i+ �|1i
| ↵ |2 + | � |2= 1↵,� 2 C
![Page 31: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/31.jpg)
• 50 coin tosses, heads or tails
à Hundred terabytes of data storage
• 50 Qbits can store the same informa\on
Quantum Parallelism
![Page 32: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/32.jpg)
Impressive Recent Progress
![Page 33: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/33.jpg)
![Page 34: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/34.jpg)
• Several orders of magnitude slower than expected
• No quantum algorithm library • Quantum state coherence \me limited (100 µS only)
• Opera\on temperature ozen close to 0°K (-‐273 °C) !
• Quantum computers ozen resemble fundamental physics experiments !
But…
![Page 35: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/35.jpg)
This is a quantum computer …..
![Page 36: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/36.jpg)
• The most complex informa\on processing system known to date.
• 2% of the human weight but 20 % of the consumed energy
• In human, ~ 10 11 neurons and ~ 104 synapses/neurons
Neuromorphic architectures
5x104 to 105 neurons 3 x108 to 7x108 synapses 4 km of axon 0,5 km of dendrites
1 mm3
cortex
![Page 37: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/37.jpg)
Compu\ng and Communica\on
Brain
![Page 38: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/38.jpg)
Bioinspired Informa\on Processing : the Pioneers
[1] W. S. McCulloch and W. Pivs, “A logical calculus of the ideas immanent in nervous ac\vity,” Bull. Math. Biophysics, no. 5, pp. 115-‐133, 1943.
Warren McCulloch
Walter Pivs
![Page 39: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/39.jpg)
A first neuromorphic engine, the perceptron
[1] F. Rosenblav, “The perceptron: a probabilis\c model for informa\on storage and organiza\on in the brain.,” Psychological Review, vol. 65, no. 6, pp. 386-‐408, 1958.
(Robert Hecht-‐Nilsen: Neurocompu6ng, Addison-‐Wesley, 1990)
Frank Rosenblav
![Page 40: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/40.jpg)
• “The Language of the Brain is Not the Language of Mathema6cs … whatever language the central nervous system is using, it is characterised by less logical and arithme6cal depth than what we are normally used to … Consequently, there exist here different logical structures from the ones we are ordinarily used to...
(John Von Neumann, The Computer and the Brain, 1958. Published post-mortem )
John Von Neumann, also thought about neuro-computation and tried, for the first time, to construct a meaningful comparison between brain and computer power.
![Page 41: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/41.jpg)
Machine Learning
Labeled Data
Labeled Data
Machine Learning algorithm
Learned model Predic\on
Training
PredicGon
![Page 42: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/42.jpg)
Deep Learning
![Page 43: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/43.jpg)
Cor\cal Neural Network
Feedforward
Feedback
![Page 44: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/44.jpg)
Loihi Intel
130 000 neurons and 130 M synapses
![Page 45: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/45.jpg)
IBM TrueNorth architecture
1M spiking neurons and 256 M plas\c synapses
![Page 46: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/46.jpg)
IBM TrueNorth architecture
1 M neurons and 256 M synapses
![Page 47: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/47.jpg)
Neuromorphic Compu\ng
• Highs and lows during the last decades • Interest renewal for AI • Emula\on of neural networks on conven\onal computer – Rather simple architectures – Energy ques\on not addressed
• Specific hardware – Scaling up difficult – Interconnects
![Page 48: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/48.jpg)
VN-‐CMOS
L’informa\que du nouveau monde
Conclusion
![Page 49: Aristote final-20181206-pour pdfold.association-aristote.fr/lib/exe/fetch.php/archipost_vonneumann.pdf · 10 4$ synapses/neurons $$ Neuromorphicarchitectures 5x104 to 105 neurons](https://reader035.fdocuments.us/reader035/viewer/2022071002/5fbea709eab8d764cb1b3baa/html5/thumbnails/49.jpg)
Merci de votre aven\on