Universal laws and architectures - ARPA-EUniversal laws and architectures: brains, bugs, networks,...
166
John Doyle 道陽 Jean-Lou Chameau Professor Control and Dynamical Systems, EE, & BioE tech 1 # Ca Universal laws and architectures: Theory and lessons from nets, grids, brains, bugs, planes, docs, fire, fashion, art, turbulence, music, buildings, cities, earthquakes, bodies, running, throwing, Synesthesia, spacecraft, statistical mechanics
Transcript of Universal laws and architectures - ARPA-EUniversal laws and architectures: brains, bugs, networks,...
John Doyle 道陽
Jean-Lou Chameau Professor
Control and Dynamical Systems, EE, & BioE
tech 1 # Ca
Universal laws
and architectures: Theory and lessons from
nets, grids, brains, bugs, planes, docs, fire, fashion,
art, turbulence, music, buildings, cities, earthquakes, bodies, running, throwing,
Synesthesia, spacecraft, statistical mechanics
• Nets
• Grids (cyberphys)
• Brains
• Bugs (microbes)
• Medical physiology
• Lots of aerospace
• Wildfire ecology
• Earthquakes
• Physics:
– turbulence,
– stat mech (QM?)
• “Toy”:
– Lego
– clothing, fashion
• Buildings, cities
• Ants • Synesthesia
A rant
Case StudyI
App App
IPC
Global
and direct
access to
physical
address!
DNS
IP addresses
interfaces
(not nodes)
caltech.edu?
131.215.9.49
App App
IPC
Global
and direct
access to
physical
address!
Robust?
• Secure
• Scalable
• Verifiable
• Evolvable
• Maintainable
• Designable
• …
DNS
IP addresses
interfaces
(not nodes)
accessible accountable accurate adaptable administrable affordable auditable autonomy available credible process
capable compatible composable configurable correctness customizable debugable degradable determinable demonstrable
dependable deployable discoverable distributable durable effective efficient evolvable extensible fail transparent fast fault-tolerant fidelity flexible inspectable installable Integrity interchangeable interoperable learnable maintainable
manageable mobile modifiable modular nomadic operable orthogonality portable precision predictable producible provable recoverable relevant reliable repeatable reproducible resilient responsive reusable robust
safety scalable seamless self-sustainable serviceable supportable securable simplicity stable standards
compliant survivable sustainable tailorable testable timely traceable ubiquitous understandable upgradable usable
Requirements on systems and architectures
accessible accountable accurate adaptable administrable affordable auditable autonomy available compatible composable configurable correctness customizable debugable degradable determinable demonstrable
dependable deployable discoverable distributable durable effective
evolvable extensible fail transparent fast fault-tolerant fidelity flexible inspectable installable Integrity interchangeable interoperable learnable maintainable
manageable mobile modifiable modular nomadic operable orthogonality portable precision predictable producible provable recoverable relevant reliable repeatable reproducible resilient responsive reusable
safety scalable seamless self-sustainable serviceable supportable securable simple stable standards survivable
tailorable testable timely traceable ubiquitous understandable upgradable usable
efficient
robust
sustainable
Sustainable robust + efficient
accessible accountable accurate adaptable administrable affordable auditable autonomy available compatible composable configurable correctness customizable debugable degradable determinable demonstrable
dependable deployable discoverable distributable durable effective
evolvable extensible fail
transparent fast fault-tolerant fidelity flexible inspectable installable Integrity interchangeabl
e interoperable learnable maintainable
manageable mobile modifiable modular nomadic operable orthogonalit
y portable precision predictable producible provable recoverable relevant reliable repeatable reproducible resilient responsive reusable
safety scalable seamless self-sustainable serviceable supportable securable simple stable standards survivable
tailorable testable timely traceable ubiquitous understandable upgradable usable
efficient
robust
sustainable
Simple
dichotomous
tradeoff pairs
PCA Principal Concept Analysis
wasteful
fragile
efficient
robust
wasteful
fragile
efficient
robust
Layering
Feedback
Layers/feedback in biology
Working backwards
• Money/finance/lobbyists/etc
• Society/agriculture/weapons/etc
• Bipedalism
• Maternal care
• Warm blood
• Flight
• Mitochondria
• Translation (ribosomes)
• Glycolysis (see 2011 Science paper)
Robust
Fragile
Universal
laws
wasteful
efficient
Slow
Flexible
Fast
Inflexible
Robust
Fragile
Universal
laws
wasteful
efficient
Slow
Flexible
Fast
Inflexible
Robust
Fragile
Universal
laws
Slow
Flexible
Fast
Inflexible
Ideal
Fragile Architecture?
Slow
Flexible
Fast
Inflexible
Ideal
Fragile
Architecture (constraints that
deconstrain)
Slow
Flexible
Fast
Inflexible
Architecture
(constraints that
deconstrain)
General Special
Universal laws and architectures
(Turing)
ideal
Fast
Slow
Flexible Inflexible
Apps
OS
HW
Apps
OS
Hardware
Digital
Lumped
Distributed
Tech implications/extensions
Layered
Architecture
Apps
OS
Hardware
Digital
Lumped
Distributed
Any layer
needs all
lower layers.
Layered architectures 101
Apps
OS
HW
Operating System
Apps
OS
Hardware
Digital
Lumped
Distributed
OS
Diverse
Deconstrained
(Hardware)
Deconstrained
(Applications)
Diverse Horizontal
App
Transfer
Horizontal
HW
Transfer
Layered architectures
Apps
OS
HW
OS
Layered architectures
Minimal
diversity
and
change
Apps
OS
HW
Diverse
Deconstrained
Deconstrained
Diverse
Horizontal
Transfer
Horizontal
Transfer
diversity and change
diversity and change
Diverse
Deconstrained
(Hardware)
Deconstrained
(Applications)
Diverse Horizontal
App
Transfer
Horizontal
HW
Transfer
Layered architectures
Apps
OS
HW
Maximal
diversity
and
change
Diverse
Deconstrained
(Hardware)
Deconstrained
(Applications)
Diverse
Layered architectures
Constrained
But hidden
Apps
OS
HW
Core
Protocols
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Digital
Lumped Lumped.
Apps
OS
Hardware
Digital
Lumped
Act
Decide
Sense
Act
Sense
Apps
OS
Hardware
Digital
Lumped
Decide
Slow
Fast
Costly
Slow
Cheap
Flexible Inflexible
General Special
Layered
Architecture
Apps
OS
HW
Digital
Lumped
Distrib.
OS
HW
Digital
Lumped
Distrib.
Digital
Lumped
Distrib.
Lumped
Distrib.
Distrib.
Any layer needs
all lower layers.
?
Diverse
Deconstrained
(Hardware)
Deconstrained
(Applications)
Diverse
Layered architectures
Constrained
Apps
OS
HW
Minimal
diversity
Layered
architectures
make robustness
and evolvability
compatible
Ask me about
hourglasses
and bowties
App App
IPC
Global
and direct
access to
physical
address!
Robust?
• Secure
• Scalable
• Verifiable
• Evolvable
• Maintainable
• Designable
• …
DNS
IP addresses
interfaces
(not nodes)
Physical
IP
TCP
Application
“Issues” (hacks)
• VPNs
• NATS
• Firewalls
• Multihoming
• Mobility
• Routing table size
• Overlays
• …
Original design challenge?
TCP/
IP
Deconstrained
(Hardware)
Deconstrained
(Applications)
Constrained • Expensive mainframes
• Trusted end systems
• Homogeneous
• Sender centric
• Unreliable comms
Facilitated wild evolution
Created
• whole new ecosystem
• completely opposite
Networked OS
Original design challenge?
TCP/
IP
Deconstrained
(Hardware)
Deconstrained
(Applications)
Constrained Incomplete
• Layering (IP)
• Feedback (TCP)
• No theory
Networked OS
Chiang, Low, Calderbank, and Doyle
wasteful
fragile
efficient
robust
Layering
Feedback
?
Deconstrained
(Hardware)
Deconstrained
(Applications)
Next layered arches (SDN? OpenDaylight?)
Constrained Optimize: control, share,
virtualize, manage resources
Comms
Memory, storage
Latency
Processing
Cyber-physical
Few global variables
Don’t cross layers
?
Deconstrained
(Hardware)
Deconstrained
(Applications)
Next layered architectures
Constrained Optimize: control, share,
virtualize, manage resources
Comms
Memory, storage
Latency
Processing
Cyber-physical
Fast
Slow
Flexible Inflexible
Vision
Explain this
amazing
system.
Layering
Feedback
Robust vision with motion
Vision
Motion
• Neuroscience motivation
Experiment • Motion/vision control without blurring
• Which is easier?
Fast
Slow
VOR
vision
Why?
• Mechanism
• Tradeoff
Fast
Slow
Flexible Inflexible
VOR
vision
Vestibular
Ocular
Reflex
(VOR)
Mechanism
Tradeoff
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
Slow
Flexible
eye
Act
Fast
Inflexible
VOR
fast
Vestibular
Ocular
Reflex
(VOR)
Slow
Flexible
eye
Act
Fast
Inflexible
VOR
fast
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
vision
eye vision
Act slow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
Highly
evolved
(hidden)
architecture
Layering
Feedback
eye vision
Act
VOR
Layering
Automatic
Unconscious
Partially
Conscious
eye vision
Act slow
delay
VOR
fast
Layering
Feedback
vision
eye vision
Act slow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
fast Architecture
Layers/feedback in biology
Working backwards
• Money/finance/lobbyists/etc
• Society/agriculture/weapons/etc
• Bipedalism
• Maternal care
• Warm blood
• Flight
• Mitochondria
• Translation (ribosomes)
• Glycolysis (see 2011 Science paper)
Universal laws and architectures: brains, bugs, networks, physiology,
grids, medicine, wildfire, turbulence, literature, fashion, dance, earthquakes,
art, music, Lego, buildings, cities vision
Act
delay + Neuroscience
Balancing
an inverted
pendulum
Mechanics+
Gravity +
Light +
2 2
0
1ln
ln
pT j d
p
z pp
z p
easy
Law #1 : Mechanics
Law #2 : Gravity
2cos sin
cos sin 0
sin
M m x ml u
x l g
y x l
&& &&&
&&&&
0
M m x ml u
x l g
y x l
&&&&
&&&&
linearize
easy
hard
Law #1 : Mechanics
Law #2 : Gravity
2cos sin
cos sin 0
sin
M m x ml u
x l g
y x l
&& &&&
&&&&
0
M m x ml u
x l g
y x l
&&&&
&&&&
linearize
Crashes
can be
made rare
with active
control.
hard harder
Easy to prove using simple models.
Why? vision
Act
delay
Law #3 : Light
0
y x
M m x ml u
x l g
l
&&&&
&&&&
eye vision
slow
Act
delay
Control
l
1p
l
noise error
E
T jN
Universal laws and architectures: brains, bugs, networks, physiology,
grids, medicine, wildfire, turbulence, literature, fashion, dance, earthquakes,
art, music, Lego, buildings, cities vision
Act
delay + Neuroscience
Balancing
an inverted
pendulum
Mechanics+
Gravity +
Light +
2 2
0
1ln
ln
pT j d
p
z pp
z p
1
2
4
8
.1 1
Length l (meters)
.05 .5 .2
1p
l
Fragility
p .3s
2 2
0
1 2ln
pT j d p
p
Law #4 :
.1s
1
2
4
8
.1 1
Length l (meters)
.05 .5 .2
1p
l
Fragility
p .3s
2 2
0
1 2ln
pT j d p
p
Law #4 :
.1s
Shorter
1
2
4
8
.1 1
Length l (meters)
.05 .5 .2
1p
l
Fragility
p .3s
2 2
0
1 2ln
pT j d p
p
Law #4 :
.1s
hard harder hardest!
Easy to prove using simple models.
What is sensed matters.
Why?
hard harder hardest!
What is sensed matters.
Unstable poles Unstable zeros
0l l0l l
hardest!
0l l
2 2
0
l1
n n2
lz pp
T j dp p
pz
0l l
1
2
4
8
.1 1 .05 .5 .2 Length (meters)
Fragility
lnz p
p
p
z
.1s
2 2
0
l1
n n2
lz pp
T j dp p
pz
.3s
0 1l l
0l l
Sense (Measure
Length
l0, m)
Length l to CoM, m
0.2 0.4 0.6 0.8 1
0.4
0.6
0.8
1
1.2
1
1.5
2
2.5
3
3.5 easy
hard
hard
robust
(easy)
fragile
(hard)
Sense (Measure
Length
l0, m)
Length l to CoM, m
0.2 0.4 0.6 0.8 1
0.4
0.6
0.8
1
1.2
1
1.5
2
2.5
3
3.5
hard hard
robust
(easy)
hard!
0l l
easy
vision
Act
delay
2 2
0
1ln
ln
pT j d
p
z pp
z p
Holds for all controllers.
Like Turing, a “law” about intrinsic problem difficulty.
Select instabilities in biology
Working backwards
• Money/finance/lobbyists/etc
• Society/agriculture/weapons/etc
• Bipedalism
• Maternal care
• Warm blood
• Flight
• Mitochondria
• Translation (ribosomes)
• Glycolysis (see 2011 Science paper)
Chandra, Buzi, and Doyle
UG biochem, math, control theory
Most important paper so far.
easy
hard
Law #1 : Mechanics Chemistry
Law #2 : Gravity Autocatalysis
k
z p
z p
10 -1
10 0
10 1 10
0
10 1
too
fragile
complex
No tradeoff
expensive
fragile
2 2
0
1ln
ln
zS j d
z
z p
z p
Law #1 : Chemistry Law #2 : Autocatalysis
Law #3:
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l
Length (meters)
Fragility
lnz p
p
p
z
.1s
k
z p
z p
10 -1
10 0
10 1 10
0
10 1
too
fragile
complex
No tradeoff
expensive
fragile
eye vision
Act
slow
VOR
fast
Act
delay
Balancing
an inverted
pendulum Control
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l
Length (meters)
Fragility
lnz p
p
p
z
.1s
Slow
Flexible
Fast
Inflexible
General Special k
z p
z p
10 -1
10 0
10 1 10
0
10 1
too
fragile
complex
No tradeoff
expensive
fragile
Universal
laws
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l Fragile
.1s
Slow
Flexible
Fast
Inflexible
General Special
k10 -1
10 0
10 1 10
0
10 1
expensive
fragile
Slow
Slow
Flexible
Fast
Inflexible
Robust
Fragile
Slow
Flexible
Fast
Inflexible
General Special
Universal
laws
Slow
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l Fragile
.1s
k10 -1
10 0
10 1 10
0
10 1
expensive
fragile
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l Fragile
.1s
Slow
Flexible
Fast
Inflexible
General Special
k10 -1
10 0
10 1 10
0
10 1
expensive
fragile
Slow
Universal laws
and architectures: nets, grids, brains, bugs, bodies, doctors, fire, fashion,
art, turbulence, music, buildings, cities, earthquakes, planes, running, throwing,
Synesthesia, spacecraft, statistical mechanics
Slow
Flexible
Fast
Inflexible
General Special
Slow
Flexible
Fast
Inflexible
General Special
Universal Turing Machine
Fast
Slow
Flexible Inflexible
Apps
OS
HW
Apps
OS
Hardware
Digital
Lumped
Distributed
Tech implications/extensions
Act
Sense
Apps
OS
Hardware
Digital
Lumped
Decide
Slow
vision
Act
delay
vision
Act
delay
+ Neuroscience
Completing the story
Balancing
an inverted
pendulum
Mechanics+
Gravity +
Light +
2 2
0
1ln
ln
pT j d
p
z pp
z p
Speed and
flexibility
tradeoffs
Concrete case studies? Theorems ?
Fast
Slow
Flexible Inflexible
fragile
robust
Slow
Flexible
Fast
Inflexible
Robust
Fragile
Cheap
Expensive
Efficient vs Robust
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
eye vision
Act slow
VOR
fast
Act
delay
Balancing
an inverted
pendulum Control
1
2
4
8
.1 1 .05 .5 .2
0l l
0 1l l
Length (meters)
Fragility
lnz p
p
p
z
.1s
Slow
Flexible
Fast
Inflexible
General Special
eye vision
Act
slow
VOR
fast
Act
delay
Balancing
an inverted
pendulum Control
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
3D + motion
color
vision
Slowest
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
B&W (luminence only): 3D, motion, and action
3D + motion
This is pretty good. Stare at the intersection
This is pretty good. Stare at the intersection
Slow
Flexible
vision
eye vision
Act slow
delay
Fast
Inflexible
VOR
fast
3D + motion
color
vision
Slowest
Slow
Flexible
vision
Fast
Inflexible
VOR
color
vision
Seeing is dreaming
- 3d+motion
B&W
slow
VOR
fast
Fast
Slow
Flexible Inflexible
slower
Objects
Mixed
Chess experts
• can reconstruct entire
chessboard with < ~ 5s
inspection
• can recognize 1e5 distinct
patterns
• can play multiple games
blindfolded and simultaneous
• are no better on random
boards
(Simon and Gilmartin, de Groot)
www.psywww.com/intropsych/ch07_cognition/expertise_and_domain_specific_knowledge.html
- 3d+motion
B&W
slow
VOR
fast
Fast
Slow
Flexible Inflexible
Faces
slower
Objects
Mixed
Not sure how to draw this…
vision
eye vision
Act slow
delay
VOR
Slow
Flexible
Fast
Inflexible
Illusion
Highly
evolved
(hidden)
architecture
Seeing is dreaming
3D +time
Simulation
+ complex
models
(“priors”)
Seeing is dreaming
Conscious perception
Conscio
us
pe
rcep
tio
n
errors
Prediction
&Control
Fast
Costly
Slow
Cheap
Flexible Inflexible
General Special
Other dimensions?
1x
2x
3x
Model?
• 1 dimension, 4 states?
• Other 2 dimensions?
• New issues arise
eye vision
Act
delay
Control
noise error
E
T jN
1x
2x
3x
eye vision
Act
delay
Control
noise error
E
T jN
1x
2x
3xeasy
easy
hard
eye vision
Act
delay
Control
noise error
E
T jN
1x
2x
3xeasy
easy
hard
Main lessons
• Theory: hard limits on closed loop
performance, aggravated by
– Instability (unstable poles)
– Delay
– Unstable zeros
• Neuroscience specific
Instabilities in technology
• Efficiency
• Autocatalysis
• The future
Select instabilities in biology
Working backwards
• Money/finance/lobbyists/etc
• Society/agriculture/weapons/etc
• Bipedalism
• Maternal care
• Warm blood
• Flight
• Mitochondria
• Translation (ribosomes)
• Glycolysis (see 2011 Science paper)
sensor
controls
external
disturbances
heart rate
ventilation vasodilation
coagulation
inflammation
digestion
storage
…
errors
O2
BP pH
Glucose
Energy store
Blood volume
…
infection
trauma energy
Homeostasis
internal noise
heart beat
breath
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Sensory Motor
Prefrontal
Striatum
Reflex
Software
Hardware
Digital
Analog
Horizontal
Gene
Transfer
Horizontal
App
Transfer
Horizontal
Meme
Transfer
OS
Linux kernel map OS
User
interface System Processing Memory Storage Network
User space
interfaces
Virtual
Bridges
Logical
Device
control
Hardware
Interfaces
Hardware
Linux kernel map
SW Layer
SW Layer
SW Layer
SW Layer
SW Layer
SW Layer
User
interface System Processing Memory Storage Network
User space
interfaces
Virtual
Bridges
Logical
Device
control
Hardware
Interfaces
Hardware
User space
interfaces
Virtual
Bridges
Logical
Device
control
Hardware
Interfaces
Hardware
User
interface System Processing Memory Storage Network
Functions
use all layers
User peripherals
I/O CPU Memory Disk controller
Network controller
Outfit
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Outfit
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
functions
robust
costly
fragile
cheap
Outfit B
ase
Insu
latio
n
Sh
ell
Body Environment
Layering & Modularity 1.0
Outfit
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Architecture, Layering & Modularity 2.0
OS
Layered architectures
Minimal
diversity
and
change
Apps
OS
HW
Software
Hardware
Digital
Analog
Cloth
Thread
Fiber
Cloth
Thread
Garments
Components
Organized
Components
Organized
What is the “true functional unit?”
Virtual machines
Software
Hardware
Digital
Analog
Cloth
Thread
Fiber
Cloth
Thread
Garments
Components
Organized
Components
Organized
Organized Software Garments
Implementations
Virtual machines
Digital
Analog
Thread
Fiber
Cloth
Thread Components
Organized
Implementations
Organized Software Garments
Digital Cloth Organized
Virtual Outfit
Garment Garment Garment
Physical connectivity
Fiber Fiber Fiber
Outfit
Cloth
Thread
Fiber
Cloth
Thread
Garment
Cloth
Thread
Fiber
Cloth
Thread
Garment
Virtual
Physical
Ga
rme
nt
Ga
rme
nt
Ga
rme
nt
Outfit
Cloth
Thread
Fiber
Garment
Garm
ent
Cloth
Thread
Fiber
Garment G
arm
en
t
Cloth
Thread
Fiber
Garment
Layering within garments (textiles)
Doyle, Csete, Proc Nat Acad Sci USA, JULY 25 2011
For more info Most accessible
No math References
Slow Apps
HW
Implementation
Control of function
Flexible
General
Fast
Inflexible
Special
Fast
Slow
Flexible Inflexible
General Special
Apps
OS
HW
Horizontal
App
Transfer
Horizontal
HW
Transfer
Fast
Costly
Slow
Cheap
Flexible Inflexible
General Special
Layered
Architecture
Apps
OS
HW
Digital
Lumped
Distrib.
Any layer needs
all lower layers.
Digital
Lumped
Distrib.
You can control function
in hardware alone.
Lumped
Distrib.
Distrib.
Hardware
Digital
Lumped
Distributed
- 3d+motion
B&W
slow
VOR
fast
Fast
Slow
Flexible Inflexible
Faces
slower
Objects
Mixed
Not sure how to draw this…
Sensory Motor
Prefrontal
Striatum
Slow
Flexible
Learning
Ashby & Crossley
Slow
Reflex (Fastest,
Least
Flexible)
Extreme heterogeneity
Sensory Motor
Prefrontal
Striatum
Fast
Fast
Inflexible
Slow
Flexible
Reflex (Fastest,
Least
Flexible)
Ashby & Crossley
Learning can
be very slow.
Sense
Universal tradeoffs?
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Reflex
Learning can
be very slow.
Evolution is
even slower.
Sense
Fast
Slow
Flexible Inflexible
Motor
Prefrontal
Fast
Reflex
Apps
OS
HW
Prosen-
cephalon
Telen-
cephalon
Rhinencephalon,
Amygdala,
Hippocampus,
Neocortex, Basal
ganglia, Lateral
ventricles
Dien-
cephalon
Epithalamus,
Thalamus,
Hypothalamus,
Subthalamus, Pituitary
gland, Pineal gland,
Third ventricle
Brain stem
Mesen-
cephalon
Tectum, Cerebral
peduncle, Pretectum,
Mesencephalic duct
Rhomb-
encephalon
Meten-
cephalon
Pons,
Cerebellum
Myelen-
cephalon
Medulla
oblongata
Spinal cord
CNS HW
“stack”
?
Diverse?
Deconstrained
(Hardware)
Deconstrained?
(Applications)
Diverse
Layered architectures??
Constrained Brain
0. HGT
1. DNA repair
2. Mutation
3. DNA replication
4. Transcription
5. Translation
6. Metabolism
7. Signal transduction
8. …
Apps
OS Hardware
Digital
Lumped
Distributed
Any layer
needs all
lower layers.
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Fast
Costly
Slow
Cheap
Flexible Inflexible
General Special
HGT DNA repair Mutation DNA replication
Transcription Translation
Metabolism Signal…
Layered
Architecture
Slow
Fast
Flexible Inflexible
General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib.
Distrib.
HGT DNA repair Mutation DNA replication Transcription Translation Metabolism
Signal
Sense Motor
Prefrontal
Fast
Reflex
vision
VOR
Slow
Fast
Flexible Inflexible
General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib.
Distrib.
HGT DNA repair Mutation DNA replication Transcription Translation Metabolism
Signal
Sense Motor
Prefrontal
Fast
Reflex
VOR
Many systems/organisms only use lower layers
Lumped Distrib.
Distrib.
Metabolism Signal
Sense Motor Fast
Reflex
VOR
Many systems/organisms only use lower layers
Analog
Red blood cells
Most metazoans
Slow
Fast
Flexible Inflexible
General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib.
Distrib.
Ideal?
Sense Motor
Prefrontal
Fast
Reflex
vision
VOR
Can a new architecture beat the tradeoff?
Slow
Fast
Flexible Inflexible
General Special
Apps OS HW Dig. Lump. Distrib.
OS HW Dig. Lump. Distrib.
Digital Lump. Distrib.
Lumped Distrib.
Distrib.
Sense Motor
Prefrontal
Fast
Reflex
vision
VOR
Be careful what you wish for…
Apps
OS
HW
Digital
Lumped
Distrib.
OS
HW
Digital
Lumped
Distrib.
Digital
Lumped
Distrib.
Lumped
Distrib.
Distrib.
VOR
Slow
Fast
Flexible Inflexible
General Special
Be careful
vision
?
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Sensory Motor
Prefrontal
Striatum
Reflex
Software
Hardware
Digital
Analog
Horizontal
Gene
Transfer
Horizontal
App
Transfer
Horizontal
Meme
Transfer
control feedback
RNA
mRNA
RNAp
Transcription
Other Control
Gene
Amino
Acids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Horizontal Gene
Transfer
Sequence ~100 E Coli (not chosen randomly) • ~ 4K genes per cell • ~20K different genes in total (pangenome) • ~ 1K universally shared genes • ~ 300 essential (minimal) genes
Clinical issue: antibiotic resistance?
control feedback
RNA
mRNA
RNAp
Transcription
Other Control
Gene
Amino
Acids
Proteins
Ribosomes
Other Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Sensory Motor
Prefrontal
Striatum
Reflex
Software
Hardware
Digital
Analog
Horizontal Gene
Transfer
Horizontal App
Transfer
Horizontal Meme
Transfer
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
Sensory Motor
Prefrontal
Striatum
Reflex
Software
Hardware
Digital
Analog
Enable
“vertical”
innovation
Mechanisms for
Horizontal Transfer
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Horizontal
Gene
Transfer
What can
go wrong?
control feedback
RNA
mRNA
RNAp
Transcription
Other
Control
Gene
Amino
Acids
Proteins
Ribosomes
Other
Control
Translation
Metabolism Products
Signal transduction
ATP
DNA
New
gene
Sensory Motor
Prefrontal
Striatum
Reflex
Software
Hardware
Digital
Analog
Horizontal
Gene
Transfer
Horizontal
App
Transfer
Horizontal
Meme
Transfer
What can
go wrong?
Horizontal
Bad Gene
Transfer
Horizontal
Bad App
Transfer
Horizontal
Bad Meme
Transfer
Parasites
&
Hijacking
Fragility?
Exploiting
layered
architecture
Virus
Virus
Meme
Fast
Costly
Slow
Cheap
Flexible Inflexible
General Special
Layered
immunity
Adaptive
OS?
Innate
Vaccination ≈ horizontal transfer?
