Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

24
Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Transcript of Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Page 1: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Carlos Rodriguezon

Heat, Learning and Prediction

July 10, 2007

(52)

Page 2: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Problem:

I have a brain I observe x I want to understand x I need to predict future x'

How ?

Page 3: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Brain ?

Why ?

Page 4: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 5: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

movement brain

Page 6: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

sea squirtat home

Page 7: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

CNS for navigation

Page 8: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Bio

Phys

Math

Page 9: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 10: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 11: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 12: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 13: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 14: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 15: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 16: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

t

Truth: t(x)

Model: { p(x|)}

Geometrization of Inference

Page 17: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

I±(p®¼: t®! )

minimized when: Gibbs distribution !

negative free energy !

I G N O R A N C E

Page 18: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 19: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 20: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)
Page 21: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

** I G N O R A N C E **

minimized when

Page 22: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

OPTIMALITY OF CONJUGATE PRIORS

minimizes:

provided

Page 23: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)

Example:

need

Page 24: Carlos Rodriguez on Heat, Learning and Prediction July 10, 2007 (52)