8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 1/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 2/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 3/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 4/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 5/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 6/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 7/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 8/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 9/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 10/11

8/8/2019 Amari-ig-Information Geometry- On the Hierarchy of Probability Distribution-01

http://slidepdf.com/reader/full/amari-ig-information-geometry-on-the-hierarchy-of-probability-distribution-01 11/11

AMARI: INFORMATION GEOMETRY ON HIERARCHY OF PROBABILITY DISTRIBUTIONS 1711

[12] S. Amari and M. Kawanabe, “Information geometry of estimating func-tionsin semi parametric statistical models,” Bernoulli , vol.3, pp. 29–54,1997.

[13] S. Amari, K. Kurata, and H. Nagaoka, “Information geometry of Boltz-mann machines,” IEEE Trans. Neural Networks , vol. 3, pp. 260–271,Mar. 1992.

[14] S. Amari and H. Nagaoka, Methods of Information Geometry . NewYork: AMS and Oxford Univ. Press, 2000.

[15] O. E. Barndorff-Nielsen, Information and Exponential Families in Sta-

tistical Theory , New York: Wiley, 1978.[16] C. Bhattacharyya and S. S. Keerthi, “Mean-field methods for stochasticconnections networks,” Phys. Rev. , to be published.

[17] Y. M. M. Bishop, S. E. Fienberg, and P. W. Holland, Discrete Multi-variate Analysis: Theory and Practice . Cambridge, MA: MIT Press,1975.

[18] L. L. Campbell, “The relation between information theory and thedifferential geometric approach to statistics,” Inform. Sci. , vol. 35, pp.199–210, 1985.

[19] N. N. Chentsov, Statistical Decision Rules and Optimal Inference (inRussian). Moscow, U.S.S.R.: Nauka, 1972. English translation: Prov-idence, RI: AMS, 1982.

[20] T. M. Cover and J. A. Thomas, Elements of Information Theory . NewYork: Wiley, 1991.

[21] I. Csiszár, “On topological properties of f -divergence,” Studia Sci. Math. Hungar. , vol. 2, pp. 329–339, 1967.

[22] , “ I -divergence geometry of probability distributions and mini-

mization problems,” Ann. Probab. , vol. 3, pp. 146–158, 1975.[23] I. Csiszár, T. M. Cover, and B. S. Choi, “Conditional limit theoremsunder Markov conditioning,” IEEE Trans. Inform. Theory , vol. IT-33,pp. 788–801, Nov. 1987.

[24] T. S. Han, “Nonnegative entropy measures of multivariate symmetriccorrelations,” Inform. Contr. , vol. 36, pp. 133–156, 1978.

[25] T. S. Han and S. Amari, “Statistical inference under multiterminal datacompression,” IEEETrans. Inform. Theory , vol. 44,pp. 2300–2324, Oct.1998.

[26] H. Ito and S. Tsuji, “Model dependence in quantification of spike in-terdependence by joint peri-stimulus time histogram,” Neural Comput. ,vol. 12, pp. 195–217, 2000.

[27] E. T. Jaynes, “On the rationale of maximum entropy methods,” Proc. IEEE , vol. 70, pp. 939–952, 1982.

[28] R. E. Kass and P. W. Vos, Geometrical Foundations of Asymptotic Infer-ence , New York: Wiley, 1997.

[29] S. L. Lauritzen, Graphical Models . Oxford, U.K.: Oxford Science,1996.

[30] M. K. Murray and J. W. Rice, Differential Geometry and Statis-tics . London, U.K.: Chapman & Hall, 1993.[31] H. Nagaoka and S. Amari, “Differential geometry of smooth families

of probability distributions,” Univ. Tokyo, Tokyo, Japan, METR, 82-7,1982.

[32] A. Ohara, N. Suda, and S. Amari, “Dualistic differential geometry of positive definite matrices and its applications to related problems,” Linear Alg. its Applic. , vol. 247, pp. 31–53, 1996.

[33] A. Ohara, “Information geometric analysis of an interior point methodfor semidefinite programming,” in Geometry in Present Day Science ,O. E. Barndorff-Nielsen and E. B. V. Jensen, Eds. Singapore: WorldScientific, 1999, pp. 49–74.

[34] G. Palm, A. M. H. J. Aertsen, and G. L. Gerstein, “On the significanceof correlations among neuronal spike trains,” Biol. Cybern. , vol. 59, pp.1–11, 1988.

[35] G. Pistone and C. Sempi, “An infinite-dimensional geometric structureon the space of all the probability measures equivalent to a given one,”

Ann. Statist. , vol. 23, pp. 1543–1561, 1995.[36] G. Pistone and M.-P. Rogantin, “The exponential statistical manifold:Mean parameters, orthogonality, and space transformation,” Bernoulli ,vol. 5, pp. 721–760, 1999.

[37] C. R. Rao, “Information and accuracy attainable in the estimation of statistical parameters,” Bull. Calcutta. Math. Soc. , vol. 37, pp. 81–91,1945.

[38] T.Tanaka, “Information geometryof mean fieldapproximation,” NeuralComput. , vol. 12, pp. 1951–1968, 2000.