McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/...

27

Transcript of McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/...

Page 1: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

������������ ��� ����������������������� � �!" ���#��� #�����%$

&('*)�',+.-"/10*2436578-"/19-:0#;�<>=:?A@B<>=DCE243>3F=.<G=:CH@BIJ/*3LKNM�3

78-.3OIJKP0*Q.R>=S0#T(0JKPU.2�<V3WKXRO/.Y[Z.R4']\^=S_JK`3badc�YeT�'fZe'hgi'

j�kmlmnpoOq.r"nVs 7t2(3OI*=:?�I*=u?vRwI*2xMwIe-:<V-.M6R>2�<y=:Cz-�3>MwKP2�0JROKf{|MGR>I*2�=.<w/�}J2�~e2�0e}*3�=.0i=.0*2.��3y-:R>ROKPR>_e}J2GR>=:?(-:<V}b~*<w=.�e-:��JKf�fKXRO/.'Ga�-:01/iMwKP<VM6_*9!3ORV-D0eM6243]3O2�2�9�9�/*3OR>2�<FKX=S_e3y=.<]~e-:<6-.}J="�1KNM�-"�eR>=�=S0*2(?(I*=�R>IJKP0*�*3BR>Ie-:RB~*<w=.�e-:�JKf�fKXRFKX243�-:<>2<>24-"�e~*IJ/*3LKNM�-"�z~*<>=.~e2�<wROKP243]26�JKN3OROKP0*Q�KP0��b-:R>_*<>2.'B��_*R]?�I*2�0!?G2�-.}J=S~*RBR>I*2����x-"/.243WK`-D0 ��0JCp2�<>2�0eM624��U.KP2�?(~,=:KP01R=:CH�b-:<>=D�`}+:26�z<>2�/*3�YJ~e-:<V-.}J="�*243B=:CpR>2�0�e24M6=.9�2�3LKP9 ~J�P2�~J�`-DROKPR>_e}J243(-:0e}�?G2�Ie-"U.2�-�9 =.<>2(~,=:?x2�<FCE_J�zR>=J=:�eCp=.<_e3O26Cp_J�xM�-"�NM6_J�N-:ROKP=.0e3�'i)GIJKN3bKN3�Kf�f�X_e3FR><V-:R>24}d�J/�R>I*<>2�2i26��-D9 ~J�P243bCp<>=.9�?GKN}J26�X/�}SK��z2�<>2�0JRb{e26�N}*3 s }SKf��_e3WKX=S0�KP0�SKX0*2�RFK`MRwI*2�=.<>/.YzRwI*2!&yKP0e3OR>26KP0J��@y=*}J=:�N3O�J/.�*�G=13O2�0��W&�@]�b�b~e-:<V-.}J="��KX0v�S_e-:01Rw_*9�R>I*2�=.<w/.YH-D0e}�R>I*2!3O24M6=S0e}�N-"? =:CBR>I*2�<>9 =*}J/10e-D9iKNM�3GKP0#�JKP=:�P=.QS/.'

�O��)��(c�¡�T¢;x)bc��[£ ��&]a�g¤��¥�Z ¦)���&§atc�)¨��©yg])G�>c�� ¦

¡b�OªBªBT�Z.�wc�� «¡b�wZ*;xT¢Z*Z.�>c�� ¬)���&­a#�O��¡ @���c�+.&G;x)¨�>c�� ªJg�\z\^g¢;]£ ®

��g�;G¥�¯��(c�Tb�b¡ c�ª°&]@�� ®;�c���ªB��c��b)zg])G�wc�� c�� �(&G;�c���;]�O\^��g])¨�>c��¢± ²&�@]� ³)���&­�x&�\z\´�W�b&Gµ�T�g¤\^�O)G�W&¨Z ¶4·�G&��(��c�Tb\z\^�6�fZ�T���� �(&B©b�>Z.�O)(&]¡ ¶4«c�)���&�� ���W¡�¡�&��G�1©yg��G��g��G\z& )(�b&Gc��G�O&GZ ¶�¸

)���&¹Z1&G;(c��b¡ \^gy7 �W� ���>c�\Hc�¯�£ ¶4º¯�&]�b&]�Gg�\^�wZ1&]¡ &�ªBªy�>;]�O&]�¢;]£ ªBc��(a�Tb\^g ¶:®)���&­�(&Bg�Z*c�� ª�c��»�W) ¶4²µ�T�g���)G�O)zg])¨��©�& ¡�&]�G�L©¼g])¨�>c�� ¦.·g ;x�b&G;x¥ ¦.«;�c���;x\[T�Z.�wc�� ¦:¸

��&]ªB&]��&]�¢;x&GZ ¦.º

$8½y¾.¿yÀ4ÁJ¿VÂSÃ�ÂSÄxÅOÆ�ÇfÈxÆ�ÅeÅL¾.¿HÉSÊ Å�¾(ËpÂ:Å�¿6Ì�ÂJÆ�Å�ÃfÀ"Â1Æ�Ç1Í�ÎGÏ(мÑG½�Ò!À"Ì�È:ÓO¾.À4Á,ÔuÕ:Å6Ö^×:À4¾.ÂeÊ Ó^ØyÀ4ÇfÇf¿VÄ"¿uÔ6ØBÆ�Ù�Ú.ÌLÃ�ÛSÄ4¿:ÔmÐ[Â.Ä"ÇXÆ�Â.ÛeÔÎGÜ.Ä4ÜSÓWÅyÝOÞ�ß.Ô:ÝVà"É4ÉSÖeËpÂbÅ�¾.¿Bá[Ì�À:âV¿6¿6Û.ÃfÂ.Ä4Ó,ãzÀ4ÇfÜ.Ù�¿uÔ�ä�å6æ�çPèbé.è�ê¼ëSìEíOîOï1ð(å�ë�ñ�òxå�ð4óOô>çNå�ë�ä�óFìöõDî6ñ6ô4Ô"×�Ö6Õ:È:ÃfÇ�ÇfÃfÂ.ÄJÔmÐ[Û.ÃfÅ�À"ÌVÔ÷ ÇfÜ:ø¼¿6ÌBÎGâmÆ�Û.¿6Ù�Ãfâxá[Ü.Ú.ÇfÃfÓO¾.¿VÌLÓ�Ô.ù]À"Ì�Û.ÌL¿Vâw¾uÅûúDü�À4ÇfÇPÆ�ÂSÛ�ýWÝ6à4É4à"þ>ÔSÁ.ÁeÖeÝFúDÿ��.Ö5 ÍÆ�ÃfÇfÃ�ÂSÄ�ÎGÛ.Û.ÌL¿VÓOÓ��zØBÆ�Ù�Á.Ü.Ó��yÀ����iÝ"Ý4ßSÔ.Ò�Æ�ÓO¾.ÃfÂ.Ä"Å�À4Â���Â.Ã� 4¿6Ì�ÓOÃfÅ��4Ô,Ý��yÌLÀuÀ"È:Ã�ÂSÄ4Óxù�ÌLÃ� "¿uÔ.ÕDÅVÖ���À4Ü.ÃfÓ]Í������.Ý��.Ö

Page 2: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦ ¦

��#����������i�i� �b� �!�b� ����� �c(_*< Q.<w=._*~vIe-.3�R>I*2�I*=.0*=._*<�R>=��e2 -D9 =.0*Q�R>I*2{e<V3ORiR>=�_e3O2�RwIJK`33O~J�P2�0e}SKN}§0*2�? ª[KN3OI*2�< �*_JKf�N}SKX0*Q§?GKPR>IKPRV3b«.·.· 3O24-DR¤-:_e}SKPR>=S<OKP_*9#'���_*Rb~e2�<>Ie-:~e3�Y|-:Rb- 9 2�2�RFKX0*Q#M6=S0eM62�<>0*24}�?GKPR>I �G-"/.243LKN-:0%KX0JCp2�<>2�0eM62.Y^?G2�3FI*=._J�N}Mw�N-:<OKfCp/�?(IJKNM>I�ª[K`3FI*2�<(KP0e3O~JKP<>24}�R>Ie-:RG0e-:9�2.'

Z.R"' +:=.I*0z��3�;�=:�f�X2�QS2 ?(-.3�Cp=._*0e}J24} KP0 R>I*2�/.24-:<�¶4º*¶S¶.Y�KPRV3�CE=S_*0e}J<>243>3�e26KP0*Q§R>I*2t\z-.}J/ a�-:<>Q1-:<w2�R��24-:_JCp=.<>R4'B+:=.I*0#ª[KN3OI*2�<G?(-.3�R>I*2�0�;]Ie-:0eM626�f�P=.<b=:CzR>I*2�T(0JKPU.2�<63LKPRW/�=:C];x-:9i�*<OKN}JQ.2.Y*-:0e}-"CpR>2�<GI*2�<(}J24-:R>I�I*2Cp=._*0e}�IJKP9!3O26�fC�=.�J�fKPQ.24}�R>=�9-:�.2iI*2�<>=:KNM�26��=S<>RV3bR>=�2�0e3O_*<w2 R>Ie-:R�I*2�<�?GKN3OI*243�?x2�<w2!M�-:<><OKP24}�=S_*R4'!��_*R�Cp=.<R>I*=13F2�26��=S<>RV3�YJ9!-.}J2�3F=.9 2�¸1².·�/.24-:<V3(-DQ.=eY,Z.R4']+:=SI*0z��3�;�=:�f�X2�QS2�?G=._J�N}�0*=.R�26�1KN3ORbR>=*}*-4/.'��GKN3OR>=S<OKN-:0e3GIe-"U.23O_*Q.QS243OR>24}�R>Ie-:R4Y[�*_*RbCE=S<�R>I*2 26�z=.<>RV3�=:C(+:=.I*0vª[K`3FI*2�<�KP0tI*=:�N}SKP0*Q�R>IJKP0*Q13�R>=SQ.2�R>I*2�<�R>I*<>=S_*Q.It-R>_*<>�*_J�P2�01R~e2�<FKX=*}^Y,R>I*2�2�01RFKX<w2�T�0JKXUS2�<V3LKPRO/�=:Cx;G-:9i�*<OKN}JQ.2�9iKPQ.IJR(0*=.R(26�JKN3OR(R>=*}*-"/.'

g��PR>I*=._*Q.I�R>I*2]Rw2�<>9!3G���G-4/S243LKN-:0e�(-:0e}��a�-"�1KP9i_*9 &B0JR><>=.~J/��G-:~*~,24-:<y~*<>=.9iKP0*2�0JRO�P/�KP0iR>I*2x-:0*0*=S_*0eM62��9 2�0JRV3b=:C]=._*<�9�2�2�ROKP0*Q13�Y^=._*<�26�z=.<>R63�-:<w2�3O=.9�2�?(Ie-:Rb9 =.<>2iQ.2�0*2�<V-u�û'�Z.RV-:R>24}��*<>=1-S}S�X/.Y[?G2�-:<>2 M6=.0eM62�<w0*24}?GKPR>I RwIJK`3 s �m7 Ie-DR]-:<>2GR>I*2(R>I*2�=S<>2�ROKNM�-"�f�P/ Uu-"�fKN}^Y*-:0e}i~*<V-DQ.9!-:ROKNM�-"�f�P/i_e3O26Cp_J�ûYJ?(-"/�3[=:C¼-:~*~J�P/SKX0*Qi~*<>=S�e-:�JKf��KPRO/R>I*2�=.<w/ KP0 3wMwKX2�0eM62:±��

)¨I*2�0*2�? -.}JU:-:0eM6243�=:C�M6=S0eM62�<>0#R>=�_e3��e=:?�CE<w=.9 R>I*2�<>24M6=SQ.0JKPROKP=.0#R>Ie-DR4YJKP0 -"�P9 =J3OR�-"�f�¼<>243F~e24M6RV3�R>Ie-:R9!-:RwR>2�<4YBR>I*2�M6=.<><>24M6R-:0e3O?G2�<V3i?G2�<>2�Q:KPU.2�0§I*2�<>2�KP0 Z.R4' +D=.I*0z��3;]=D���P2�Q.2�3O=.9 2%{*CERO/�/.24-:<V3i-:QS=eY]�J/§Z:KX<�b-:<>=:�N} +:26�z<>2�/*3�']��2�3OR6-:R>24}iR>I*2�Q.2�0*2�<V-"�^~*IJK��P=13F=.~*I1/�=:Cz?(Ie-:Rx3wMwKX2�0JROKf{|M¨KX0JCp2�<>2�0eM62bKN3�YSCp_J���P/�-:0e} M6=.<w<>24M6RO�P/.YCp=.<iR>I*2�{e<V3FR�RFKX9�2���-:0e}�R>I*2�0§~*<>=*M62�24}J24}vR>=8M�-D<><>/t�,=.R>IvR>I*2�9!-:R>I*2�9!-DROKNM�-"�(R>I*2�=.<>/v-:0e}dKPRV3i~*<V-SM6ROKNM�-"�KP9 ~J�P2�9 2�0JRV-:ROKP=.0%Cû-:<wR>I*2�<(R>Ie-:0#-D01/.=S0*2�M�-:0��e26�fKP2�U.2iR>=*}*-4/.Y�?(I*= Ie-.3G0*=SR�3OR>_e}SKP24}�IJKN3�?G=.<>�*3�'

)¨I*2�KN}J24-.3�?G2�<>2 3O_*�*RO�P2.Yy-:0e}�KPR�<>24�S_JKX<w24}8-��P=.0*Q�ROKP9 2�CE=.<�RwI*26KX<�9 2�<OKPR�R>=��,2!-:~*~*<>24MwKN-:R>24}��y�*_*R�?G2M�-:0�RV-D�.2¤3w-:ROKN3LC�-.M6ROKP=.0KP0#�J0*=:?GKP0*Q R>Ie-:RbZ:KP<¤�b-:<>=D�`}Ie-S3��fKXUS24}�R>= 3O2�2�-i/S=._*0*Q.2�<(Q.2�0*2�<6-:ROKP=.0�=:CH3wMwKX2�0JROKN3ORV324-:Q.2�<F�X/i<>24-S}SKX0*Q,Y�-D0e}i~*<>=:{eROKP0*Q��1/.YJIJKN3B?G=.<>�^'y��0�Z.2�~*Rw2�9��,2�<�¶4³.².«b�yIe-.} -¤�X=S0*QeY*}J26��KPQ.IJROCp_J��M6=.0JU.2�<V3w-:ROKP=.0=:U.2�<GR>24-i?GKPR>IdZ:KP<���-D<>=:�N}#-:0e}�\[-.}J/#+:26�z<>2�/*3�Ye-:0e}�J0*=:? I*=:? ~J�P24-.3F24}#RwI*2�/!�,=.R>I�?G2�<>2.'

�L9 ~e=S<>RV-:0JRi~*<>=.Q.<>243w3bKN3i0*=:? �e26KP0*Q89-.}J2 KP0v9!-D01/8-D<>24-.3�=:C¤3>MwKP2�0eM62��1/8-S}J=.~*ROKP0*Q�R>I*2�U.KP2�?(~,=:KP01R-:0e}%26��R>2�0e}SKP0*QR>I*2�9�2�R>I*=�}*3�=:C]��-D<>=:�N}#+:26�z<>2�/*3�'G&BU.2�0�RwI*=13O2�=:C]_e3G?�I*=!?G2�<>2b�P=.0*Q�3LKP0eM62�M6=.0JUSKX0eM624}�=:CR>I*26KP<(R>I*2�=S<>2�ROKNM�-"�¼9 2�<FKXR(-:<w2�=:CERw2�0�-.3FR>=.0JKN3OI*24}�Rw=�}SKN3>M6=:U.2�<GR>I*2�-D9 =._*0JRx=DC¼01_*9�2�<OKNM�-"�zKP9 ~*<>=:U.2�9 2�0JR(=:U.2�<�6=.<wR>I*=�}J="�e��3ORV-:RFK`3FROKNM�-"�|9 2�RwI*=�}*3�YSR>Ie-:R�R>I*2�/ M�-:0 /SKX26�N}?(I*2�0~*<>=.QS<V-:9 9 24}�KX0JR>=iM6=.9 ~*_*R>2�<V3�'¼�LR�K`3�Ie-:<V}S�P/2�U.2�<(3O9!-u���z26�eM62�~*RGKP0!Rw<OKPU.KN-"�¼~*<w=.�J�P2�9!3�Y*-:0e}0*=.0JR><OKPUSK`-u�[M�-S3O243�Ie-4US2¤M6=.9�2�_*~?(I*2�<>2�R>I*2�/�/.KP26�N}�=.<6}J2�<V3B=:C9!-:QS0JKXRw_e}J2��e2�RwR>2�<�3O2�0e3LKPROKPUSKPRW/#-D0e}�<>243O=D�X_*RFKX=S0�KP0#26�*R><V-.M6RFKX0*Q�KX0JCp=.<>9-:ROKP=.0Cp<>=.9 }*-:R6-*'

)¨IJK`3�9 24-D0e3�R>Ie-:RbKP0v3O=.9 2-:<>24-.3�Yy3O_eMwI -.3¢9!-:Q.0*2�RFK`M�<>243O=.0e-:0eM62�3O~,24M6R><>=13>M6=S~1/.Y�KXR�KN3�0*=:?�~e=13>3WKX�J�P2R>= M6=.0e}J_eM6R��S_e-:0JROKPRV-:ROKPU.2�3OR>_e}J/�=:C¼~*I*2�0*=.9 2�0e-�?(IJKNM>I�?x2�<w2�0*=.R(-.M�M6243w3LKP�J�X2�R>=i=.�e3O2�<>U:-:ROKP=.0�-:R(-"�f�¼�J/ R>I*2~*<>2�USKP=._e3L�P/!_e3F24}�ª*=._*<OKP2�<GR><V-D0e3LCE=S<>9 9 2�RwI*=�}*3�=:CH}*-DRV-�-:0e-u�X/*3LKN3�*=D�`}�}*-DRV-�9!-"/ Ie-"U.2b-�0*2�?§�P24-.3O2�=S0 �fKfCE2.')GI*2�R>24MwI*0JKNM�-"�]}J2�RV-"Kf�N3(=:CBR>IJKN3b-:<>2�R>= -:~*~,24-:<(KP0�R>I*2bCE=S<>R>IeM6=.9iKP0*Q �,=1=S�!=:CG¯�'*\B'^��<>2�R>R>I*=S<V3ORb�V¶4³.²S²J�V'

&�U.2�0�?(I*2�08RwI*2!0J_*9 2�<OKNM�-"�GKP9 ~*<>=:U.2�9 2�0JR�KN3�3F9!-"�f��Y]R>I*2Q.<>24-DR>2�<�M6=.9�~*_*RV-:ROKP=.0e-"�G2��MwKP2�0eM6/8=DC�R>I*2+:26�z<>2�/*3(9�2�R>I*=�}*3�Ye?(IJKNMwItM�-:0#<>24}J_eM62iR>I*2i}SKP9 2�0e3LKP=.0e-"�fKPRO/ =DCx- 3O24-:<VMwI -u�XQS=.<OKPR>I*9��1/�26�fKP9iKP0e-:ROKP0*Q#_*0JKP0*�R>2�<>243FROKP0*Q�~e-:<V-D9 2�R>2�<V3B-:RBRwI*2�3ORV-:<wR4Y.M�-:0 9 24-D0 R>I*2�}SKf�z2�<>2�0eM62b�e2�RO?G2�2�0!?(Ie-DRyK`3HCE24-S3LKP�J�X2�-D0e}i?(Ie-:RyKN3�0*=.R4Y?GKPR>I!-¢Q:KPU.2�0!M6=.9�~*_*R>2�<4'yg¤3�R>I*2(M6=.9 ~J�P26�JKXRO/ =DC|=._*<�~*<>=.�J�P2�9!3yKP0eM6<>24-S3O243�Y*3O=�}J=J243BR>I*2(<w26�`-DROKPU.2¤-S}JUu-:0JRV-:Q.2=:CzR>I*2�+D26��<w2�/�3�9 2�R>I*=*}*3�.R>I*2�<w26CE=.<w2(?G2xRwIJKX0*��R>Ie-:RyKP0!RwI*2GCE_*Rw_*<>2(R>I*2�/i?GKf�f�z�e24M6=.9 2�-b~*<V-.M6RFK`M�-u�|0*24M6243>3LKPRO/Cp=.<�-"�f�¼?G=.<>�S2�<V3�KX0�R>I*2��S_e-:01RFKXR6-:ROKPU.2�3>MwKP2�0eM6243�'

��=:?�{eR>ROKP0*QbKPRBKN3BRwIe-:RBR>IJKN3B9 2�2�RFKX0*Q¢KN3B�e26KP0*QiI*26�N} �e-SM>��?(I*2�<>2(R>I*243F2�-.}JUu-D0eM6243]3ORV-D<>R>24}^'Bc(_*<�R>Ie-:0*�*3R>= RwI*2�a -S3OR>2�<(-:0e}�;]=._*0eMwKf�B=:CGZ.R4']+:=.I*0z� 3b;]=:�f�P2�Q.2.Y,?(I*= 9!-.}J2bKPR(~,=13>3LKP�J�P2.'

���#� ��������¤����"� �@B<w=.�e-:�JKf�fKXRO/ RwI*2�=.<>/�KN3�-�U.2�<V3w-:ROKf�P2(R>=J=:��Y.?(IJKNMwI!M�-:0!3O2�<wU.2(9!-:0J/�}SKf�z2�<>2�0JR]~*_*<>~,=13O243�'�)GI*2(24-:<O�fKP243ORG3LKPQ.0e3B=:C9i/ =:?(0�KX0JR>2�<>243FR]KP0�R>I*2b{e26�N}�KP0JU.=:�PU.24}0*=.R(}*-:RV-i-:0e-u�X/*3LKN3�Y*�*_*RG<>24M6=SQ.0JKPROKP=.0#R>Ie-DR]R>I*2�+:26�z<>2�/*3�U.KP2�?(~,=:KP01RM�-:0�Mw�P24-:<y_*~�=._*R63ORV-:0e}SKP0*Q(9i/*3OR>2�<OKP243�KX0�R>I*2�=.<>2�RFK`M�-u�1~*I1/*3LKNM�3�Y:�J/�<6-"KN3LKP0*Q�=._*<y3ORV-:0e}*-:<6}*3^=:CJ�X=SQ:KNM:'¼g�3z+.-D9 243;B�P2�<>�ia -u��?G26�f�e?(<>=.Rw2]=:U.2�<G¶4·.·�/.24-:<V3B-:QS=¤-:0e}i�b-:<>=:�N}i+:26�z<>2�/*3B�._*=SR>24}iº.·(/S24-:<V3B-:Q.=,Y4~*<>=S�e-:�JKf��KPRO/iR>I*2�=.<>/KN3GKPRV3F26��C]RwI*2�R><>_*2b�P=.Q:KNM�=DC�3>MwKP2�0eM62.'

Page 3: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

« «

)¨I*2#<>24M62�0JR�2�9 ~*Ie-.3LKN3�=.0�R>I*2 }*-DRV-t-:0e-"�P/*3LKN3�-.3O~,24M6R#3OR>2�9!3�Cp<>=.9 R>I*2�-4U:-"Kf�N-:�JKf��KPRO/�=:C�M6=.9 ~*_*Rw2�<V3-:0e}�RwI*2�C�-"Kf�P_*<>2 =:C��6=.<>RwI*=�}J="�e�!3OR6-:ROKN3OROKNM�3�Rw=!�.2�2�~d_*~t?GKPR>ItR>I*2i0*2�24}*3¢=:C¨3>MwKP2�0eM62.')GIJKN3�M6<>24-:Rw24}#9-:01/=.~*~,=.<>R>_*0JKPROKP243�CE=.<i_e3�YG-:�,=._*R ?(IJKNMwIv=.R>I*2�<!3O~,24-:�.2�<V3�?GKf���bIe-4US2#-#QS<>24-:R }J24-"��R>=t3>-"/tI*2�<w2.'���_*R�?�IJK��P2~*_*<V3O_JKP0*Q�R>I*243O2iKP9 ~,=.<>RV-:0JR�-:~*~J�fKNM�-:ROKP=.0e3�?G2 3OI*=._J�N}�0*=.Rb�P=13O2 3LKPQ.IJR�=DC]R>I*2 =.<OKPQ:KP0e-"�]QS=1-"��Y^?(IJKNM>I K`3¤KP08-3O2�0e3O22�U.2�0�9 =.<>2�CE_*0e}*-:9�2�01RV-u�xR>=�3>MwKP2�0eM62.'t)GI*2�<>26Cp=.<>2�KX0�R>IJKN3�=.~e2�0JKP0*QtR6-"�P�t?G2 ?(-:01R�R>=#~,=:KP01Ri=._*Ri-{e26�N}�<OKP~e2Cp=.<�26�*~J�P=.<V-:RFKX=S08�J/tQ:KPUSKX0*QdR>I*<>2�226��-:9�~J�X243�YyCE<w=.9�?GKN}J26�P/v}SK��z2�<>2�0JR -:<>24-.3�Y¼=DC¨I*=:? 3>MwKP2�01ROKf{|M9i/�3FR>2�<OKP243G-:<>2�Mw�X24-D<>24}�_*~zY*-:0e}~e-:<6-.}J="��243��e24M6=.9 2�~J�N-:RFKXRw_e}J243�Ye?�I*2�0!?G2�-.}J=.~*R�R>I*2�+:26�z<>2�/*3�U.KP2�?(~,=:KP01R4'c(0eM62�R>I*2��P=.Q:KNMb=:CzKPR�KN3(3O2�2�0zYSKPR(�e24M6=.9�243]2�USKN}J2�01R�R>Ie-:RGR>I*2�<>2�-:<>2b9!-:0J/i=.R>I*2�<G9i/�3ORw2�<OKP243�YSKX0#-u���¼3>MwKP2�0eM6243�YM�-"�f�fKP0*Q�=._*RGCp=.<GR>I*2�3>-D9 2�Rw<>24-:R>9 2�0JR4'

)¨I*2({e<V3FR]26�e-:9 ~J�P2bKN3x-i3LKP9 ~J�P2�26�*2�<VMwKN3O2bKP0��.KP0*2�ROKNMbR>I*2�=S<>/iR>Ie-:R]Ie-S3]~*_����6�P24}%Q.2�0*2�<V-:ROKP=.0e3�=:Cz~*IJ/�3WK`M�33OR>_e}J2�0JRV3 s I*=:?A}J=J243G=.0*2�M�-"�NM6_J�N-:R>2�-�}SK��z_e3LKP=.0#M6=J2��MwKP2�0JR¤-:0e}0*=SRxQS2�R���2�<w=*±#)GI*2�3O24M6=.0e}�M6=.0eM62�<w0e3GR>I*2M6_*<><>2�0JRO�P/�KP0JR>2�<>243ORFKX0*Q#&HKP0e3OR>26KP0J��@y=*}J=:�N3O�1/S���G=J3O2�0t~e-:<V-S}J=4� -D0e} ��26�f�BKP0*24�._e-u��KPRO/�9i/�3ORw2�<OKP243�KX0t�S_e-:0JR>_*9R>I*2�=.<w/ s }J=�~*IJ/�3LKNM�-"�,KP0 �e_*2�0eM6243GR><V-"U.26�*C�-.3OR>2�<BRwIe-:0i�fKPQ.I1R�±�)GI*2(RwIJKX<6} <>2�26�e-:9iKP0*243�R>I*2(=D�`}�9�/*3OR>2�<w/�-:�,=._*R?(I*2�R>I*2�<�R>I*2�<>9 =*}J/10e-D9iKNM�3 -:~*~J�fKP243 R>=��JKP=:�P=.Q./ s }J=J243iR>I*2IJKPQ.I�2��MwKP2�0eM6/v=:Cb=._*<i9�_e3wMw�X243�USKX=D�`-DR>2�R>I*23O24M6=.0e}��N-4?¢±

������(���z"���)GIJKP0*�^YJCE=S<¨}J26{e0JKPR>2�0*243w3�Ye=DCH-i3O=:�P_*ROKP=.0�=:CH3F_*Q1-:<BKP0�?(-:R>2�<"Y�3F=�}SKf�P_*R>2�R>Ie-DRx24-SM>I�3O_*Q1-:<G9 =D�X24M6_J�P2¢KX0JR>2�<V-SM6RV3M6=.0e3OR6-:01RF�X/�?GKPR>I�R>I*2 3O_*<><>=._*0e}SKP0*Q�?(-:R>2�<4Y^�*_*Ri-"�P9 =13OR�0*2�US2�<�2�0eM6=._*0JR>2�<V3�-:0*=.R>I*2�<�3O_*QJ-:<�9 =:�P24M6_J�P2.'g(RROKP9 2��� ·iR>I*2i3O_*Q1-:<�M6=S0eM62�01R><6-:ROKP=.0#U:-:<OKP243�?GKPR>I#~,=13LKPROKP=.0t-.M�M6=.<V}SKP0*QR>= -iCp_*0eM6ROKP=.0�z� ���V·��V'Bg(R�-��`-DR>2�<ROKP9 2�?G2b26��~,24M6R(R>Ie-:RGR>I*243O2bUu-D<OKN-:ROKP=.0e3G?GKf�f�]3O9 =J=.R>I =._*R"Y�-D0e}2�U.2�01Rw_e-"�f�X/�[�������>�B?GKf�f�¼R>2�0e}R>=i-i_*0JKfCE=S<>9}SKN3OR><OKP�*_*ROKP=.0z'

Z:KP0eM62i3O_*Q1-:<(9�=:�P24M6_J�X243¨�!=.<(-.3¨?x2�3OIe-"�f�HM�-u���BR>I*2�9#Yz�6~e-D<>ROKNMw�P243>����-:<w2�0*=.R(M6<>24-:R>24}=.<b}J243OR><>=:/.24}^YSKPR3O2�2�9!3�0e-:Rw_*<V-"�zR>=iR>IJKP0*�!RwIe-:R]R>I*2�<w2�9�_e3FRxIe-"U.2b�e2�2�0#-i}SKf�z_e3LKP=.0 M6_*<w<>2�01R"Y1=S< �e_J���y�������>�]M�-:<><>/SKP0*QiR>I*2�9Cp<>=.9 R>I*2�IJKPQ.I }J2�0e3LKPRO/#<w2�Q:KP=.0e3(Rw= R>I*2��P=:?�Ye3F=!R>Ie-DR(R>I*2�MwIe-:0*Q.2�KP0t}J2�0e3LKPRO/�?GKPR>I#RFKX9�2�KN3�-.M�M6=._*0JR>24}Cp=.<�J/!R>I*2�M6=S0e3O2�<>Uu-DROKP=.0��N-"? s

� � ��� }SKPU^���y��� ·�� �V¶:�

@BI*2�0*=S9 2�0*=:�P=.Q:KNM�-"�f�P/.Yzª[KNM>�^��3��N-"? <>26�N-:R>243�R>IJKN3GR>=�R>I*2�}J2�0e3LKPRO/�Q.<V-.}SKP2�0JR s�������vQ.<V-S},��[� �W¦J�

��0�R>I*2(M�-.3O2G=:C�3F_*Q1-:<V3�Y:RwI*2¨}SKf�z_e3LKP=.0!M6=J2��MwKP2�0JR�� KN3y24-.3O/�Rw=�9 24-.3O_*<>2G�J/�=.~*RFK`M�-u�e<>=.RV-:RFKX=S0z'z��0a -u��?G26�f����3Q.<>24-DR�&B0eM6/*Mw�P=.~e-:24}SKN-t��<OKPR>RV-D0JK`M�-d-:<>ROKNMw�P2!=S0 }SKf�z_e3LKP=.0vI*2��._*=.Rw243�RwI*2!26�*~e2�<OKP9 2�0JRV-"�(<>243F_J�XRi=:C(©B=:KPRiCp=.<3O_eM6<>=J3O2 s � ��«���¬.º�!8¶"·�"$#�3>�S_e-:<>2�M69�%:3O24M:'

c(_*<�~*<w243O2�01R�~*<w=.�J�P2�9 KN3 s I*=:? }J=�?x2 M�-"�NM6_J�N-:R>2&�¼���'���w�]Cp<>=.9�{e<V3FR�~*<OKP0eMwKP~J�P2436±Aa�-"�*?x26�f�]Q1-"U.2�R>I*23LKP9 ~J�P2��SKP0*2�ROKNMbR>I*2�=.<>/�=:CH}SKf�z_e3LKP=.0KP0�Q1-.3O243�YS�e-.3O24}=.0R>I*2�KN}J24-i=:C¼R>I*2b9 24-:0�Cp<>2�2�~e-DR>Iz']��_*R�KX0#-¢�fKN�._JKN}R>I*2�<>2�KN3G0*=i9 24-:0�CE<w2�2�~e-:RwIz'Ha�-"�*?G26�f�ûY�?(I*=�}SKP24}KP0t¶4²�®u³*Y:0*2�U.2�<(�J0*2�?�R>I*2bQ.2�0*2�<V-"�zR>I*2�=.<w2�ROKNM�-"�eCp=.<>9i_J�N-Cp=.<iR>I*2�}SKf�z_e3LKP=.0�M6=J2��MwKP2�01R�?(IJKNM>Iv?G20*=u? 3O2�2��^Y]-:0e}d?(IJKNMwI�-:~*~J�fKX243�24�S_e-"�f�X/�R>=�Q1-.3F243�Y[��KN�S_JKN}*3�Y(-:0e}3O=:�fKN}*3�'

c(0J�P/�?GKPR>I�R>I*2�?G=.<>��=DCx&yKP0e3OR>26KP0�KP0 RwI*2�{e<63OR¤}J24M�-S}J2�=DC]R>IJKN3�;]2�0JR>_*<>/�?G2�<>2�R>I*2i�e2�Q:KP0*0JKP0*Q13¢9!-.}J2KP0 3O2�26KP0*Q I*=:?�R>= }J24-"�¼?¨KXRwI�R>I*2�~*<>=.�J�P2�9#YeM6_J�P9iKP0e-:RFKX0*Q�{e0e-"�f�P/KP0#R>I*2�M6=.<><>24M6R¨CE=.<w9�_J�N-¢Cp=.<GR>I*2�}SKf��_e3WKX=S0M6=J2��MwKP2�01R4'i��_*R�&yKP0e3OR>26KP0tIe-S}#Rw=!?G=.<>�#-DR(KPR�Ie-D<V}J2�<�RwIe-:0�?x2 3OIe-u����Y[�e24M�-:_e3O2�I*2�}SKN}�0*=SR�Ie-"U.2 �b-:<>=:�N}+:26�z<>2�/*3(-:<>=S_*0e}R>=!3OI*=:? IJKP9 I*=:? R>=�_e3O2�~*<>=.�e-:�JKf�fKPRO/#R>I*2�=.<w/.' $

�LR(?G=._J�N}�3O2�2�9�R>Ie-:R4YSQ:KPU.2�0#?(I*2�<w2�-i~e-:<>ROKNMw�P2�KN3G0*=:?�Y�?x2�3OI*=._J�N}�{e0e}KPRV3GU.26�P=*MwKPRW/)(,Y*-:0e}�3O_*9 9�KX0*QR>IJKN3B=:U.2�<]-u���^~e-:<>ROKNMw�P243�KP0�-�3O9-"�f�|<>2�Q:KP=.0�?x=S_J�`}�Q:KPU.2(R>I*2G�P=*M�-"� �e_J�*�¼���'���w�V'¼��=:?x2�US2�<4Y:R>I*2GKP0e3ORV-D01RV-D0*2�=._e3$ ÎGÓ,+EÆ�Ì�Æ�Ózøy¿B¾1Æ 4¿BÚJ¿V¿6Â�Æ�Ú.Çf¿BÅ�ÀGÛ.¿6Å�¿6Ì�Ù�ÃfÂ.¿uÔ�×u¿�-eÌ�¿ �:Ó�Ê :Ãf¿6ø#À�+*Á.ÌLÀ4Ú1Æ�Ú.ÃfÇ�ÃfÅ��bÅ�¾.¿6À4Ì ��øBÆ�Ó[Ü.Â.È:Â.À�øBÂ�ÃfÂbâVÀ"Â:Å�ÃfÂ.¿6ÂuÅOÆ�ÇÐ[Ü.Ì�À"Á1¿bÅ�¾.ÌLÀ4Ü.Ä"¾.À4ÜSŨÐ[ÃfÂ.ÓOÅ�¿6ÃfÂeÊ ÓBÇ�Ã.+N¿6Å�ÃfÙ�¿0/�ÅL¾.ÃfÓ]øBÆ�ÓGÆb¾1Æ�Â.ÛSÃ�â�Æ�Á�Å�À�Ð[Ã�ÂSÓWÅL¿VÃfÂiÃfÂiÙ�À4ÌL¿GøHÆ �:Ó]ÅL¾1Æ�Â�À4Â.¿:Ö

Page 4: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¸ ¸

U.26�P=*MwKXRO/�=:Cx-i~e-:<>RFK`Mw�P2iKN3 �e_eM6R>_e-:ROKP0*Q�?GKf�N}S�P/.Yz?GKPR>It-i9�24-:0J��3>�S_e-:<>2�Uu-"�P_*2 Q:KPU.2�0��1/�RwI*2��(-"/S�X26KPQ.IJ�*+:24-:0e324�S_JKX~e-D<>ROKPROKP=.0v�N-"? �(-:0e}�RwIe-:R�K`3�0*=.RiR>I*2�U.26�P=*MwKPRW/v?G2�3O2�2��^'�Z._*~e2�<>~,=13O24} =.0vR>IJKN3i<V-:~JKN}S�P/ �e_eM6R>_e-:RFKX0*Q-:0e}%<>2�U.2�<V3LKP0*QR>I*2�<>9!-u��US26�X=*MwKPRO/.Y^=:CHRwI*2�=.<V}J2�<�=:C¨¶"·.·i9 2�R>2�<63 %u3O24M:YJKN3b-iU.2�<>/�9i_eMwI#3L�P=:?x2�<b-4US2�<V-:Q.2�}J<OKfCpRU.26�P=*MwKXRO/�<>2�~*<w243O2�01RFKX0*Q�}SKf�z_e3LKP=.0zYe?�IJK`MwI�KN3G=S_*<(~*<>243O2�0JR(KP0JR>2�<>243OR"'

¯�KPU.2�0!?�I*2�<>2¤-¢~e-:<>ROKNMw�P2bKN3G0*=:?�Y ��� �>�6Y:KPRV3G-"U.2�<V-:Q.2GU.26�P=*MwKPRW/=:U.2�<x-¢ROKP9 2�KX0JR>2�<>U:-"�¼¦ � M62�01R>2�<w24}!-:R�R>I*2~*<>243O2�0JRGKN3

�( � ��� � � � ��� �^� � � � �¦ ��W«J�

3O=%K�C(?G2 9!-D�.2i=._*<��,243OR�243ORFKX9-:R>2 =:CG?(I*2�<>2 RwI*2 ~e-:<>ROKNMw�P2?GKf���(�,2�-ROKP9 2 � KP08R>I*2�CE_*R>_*<w2 R>Ie-:RbKN3¢�P=.0*Q=.0�R>I*2�ROKP9 2i3>M�-"�P2�=DC]R>I*2�<>9!-"� �e_eM6R>_e-:ROKP=.0e3�Y^-:0e}%?(I*2�<>2�KPRb?(-.3(-:0�24�._e-"�BROKP9 2¢KX0�R>I*2�~e-.3OR4Y�?x2�Ie-"U.2�-:0243OROKP9!-DR>2(=:C^KPRV3]-"U.2�<6-:Q.2(3L�P=:?�U.26�P=*MwKXRO/!-D�e=._*R�R>I*2(~*<>243O2�0JR]RFKX9�2.'])GI*2(~*<>=S�e-:�JKf��KPRO/R>Ie-:RyKPRG?GKf���^9 =:U.2GCp<>=.9�^� �>�GR>=���� ��� � � � �]KP0�R>I*2�Cp_*R>_*<>2¢KN3bQ:KPU.2�0#�J/#3O=.9 2i}SKN3OR><OKP�*_*ROKP=.0������ �'� � �V'���R63(9 =SROKP=.0�KN3�R>I*2i<>243O_J�PR=:CH-¢�N-:<>QS2�0J_*9i�e2�<(=:CB3O9!-"�f�^KP0eM6<>2�9 2�0JRV3b��2�0eM6=._*0JR>2�<V3�?GKPR>I�KP0e}SKPU.KN}J_e-"�]?(-:R>2�<�9 =:�P24M6_J�P2436�V'G)GI*2�<>26Cp=.<>2bR>I*2;]2�0JR><V-"�¼\,KP9iKPR�)GI*2�=S<>2�9#YJKP0JR>2�<>~*<>2�R>24}%?GKPR>I#RwI*2 �W_e}JQ.9�2�01RbR>Ie-:R�3wMwKX2�0JROKN3ORV3b}J2�U.26�P=.~d���*_*R�M�-:0*0*=.R�-"�P?(-"/�326�*~J�`-uKX0�R>=�9!-DR>I*2�9!-:ROKNMwKN-:0e3�Y��e24M�-D_e3O2�KXR}J<V-"?�3�=.0v26��Rw<V-�KP0JCE=S<>9!-:ROKP=.0vRwIe-:R -�9!-:R>I*2�9-:ROKNMwKN-:0�?G=._J�N}0*2�U.2�<G_e3O2bKP0�~*<>=:USKX0*QiR>I*2bR>I*2�=.<w2�9��¼R>26�f�N3G_e3GRwIe-:R]R>IJKN3G?¨K��f�zIe-"U.2�- ¯�-:_e3>3LKN-:0�Cp=.<>9#YJ-:0e}iCp<>=.9 3O/J9 9 2�Rw<>/R>I*2�9 24-D0#}SK`3F~J�`-SM62�9 2�01RbKN3���2�<>= s

������ �����,� ����26��~�� � ��� � �������u¦������ � ��� ��¸*�

?(I*2�<>2 ��3ORV-:0e}*3�Cp=.<¼RwI*2xQS2�0*2�<V-"�1~*<OKP=.<yKP0JCp=.<>9!-DROKP=.0�3OR6-:R>24}�=S<zKP9 ~J�fKP24}iKP0i=._*<[CE=S<>9i_J�`-DROKP=.0�=:CeRwI*2x~*<w=.�J�P2�9#'g����eRwI*2¨-D0e-"�P/�3LKN3y=.0*2(M6=._J�N}i9-:�.2]=DCeR>I*2(}J/10e-:9�K`M�3�=:C|3O_*Q1-D<O�1?(-:R>2�<^KP0JR>2�<V-.M6RFKX=S0e3y?x=S_J�`}^Y"KP0 RwI*2]2�0e}^Y13F2�<>U.2=.0J�P/�R>= }J2�R>2�<>9�KX0*2iR>I*2�3F~*<>24-.}SKP0*Q Cp_*0eM6ROKP=.0�� � � � � � ��� ��� � Y�R>I*2�26��~,24M6R>24}�3>�S_e-:<>2�=:CBR>I*2�}SKN3O~J�N-.M62�9 2�0JR4'

��_*Rb0*=:? =._*<(R><w=._*�J�P2��e2�QDKX0e3 �^R>I*2�~e-:<wROKNMw�X2�KN3b-.3��fKP�.26�P/ Rw= �e2��e-:R>R>2�<>24}%R>= R>I*2�<FKXQSI1R�-.3GR>=�R>I*2��P26CpR �3O=�Cp<>=.9 3O/J9 9 2�Rw<>/.YBR>I*2�26�*~e24M6RV-DROKP=.0�=:C�� K`3! "�$# � �z'§�(=:? -"�f��R>I*2�24�S_e-:ROKP=.0e3i=DC¤9 =SROKP=.0zY]I*=:?G2�U.2�<M6=.9 ~J�fKNM�-:R>24}^Y(-D<>2�-DR��P24-.3FR ROKP9 26�1<>2�US2�<V3>-"�GKP01U:-:<OKN-:0JR4'8)¨I*2�<>26CE=S<>2CE=S<�RwI*2�~e-.3ORi~e=13WKXRFKX=S0�%&� ��� ��� � �VYM6=.0JU.2�0JROKP=.0e-"��<>24-S3O=.0JKP0*Q83>-"/*3iR>Ie-:R ?G2#3OI*=S_J�`} Ie-"U.2�R>I*2 3w-:9 2�~*<>=.�e-D�JK��fKPRO/ }SKN3OR><FKX�*_*RFKX=S0A�L¸*��?(IJKNM>I K`3KP0e}J2�~e2�0e}J2�0JR�=:CyR>I*2�3LKPQ.0�=DC � Ye-D0e}�-:Q1-"KP0' "%(# � �^� �>�V'B)GI*2�<>26Cp=.<>2�RwI*2�243OROKP9!-:R>24}%U.26�P=�MwKPRO/KN3��2�<>=e'

Z._*<w26�X/.YJR>IJKN3�9�_e3FR]�e2�<OKPQ.I1R"Y:Cp=.<B=._*<]~e-D<>ROKNMw�P2.Y.KP0JR>2�<V-.M6RFKX0*Q�=.0J�P/ ?GKPR>I RwI*2�3O_*<><>=S_*0e}SKX0*Q�?(-:R>2�<4Y:Ie-.3�0*=?(-"/�=:C|�J0*=:?GKP0*Q�R>Ie-:RB=.R>I*2�<]3F_*Q1-:<y9 =:�P24M6_J�P243x-D<>2G~*<>243O2�0JR4Y:9i_eM>I��P243>3BRwIe-:RBR>I*2�<>2�KN3]-:0J/�}J2�0e3WKXRO/�Q.<V-.}SKP2�0JR4'ª*<w=.9 R>I*2¤3FRV-:0e}J~e=DKX0JR(=:CB}J/10e-:9�K`M�3b-"�P=.0*2i�*),+.-/+`Y:Cp=.<VM6243G-:0e}24�S_e-:ROKP=.0e3G=:Cy9 =.ROKP=.0^�BR>I*2�<>2bKN3G0*=SR>IJKP0*Q R>Ie-:RM�-:0�Q:KPU.2bKPR¤-:0J/R>2�0e}J2�0eM6/�R>=!}J<OKfCpR�Rw=�<w2�Q:KP=.0e3(=DC¼�P=:?G2�<(<V-:R>I*2�<�R>Ie-:0�IJKPQ.I*2�<�}J2�0e3LKPRW/.'G£B2�Rb}SK��z_e3LKP=.0t}J=J243Ie-:~*~,2�0�0

�L0tR>I*2iC�-.M62 =DC¨RwIJK`3�}SKf�X2�9�9!-*Y]&HKX0e3FR>26KP08?(-.3�Cp=.<VM624}�Rw=KX0JU.2�0JR 3OR><V-:0*QS2.Y^<>=._*0e}*-:�,=._*R�-:<wQ._*9 2�0JRV3��Ie-"�fC�R>I*2�=.<w2�ROKNM�-"��Y(Ie-"�fC�~*I*2�0*=S9 2�0*=:�P=.Q:KNM�-"�b�8KP0�=.<V}J2�<R>=tQS2�R!-�Cp=.<>9i_J�N- CE=.<}SK��z_e3LKP=.0z'�ª*=.<�26��-:9�~J�X2.Y{e<V3ORG243ORFKX9-:R>2bI*=u?�R>I*2�}J2�0e3LKPRO/ [���'���w�¼?G=._J�N}�e2�M>Ie-D0*Q.24}�-¢�X=S0*Q�RFKX9�2bKX0�RwI*2(Cp_*R>_*<>2b�1/M6=.9i�JKX0JKP0*QR>I*2}SKN3OR><OKP�*_*ROKP=.0e3¨��¸*�^Q.2�0*2�<V-:Rw24}��J/�9-:01/�}SKf�z2�<>2�0JRB~e-:<>ROKNMw�P243�YSR>I*2�0 3O_*�e3OROKPR>_*R>2�KPRyKP01Rw=�R>I*2G~*I*2�0*=.9 2�0*=:�P=.Q:KNM�-"�}SKf�z_e3LKP=.0t24�S_e-:ROKP=.0tR>Ie-DR�?x2iQ.2�R��J/ M6=S9��JKP0JKP0*Qt�6¶:��-:0e}d�W¦J� �z-D0e}�CE<w=.9 RwIe-:R�<>24-.3O=S0 �e-SM>�J?(-:<V}*3�R>=�R>I*2~*<>243O2�0JR(ROKP9 2�R>= 3O2�2�?�Ie-:RGR>I*2�}SKf�z_e3LKP=.0 �e_J�#9i_e3ORGIe-"U.2��,2�2�0z'

)¨IJK`3��SKP0e}�=:CGKX0e}SKP<>24M6R�<>24-.3O=.0JKP0*Q�Ie-.3¢�e2�2�0�Cp=:�f�X=:?G24} Cû-"KPR>IJCp_J�f�P/82�U.2�< 3LKP0eM62�KP0vR><>24-:R>9�2�01RV3b=DCxKP<><w2��U.2�<V3WKX�J�P2�~*<>=�M6243w3O243�Y*�,24M�-:_e3O2�KPR(Ie-S3(3O2�2�9 24}R>=��e2�R>I*2�=.0J�P/�R>IJKP0*Q RwIe-:RG?x=S<>��3�'¼g�R>R>2�9 ~*RV3�R>= M�-"�NM6_J�N-:R>2i-�e_J� }SKP<>24M6RO�P/t-:R(R>I*2�~*<>243O2�0JR�RFKX9�2�Q:KPU.2���2�<>= Cp<>=.9�3O/19�9 2�R><>/.Ye3F=!=.0*2�<>243O=.<wRV3GR>= �VCE=.<w?¨-D<V}iKP0JR>2�Q.<V-DROKP=.0e�Cp=:�f�X=:?G24}d�1/t�e-SM>�J?(-:<V}�<>24-S3O=.0JKP0*Qe'�£B2�RiR>IJKN3�~*_����6�X243�2�U.2�<>/�R>I*=S_*Q.I1RFCE_J�(3OR>_e}J2�0JR4YB?(I*=�R>IJKP0*��3iRwIe-:R�?G2=._*Q.IJRGR>= �,2�-:�J�P2�R>= 3O=:�PU.2�RwI*2�~*<>=.�J�P2�9 �J/�}SKX<w24M6R(<>24-.3O=S0JKX0*Q s M�-"�NM6_J�N-:R>2iR>I*2 �e_J���¼���'���w�HI*2�<w2�-:0e}0*=:?�Y3OR><6-"KPQ.I1R�=._*R�=DCHR>I*2�~*I1/*3LKNM�3b=:C]R>I*2i3LKPR>_e-:ROKP=.0z'b)GIe-:R�3F/19 9�2�R><>/�M�-:0*0*=.Rb�e2i26��-SM6RO�P/�<OKPQ.I1R �e�*_*Rb?(I*2�<>2¢K`3R>I*2�2�<><w=.<GKP0#R>I*2�<w24-.3O=.0JKP0*Q*±:'

ª�_*<>R>I*2�<>9�=.<>2.Y�KX0e3FR>24-.}v=DC¤=._*<�Ie-4USKP0*QtR>=8-S3>3O_*9 2#-�~*I*2�0*=S9 2�0*=:�P=.Q:KNM�-"��Cp=.<>9#Y�-tM6=.<><>24M6R-:0e-"�P/�3WK`3=._*Q.IJR R>=dQ:KPU.2�KPR�-:_*R>=.9!-DROKNM�-"�f�X/��1)2+.-/+`Y�KXR�3OI*=._J�N}§R>26�f��_e3iCp<>=.9 {e<63OR ~*<OKP0eMwKP~J�P243#?�I1/dKPR KN3�R>I*2 }J2�0e3LKPRO/

Page 5: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

º º

Q.<V-S}SKX2�0JR4Y*-:0e}�0*=.Rx3F=.9 2b=.R>I*2�<BCp_*0eM6ROKP=.0�=:CyR>I*2�}J2�0e3LKPRO/.Y*R>Ie-:R�9!-:R>Rw2�<V3�Y1-D0e}!-"�N3O=i_*0e}J2�<G?(Ie-:R(M6=.0e}SKPROKP=.0e3R>IJKN3�?GKf���y�e2�Rw<>_*2.']&BUSKN}J2�01RF�X/.Y,?G2�Ie-"U.2�-i<>24-"�y9�/*3OR>2�<w/ I*2�<>2.'

7�IJ/!}SKN}=._*<B{e<63OR(-:R>R>2�9 ~*RG-:Rx}SKP<>24M6R�<>24-.3O=.0JKP0*Q�C�-"Kf�E±#��24M�-:_e3O2�RwI*2�~*<>=S�J�X2�9 K`3�0*=.RG=.0*2b=:C¼~*IJ/*3LKNM�-"�~*<>24}SKNM6ROKP=.0�Cp<>=.9 R>I*2�}J/10e-:9�K`M�3 �bKPRK`3�-d~*<>=.�J�P2�9­=:C�KP0JCE2�<>2�0eM62.'�)GI*2t�._*243ORFKX=S0�KN30*=.Rt����=:? }J=vR>I*224�S_e-:ROKP=.0e3G=:Cy9 =.ROKP=.0<>24�S_JKX<w2�R>I*2�~e-:<>ROKNMw�P243GR>=i9 =:U.2b-:�e=._*R�=.0!RwI*2¤-"U.2�<V-DQ.2:±m�i)GI*2b24�._e-DROKP=.0e3G=:C¼9�=.ROKP=.0}J=�0*=.R�<>24�._JKP<>2�R>I*2�9 R>=�9 =:U.2(-:�,=._*R]-:R]-"�f��'])GI*2��S_*243OROKP=.0�K`3 s �m7 Ie-DRyK`3�R>I*2G�e243OR�243OROKP9!-:Rw2(?G2¨M�-D0�9-:�.2-:�,=._*RGI*=u?§R>I*2b~e-:<>ROKNMw�P243(-:<>2�KP0Cû-SM6R]9 =:USKX0*Q�KP0�R>I*2b~*<>243O2�0JR�KX0e3FRV-:0eM62.YJ�e-.3O24}�=.0�-"�f��RwI*2(KP0JCp=.<>9!-:RFKX=S0!?G2Ie-"U.2:±m�)GI*2�24�._e-:RFKX=S0e3(=:CB9 =.RFKX=S0 -:<>2�3F/19 9�2�R><OKNMbKP0�~e-.3OR�-D0e}Cp_*R>_*<>2��,�*_*R�=._*<¨KX0JCp=.<>9-:ROKP=.0 -D�e=._*RbR>I*2~e-:<>RFK`Mw�P243¨KN3(0*=.R"'

¯�KPU.2�0#R>I*2�~*<w243O2�01Rb~e=J3LKPROKP=.0�=:C�-�~e-:<>ROKNMw�P2.Ye?�Ie-:R�M�-:0�?x2�3w-4/�-:�,=._*RGKPRV3¨CE_*R>_*<w2�~e=J3LKPROKP=.0^± )GI*2���2�<>=9 =:U.2�9 2�0JRx-D0e3O?G2�<x-:�,=uUS2�?(-.3�M6=.<><>24M6R �DCE=S<]~*<>24}SKNM6ROKP0*Q?(I*2�<>2�KXRG?GKf�f�z�e2bKP0R>I*2(Cp_*R>_*<>2.YJR>I*2b�J0*=u?¨�X24}JQS2�=:C?(I*2�<>2bKPRGKN3�0*=:? 9-:�.243(-"�f�¼~*<FKX=S<GKP0JCE=.<w9!-:ROKP=.0#-:�,=._*R(?(I*2�<w2bKXR�9iKPQ.I1R�Ie-4US2��e2�2�0�KP0�R>I*2�~e-.3OR�KP<><>26�P2�Uu-D01R4'��_*R�243OROKP9!-:RFKX0*Q�?(I*2�<>2�KPR�?(-.3¨KP08R>I*2i~e-.3FRbK`3b0*=SR�-ROKP9 26�1<>2�U.2�<63O24}�9iKP<><>=S<bKX9-:Q.2i=:CxRwIJK`3�Y^Cp=.<�?G2iIe-"U.2~*<OKP=.<(�J0*=:?G�P24}JQ.2�=DCHR>I*2�U:-:<>/SKP0*Q�}J2�0e3LKPRO/�=:CB~e-:<>ROKNMw�P243¨KX0�R>I*2�~e-S3OR4'B¥b0*=:?G�P24}JQ.2�=:CB?(I*2�<>2¢KPRGKN3(0*=:?A}J=J2430*=.R(9-:�.2bR>Ie-:R(~*<OKP=.<��10*=:?G�P24}JQ.2¢KX<w<>26�P2�Uu-:0JR �^-:0e}�3O=._*0e}��X=SQ:KNM�9i_e3OR(RV-D�.2��,=.R>IKP0JR>=�-SM�M6=._*01R"'

\�2�R _e3i<>243OR6-:R>2R>IJKN3�KP0�}SK��z2�<>2�0JRi�N-:0*Q._e-DQ.2.'v&]�,']�L¸*��26��~*<>243w3O243 -:0v-"U.2�<V-:Q.2=:U.2�<iR>I*2#Mw�N-.3>3i=DC¤-"�f�~e=J3>3LKP�J�P2�9 =.ROKP=.0e3�M6=.9 ~e-:ROKP�J�P2b?GKPR>I R>I*2�}J/10e-D9iKNM�3�Y:KP0?(IJKNM>I9 =:U.2�9 2�0JRV3yR>=�R>I*2(<OKPQ.IJRx-:0e}�R>I*2G�P26CERGIe-"U.2.YCp<>=.9 3F/19 9�2�R><>/.Y.24�S_e-"�z?G26KPQ.I1R"'H��_*RG=:C¼M6=._*<V3F2.Y1=S_*<x~e-D<>ROKNM6_J�N-:<G~e-:<>ROKNMw�P2bKN3BKP0C�-.M6R]26�*24M6_*ROKP0*Q =.0J�P/ =S0*2�=:CR>I*=13F2x9�=.ROKP=.0e3�'�c(_*<]~*<FKX=S<BKP0JCE=S<>9!-:ROKP=.03O26�P24M6RV3B=._*R�=:C|RwI*2�Mw�N-.3>3B=DC�-"�f�|~,=13>3LKP�JKf�fKPROKP243GKP0���¸��¼-�3O9!-"�f�P2�<(Mw�`-S3>3KP0t?(IJKNMwI8=._*<�~e-D<>ROKNMw�P2iKN3b�fKP�.26�P/tR>=��e2.Y�KP0t?(IJKNM>I�9 =:U.2�9 2�0JRV3�R>=�R>I*2i<OKPQ.IJR�-:0e}��P26CpR�}J=�0*=.R�Ie-"U.2i24�S_e-"�?G26KPQ.I1R"']�LR(KN3b0*=.R(RwI*2�}J/J0e-:9iKNM�3�Y,�*_*R�R>I*2�~*<OKP=.<�KX0JCp=.<>9-:ROKP=.0zY,R>Ie-:R(�*<>24-D��3GRwI*2�3O/J9 9 2�R><w/�-:0e}��P24-.}*3b_e3R>= ~*<w24}SK`M6R�-i0*=.0J� ��2�<>= �e_J�z'

7�IJKf�P2 ����� % ���>��KN3�-}SKP<>24M6R�~*<>=.�e-D�JK��fKPRO/.Y^R>I*2�3w-:9 2�Cp_*0eM6ROKP=.0t-.3b�L¸*�VY*R>I*2�~*<>=.�e-:�JKf�fKPRO/ ?G2�0*=u? 0*2�24}KN3 ���% �����>�VY*-:0KP0JU.2�<V3O2�~*<w=.�e-:�JKf�fKXRO/�?(IJKNM>I�<>24�._JKP<>243�R>I*2�_e3O2�=:C]�x-"/.243��1RwI*2�=.<>2�9 s

����% �'��� � �e� ��� ����% �,� ��� � %�� �e�$� �WºJ�)GI*2�~*<OKP=.<b~*<>=.�e-D�JK��fKPRO/ ����% �,�BKN3(Mw�P24-:<O�P/�~*<>=.~e=S<>ROKP=.0e-"�zR>= [��%��VY*-:0e}#3O=�CE<>=S9 �O«J�

�X=SQ ����% �����,� �v�P=.Q�[��%J� �v��% � ��� � �u¦�� � � � � � �WM6=.0e3OR �X�$� �W¬J�¡�Kf�z2�<>2�01RFK`-DROKP0*QeY*R>I*2�9 =J3OR(~*<>=.�e-D�J�X2�Uu-"�P_*2�=:CHRwI*2�~e-.3OR(~,=13LKPROKP=.0 %�KN3G0*=.R �[Y*�*_*R

�%�� � � � � Q.<V-S},�p�P=.Q�[� � � � ��� �^� � QS<V-.}��p�P=.Q�[� �>®.�?(I*2�<>2�_*~,=.0zY^3O_*�e3OROKPR>_*ROKP0*Q�KP01R>=%�W«J�B?G2�243OROKP9!-:R>2�RwI*2�}J<OKfCpR(U.26�P=�MwKPRO/�R>=i�e2

�( � �b��0��� � �u¦ � QS<V-.}��p�P=.Q�[� �W²J�-:0e}=._*<�~*<>24}SKNM6R>24}�-4US2�<V-:Q.2�}SKf��_e3WKX=S0 �e_J�#=:U.2�<GR>I*2�RFKX9�2bKX0JR>2�<>U:-"�H¦ � KN3

�¼� �����w� � �( � �b��� �^�����:¦ � Q.<V-.}���[� � �W³J��G-"/.243��JR>I*2�=.<>2�9 Ie-.3GQ:KPU.2�0�_e3 �W_e3FR�&yKP0e3OR>26KP0z��3¨Cp=.<>9i_J�N-�CE=S<(R>I*2�}SKf�z_e3LKP=.0 M6=J2��MwKP2�01R s

� � ��� ��� �¦ ��V¶4·J�

-:0e}�-(Q.=J=*}�}J24-u��9 =S<>2.'z7t2G}SKN}i0*=.RB-.3>3O_*9 2�R>Ie-:RzQS<V-.},��[�^?¨-S3^R>I*2(-:~*~*<>=.~*<FK`-DR>2]~*I*2�0*=.9�2�0*=:�P=.Q:KNM�-"�*Cp=.<>9 ��G-"/.243��:R>I*2�=.<w2�9 R>=:�N} _e3�R>Ie-:R]-:_*Rw=.9!-:ROKNM�-"�f�P/.'yg(R]RwI*2�3>-:9 2GROKP9 2.YDKPRxRw=:�N}i_e3BR>I*2bM6=.0e}SKPROKP=.0 Cp=.<BU:-"�fK`}SKPRO/ =:C

Page 6: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¬ ¬

R>Ie-:R¨CE=.<w9 �*_*0J�P243>3���� �^� � KN3(~*<w=.~e=.<wROKP=.0e-"�BR>= � Y*R>I*2�<w2�?GKf�f�]�e2i0*= _*0JKN�S_*2!}SKf��_e3WKX=S0 M6=J2��MwKP2�0JR4Ye�*_*Rb=.0J�P/-i3O24�S_*2�0eM62�=:CH-D~*~e-:<>2�0JR�}SKf��_e3WKX=S0 M6=J2��MwKP2�01RV3���� � �yCp=.<GR>I*2�-"U.2�<V-:QS2�}J<OKfCER�=uUS2�<¨}SKf�z2�<>2�0JR(ROKP9 2bKP0JR>2�<>Uu-u�`3¦ � '()GI*2�0�R>I*2 �e_J� �y�������>�]?¨K��f�x}J2�~,2�0e}�=.0#=SR>I*2�<�~*<w=.~e2�<>RFKX243�=:C�[���'���>��R>Ie-:0�KPRV3b~*<w243O2�01RbQ.<V-S}SKX2�0JR4Y^-:0e}KP0t~J�N-.M62 =:C(�O¦J�¨-9�=.<>2�M6=S9 ~J�P2�R>2!�G-"/.243LKN-:0t-:0e-"�P/*3LKN3b?GKf���GQ:KPU.2 -�}SKf��2�<w2�01R�~*I*2�0*=.9�2�0*=:�P=.Q:KNM�-"�x<w26�`-DROKP=.0zYKP01US=:�PU.KP0*Q!-:0�-"U.2�<V-:QS2x=DC�QS<V-.},��[�¼=:U.2�<G-i3OI*=.<>R�ROKP9 2(KP0R>I*2b~e-.3OR4'B)GIJ_e3��W³J�^KN3G=.0J�P/ R>I*2b�e2�QDKX0*0JKP0*Q=:CzR>I*2~*IJ/�3LKNM�-"�y~*<>24}SKNM6ROKP=.0e3bR>Ie-:R(?G2�M�-:0�26�*R><V-SM6Rx�J/��x-"/.243WK`-D0 -:0e-"�P/*3LKN3�'

7�IJKf�P2��W²J�GKN3bR>I*2i�,243OR�243ORFKX9-:R>2i=:C]R>I*2!-"U.2�<6-:Q.2�U.26�P=*MwKXRO/�R>Ie-:R�?G2 M6=._J�N}�9!-D�.2�Cp<>=.9 R>I*2 -.3w3O_*9 24}KP0JCE=S<>9!-:ROKP=.0zY�KXR�}J=J243(0*=.Rb}J2�R>2�<>9iKP0*2iR>I*2�US26�X=*MwKPRO/�=:C�-D01/�=.0*2�~e-D<>ROKNMw�P2�US2�<>/!?G26�f��'(��_*R�?(Ie-DR(9!-:R>Rw2�<V3�K`3R>I*2�~*<>24}SKNM6ROKP=.0�=:C¼R>I*2�=S�e3O2�<>Uu-D�J�X2�0*2�R �e_J��=:C�� ~e-D<>ROKNMw�P243�']�L0�~*<OKP0eMwKP~J�X2i?G2�3OI*=._J�N}Ie-"U.2�M�-"�NM6_J�N-:R>24}%R>I*2�O=:KP01R�~e=13ORw2�<OKP=.< }SK`3FR><OKP�*_*ROKP=.0�Cp=.<�R>I*2�U.26�P=�MwKPROKP243i=:C�� ~e-:<wROKNMw�X243�Y]-:0e}d243OROKP9!-:R>24}dR>I*26KP< 3O_*9#'���_*R 3LKP0eM62R>Ie-:R]}SKN3ORw<OKP�*_*ROKP=.0Cû-SM6R>=.<V3�Y:RwI*2�M�-"�NM6_J�N-:ROKP=.0<>24}J_eM6243�R>=�� <w2�~e2�ROKPROKP=.0e3�=:CzR>I*2�-D�e=:U.2G=.0*2.Y1-D0e}iR>I*2(<>26�N-:RFKXUS2-.M�M6_*<V-SM6/!=:CBR>I*2�~*<>24}SKNM6ROKP=.0�KP9 ~*<>=:U.243x��KP�.2�� ��Y*R>I*2�_e3O_e-u�¼<>_J�P2�KP0#~*<w=.�e-:�JKf�fKXRO/�R>I*2�=S<>/.'

�L0t~*<V-.M6RFK`M62.Yy?GKPR>Id~e2�<>Ie-:~e3i·�� ·.·*¶�� 3F_*Q1-:<�3O=:�P_*ROKP=.0e3�Y¼RwI*2�<w26�X2�U:-:0JR�U:-"�P_*243�=:C�� -:<>2 =DCxR>I*2 =S<V}J2�<=:C�¶4·��.Yz-:0e}�R>I*2�~*<w24}SK`M6RFKX=S0tKN3bIJKPQ.IJ�P/�<>26�fK`-D�J�X2.Y[KP0�R>I*2�CE=D���P=:?GKP0*Q#3O2�0e3O2 s Cp=.<bR>I*2iQ.<>24-:R(9- �O=.<OKPRO/�=:C]R>I*2�%�1~e-:<>RFK`Mw�P29 =.ROKP=.0e3iM6=.0e3WK`3FR>2�01Ri?GKPR>I�R>I*2�KP0JCE=.<w9!-:ROKP=.0�_e3O24}^YBR>I*2 �e_J��K`3�U.2�<w/8Mw�P=13O2R>=�R>I*2!~*<w24}SK`M6Rw24}Uu-u�X_*2.'

��"�¼�����y�z"���)GI*2(-:�,=uUS2x26�e-:9 ~J�P2(9-4/bKP0e}SKNM�-:R>2bR>I*2G~*<OKNM62(R>Ie-DRB�.KP0*2�ROKNMGR>I*2�=S<>/�Ie-.3y~e-uK`}�CE=.<[KPRV3[C�-"Kf�X_*<w2�R>=�M6=.9 ~*<w2�I*2�0e}-:0e}�_e3O2�RwI*2#�x-"/.243WK`-D089 2�RwI*=�}*3iRwIe-:R ��-:<w=:�N}v+:26�z<>2�/�3�Q1-"U.2!_e3iº.·�/.24-D<V3i-:Q.=eY]-D0e}�I*=u? 9!-D01/t=SR>I*2�<~*_����6�P243�0*2�24}#Rw=��e2i<>2�26�e-:9iKP0*24}�Cp<>=.9�R>Ie-:RbUSKX2�?�~e=:KP0JR4'�)¨I*2 =.0J�P/#<>24-S3O=.0�?(IJ/�R>I*2 �e_J��243¢~e2�<V3LKN3ORw24}�KP0�e26KP0*Q���2�<>=�?¨-S3BC�-"Kf�P_*<>2iR>= ~*_*R(RwI*2�=.�JU.KP=._e3W�X/�0*24M6243w3>-:<>/~*<OKP=.<�KX0JCp=.<>9-:ROKP=.0KP01Rw=!R>I*2�~*<w=.�e-:�JKf�fKXRFKX243�'���_*R-.3¨�P=.0*Q#-.3�=.0*2iR>IJKP0*��3bR>Ie-DR�~*<>=S�e-:�JKf��KPROKP243i-:<>2�<>24-"�B~*I1/*3LKNM�-"�]~*<>=S~e2�<>ROKP243b=:Cx3F/�3ORw2�9!3�Y�KXR�3F2�2�9!3b?(<>=.0*QR>=9 =*}SKfCE/#-i~*<w=.�e-:�JKf�fKXRO/�9 2�<w26�X/��,24M�-:_e3O2�=._*<�3ORV-DR>2�=DCH�J0*=:?G�P24}JQ.2�Ie-.3�M>Ie-:0*QS24}^'

)¨I*2K`}J24- R>Ie-:R�~*<w=.�e-:�JKf�fKXRFKX243�M�-D0v�e2�_e3O24}�R>=�<>2�~*<>243O2�0JR =._*<i=:?(0dKP0JCE=.<w9!-:ROKP=.0dKN3 3OROKf�f�(Cp=.<>26KPQ.0vR>=�6=.<wR>I*=�}J="�e�iR>24-.MwIJKP0*QeY¼-u�XRwI*=._*Q.I�R>I*2�-D�e=:U.2i26��-D9 ~J�P2�3FI*=u?b3b?(Ie-:Rb=.0*2iQ1-"KP0e3b�1/�3O=�}J=:KP0*Qe'ic(<>R>I*=*}J="��/}J=J243 0*=.R�~*<>=:U.KN}J2 -D01/vR>24MwI*0JKNM�-"��9 24-:0e3�Cp=.< RV-D�.KP0*Q�~*<OKP=.< KP0JCp=.<>9!-DROKP=.0�KP01R>=v-.M�M6=._*0JR ��/.2�R R>Ie-:R�~*<OKP=.<KP0JCE=S<>9!-:ROKP=.0%KN3(=:CpR>2�0�IJKPQ.IJ�P/ M6=SQ.2�01R"Ye-:0e}#3F=._*0e}�<>24-S3O=.0JKP0*Q!<w24�._JKP<>243�R>Ie-:RGKPRb�e2iRV-:�S2�0KX0JR>=!-SM�M6=._*01R"']�L0=.R>I*2�<�{e26�N}*3�R>IJKN3GKN3(M6=.0e3WK`}J2�<w24}#-�~J�N-:ROKPR>_e}J2��,?(Ie-:RG?G=._J�N}�/.=._R>IJKP0*�=:C�-�~*IJ/�3WK`MwKN-:0�?(I*=��P=J=.�.24}=.0J�P/#-:R/.=._*<�~*<>243O2�0JR�3O/J9 ~*R>=.9!3�Y�-D0e}<>26CE_e3F24}�R>= R6-:�.2b0*=.R>2�=:CB/.=._*<G9 24}SKNM�-"�BIJKN3OR>=.<>/,±

�L0�R>I*2b0*26��RGRV-"�P�^Y*�(-"/�Z.9iKPR>I�?GKf�f�H3O_*<>US2�/ R>I*2�-:<>Q._*9 2�0JRV3�=:C]¯�2�=S<>Q.2�@� =:�P/1-i-:0e}���KNM>Ie-D<V}�;]="�iKX0e}SKP�M�-:ROKP0*Q�R>I*2(3O2�0e3F2]KP0i?(IJKNMwI!�G-4/S243LKN-:0�KP0JCp2�<>2�0eM62(KN3y_*0JKN�S_*26�X/}J2�R>2�<>9iKP0*24}��1/i3LKP9 ~J�P2��S_e-"�fKXR6-:ROKPU.2�}J243LKN}J2�<V-DRV-=:C]<V-DROKP=.0e-"�fKPRW/#-D0e}�P=.Q:KNM�-"�xM6=.0e3WK`3FR>2�0eM6/.'��(2�<>2��(?(-:0JR(=.0J�P/#R>=�KX0e}SKNM�-:Rw2!3O=.9 2�RwIJKX0*Q�-:�,=._*R�RwI*2�<6-:ROKP=.0e-"�P2=:CBR>I*26KP<�-:~*~J�fKNM�-:ROKP=.0�KP0#<>24-u�¼~*<>=.�J�P2�9!3�'

;�=.01US2�01ROKP=.0e-u�|R><V-uKX0JKP0*Q�KP0�R>I*2(~*IJ/�3WK`M�-u�[3wMwKX2�0eM6243bM6=.0eM62�0JR><V-:Rw243]-:R>Rw2�01ROKP=.0�¶4·.·���=.0 ~*IJ/�3LKNM�-"�y~*<>24}SKNM6�ROKP=.0 �*RwI*2�?G=.<V}��wKP0JCp2�<>2�0eM624� ?(-.3�0*2�U.2�<(_*R>Rw2�<>24} =S0eM62bKX0�-"�f�zR>I*2�3>MwKP2�0eM62�M6=._*<63O243��]2�U.2�<GR>=J=.�^'H)¨I*2�<>26CE=S<>2.YR>I*2!-D�e=:U.2 26�e-:9 ~J�P2?¨-S3�M>I*=13F2�0t�e24M�-:_e3F2 KPRV3¢<V-:ROKP=.0e-"�P2�KN3�Mw�P24-:< -:0e}�R>I*2-.M6R>_e-"�(M�-"�NM6_J�`-DROKP=.0tKN3�_*R>R>2�<F�X/R><OKPUSKN-"� �B/.2�R�KPRV3¢~e=:?G2�<�R>=�/SKP26�N}�0*=.R�=.0J�P/t<>243O_J�PRV3¢R>Ie-:R�~*<>2�U.KP=._e3W�X/d<>24�._JKP<>24}d9 =.<w2 ?G=.<>�#�*_*Ri-"�N3O=#9�=.<>2}J2�RV-"Kf�N3b-:�e=._*R�R>I*2�9#YJKN3b-:~*~e-:<>2�0JR�-:RG=.0eM62.'

)[=#-:~*~*<>24MwKN-:Rw2�RwI*2�}SKN3ORFKX0eM6RFKX=S08�,2�RW?G2�2�0t~*IJ/*3LKNM�-"�]~*<>24}SKNM6ROKP=.0v-:0e}%KX0JCp2�<>2�0eM62iKPR¢K`3b243w3O2�01RFK`-u�]R>=�<>24M6�=.Q.0JK ��2 RwIe-:R�~*<w=.~e=13WKXRFKX=S0e3�-:R�RO?G=�}SKf�z2�<>2�0JRb�P2�U.26�N3�-D<>2�KX0JU.=:�PU.24}^'i�L0t~*IJ/�3LKNM�-"�]~*<w24}SK`M6RFKX=S08?G2 -:<>2iR><>/SKP0*QR>=�}J243>M6<OKP�e2�R>I*2<>24-"�G?G=.<O�N}��yKP0tKP0JCp2�<>2�0eM62�?G2!-:<>2�}J243>M6<OKP�JKP0*Qt=.0J�P/t=S_*<�3ORV-DR>2 =:C(�J0*=u?¨�X24}JQS2�-:�,=._*RiR>I*2?G=.<O�N}^'yg ~*IJKf�P=13O=.~*I*2�<(?G=._J�N}3>-"/iR>Ie-:R]~*IJ/*3LKNM�-"�z~*<>24}SKNM6ROKP=.0�=.~e2�<6-:R>243G-:R]RwI*2(=.0JR>=:�P=.Q:KNM�-"�,�X2�US26�ûY�KX0JCp2�<>2�0eM62-:R�R>I*2 2�~JKN3OR>2�9 =D�X=SQ:KNM�-"�G�X2�US26�û'�ªe-uK��P_*<>2�Rw= 3O2�2 RwI*2�}SKN3OROKP0eM6ROKP=.0v�,2�RO?x2�2�0�<>24-"�fKPRO/8-:0e}�=S_*<��J0*=u?¨�X24}JQS2!=:C<>24-"�fKPRO/ ~*_*RV3�_e3�=.0 R>I*2��G=:/1-"�z�G=1-.}�R>=�;]=.0JCp_e3LKP=.0 �JR>IJKN3]_e3F_e-"�f�X/RV-:�S243BR>I*2�CE=S<>9 =:CzR>I*2�a%KP0e}!@�<>=��O24M6ROKP=.0ªe-u���N-.M6/.Y^}SKN3>M6_e3>3O24}��,26�X=:?�'

)¨I*2�M6=.0JCE_e3WKX=S0�~*<>=�M62�24}*3�R>=iR>I*2bCp=:�f�P=u?¨KX0*Q�R>2�<>9iKP0e-"�z~*Ie-.3O2 s - �G-4/S243LKN-:0�M�-u�`M6_J�N-:RFKX=S0#�fKP�.2�R>I*2¤-D�e=:U.2=.0*2�=.~e2�<V-DR>243G=.0�R>I*2�2�~JKN3OR>2�9�=:�P=.Q:KNM�-"�y�X2�US26��-:0e}%Q:KPU.243�_e3(=.0J�P/�R>I*2��e243ORb~*<>24}SKNM6ROKP=.0e3¢R>Ie-:R�M�-:0��e2�9!-.}J2

Page 7: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

® ®

Cp<>=.9 R>I*2iKP0JCp=.<>9!-DROKP=.0tR>Ie-:R�?(-.3b_e3F24}�KP08R>I*2 M�-"�NM6_J�N-:ROKP=.0z'��]_*RbKPR¢K`3i-"�P?(-"/�3b~,=13>3LKP�J�P2R>Ie-:RbKP08RwI*2 <>24-"�?G=.<O�N}�R>I*2�<>2�-:<>2�26�*R><V-tM6=S01R><w=:�f��KP0*QdCû-SM6R>=.<V3�=:C�?(IJKNM>I§?G2#?G2�<>2�_*0e-"?(-:<>2��(3O=t=S_*< ~*<>24}SKNM6ROKP=.0e39!-"/t�,2?(<>=S0*Qe'B)GI*2�0�=.0*2�?�I*=�M6=S0JCE_e3O243¨KP0JCE2�<w2�0eM62�?GKPR>I�~*IJ/�3WK`M�-u�H~*<>24}SKNM6ROKP=.0�?G=._J�N}<>2�W24M6R�R>I*2�M�-"�NM6_J�N-:ROKP=.0t-:0e}R>I*2�9 2�RwI*=�}��*�*_*R�KP0 3O= }J=:KP0*QI*2�?G=._J�N}9iKN3>3�R>I*2�~e=DKX0JRb2�01ROKP<>26�P/.'

ª�=.< =.0*2�?�I*=t_*0e}J2�<V3ORV-D0e}*3 R>I*2#}SKf�z2�<>2�0eM62��e2�RO?G2�2�0�R>I*2�2�~JKN3OR>2�9�=:�P=.Q:KNM�-"��-:0e}�=.0JR>=:�P=.Q:KNM�-"�(�P2�U.26�N3�Y-�?�<>=.0*Q#~*<w24}SK`M6RFKX=S0�K`3¢0*=.R�}SKN3>M6=S0eM62�<>ROKP0*Q �G�._JKPR>2R>I*2=.~*~e=13WKXRw2.'#ª*=.<�I*=:?�26�`3F2#M6=._J�N}t?G2 Ie-"U.2i�P24-:<w0*24}-:�,=._*RBR>I*=13O2G_*0*�J0*=:?(0�Cû-.M6Rw=.<V36±i��R�K`3y=S0J�X/i?(I*2�0i=._*<B2�~JKN3ORw2�9 =:�P=.Q:KNM�-"�^~*<>24}SKNM6ROKP=.0e3yC�-"Kf�eR>Ie-:Ry?G2]�P24-:<w0 0*2�?R>IJKP0*Q13�-:�e=._*RBRwI*2(<>24-"�*?G=.<O�N}��.R>I*=J3O2�-:<>2 �O_e3ORBR>I*2(M�-.3O243�?(I*2�<>2(~*<w=.�e-:�JKf�fKXRO/iR>I*2�=.<w/�KN3B~,2�<OCE=S<>9iKP0*Q�KPRV3�9 =13ORUu-u�X_e-D�J�X2�CE_*0eM6ROKP=.0z'()¨I*2�<>26CE=S<>2.YeRw= <>2�O24M6R�-!�G-"/.243LKN-:0�M�-"�NM6_J�N-:ROKP=.0��e24M�-:_e3F2�KPRbIe-.3�Q:KPU.2�0#_e3b-:0�KP0eM6=.<w<>24M6R~*<>24}SKNM6ROKP=.0�KN3¨�fKX�S2�}SKN3>M6=S0*0*24M6ROKP0*Q -�{e<>2 -"�N-:<>9 �,24M�-:_e3O2iR>Ie-:R�-:0*0*=:/.KP0*Q�e26�f�]�.2�2�~e3�<OKP0*Q:KP0*Qe'�@B<>=S�e-:�JKf��KPRO/R>I*2�=.<w/ KN3�R><>/SKX0*Q�R>=iR>26�f�H_e3(3F=.9 2�R>IJKP0*QiKP9 ~,=.<>RV-:0JR4Ye-D0e}�KXRb�e2�I*=J=:U.243G_e3GRw=i�fK`3FR>2�0z'

���#� � �� � ������z�¢����"� � �^�����]�%�����R�KN3GU.2�<w/!}SK �M6_J�PR�R>=iQ.2�R�R>IJKN3G~e=DKX0JR�-.M6<w=13>3�R>=�RwI*=13O2b?(I*=iR>IJKP0*�!R>Ie-DR]KP0#}J=:KP0*Q ~*<w=.�e-:�JKf�fKXRO/�M�-"�NM6_J�N-:ROKP=.0e3R>I*26KP<(24�S_e-:ROKP=.0e3(-D<>2�}J243>M6<OKP�JKP0*Q�R>I*2b<>24-"�¼?G=.<O�N}^'B��_*R(R>Ie-:R�KN3bMw�`-uKX9�KX0*Q�3O=.9�2�R>IJKP0*Q R>Ie-:RG=.0*2�M6=._J�N}%0*2�U.2�<�J0*=u? R>=��e2#Rw<>_*2��G?G2�M�-"�f�bKPR R>I*2#a%KP0e}�@B<w=��O24M6ROKP=.0 ª,-"�f�N-.M6/.' )¨I*2#-:0e-"�P=.Q./dKN3iR>=8-�9 =:USKX2�~*<>=��O24M6R>=.<"Y?(I*2�<>2��J/�R>IJKP0*Q13bR>Ie-:R�26�JKN3OR�=.0J�P/t-.3b9!-:<w��3b=.0t-ROKP0J/ 3ORw<OKP~t=:C]{*�P9 -:~*~e24-:<�Rw=��e2 <>24-u�H=.� �W24M6RV3b9�=uUSKP0*Q-.M6<>=J3>3�-��N-:<>Q.2i3>M6<>2�2�0z'�Z:KP9iKf�N-:<O�P/.Yy?x2i-:<>2i-"�f�H_*0e}J2�<�-:0�2�Q.=:��}J<FKXUS2�0 Rw2�9 ~*RV-:ROKP=.0�R>=~*<>=��O24M6R(=._*<b~*<OKPUu-:Rw2R>I*=._*QSI1RV3�=._*RB=.0JR>=�RwI*2(<>24-"�^?x=S<O�N}^Y.�J/!3O_*~*~e=J3LKP0*Q�RwIe-:R]R>I*2bM6<>24-:ROKP=.0e3�=:Cz=.0*2.��3�=:?(0�KX9-:Q:KP0e-:ROKP=.0#-:<w2(<>24-"�~*<>=.~,2�<>ROKP243�=DCx��-:Rw_*<>2.Y^=.<bR>Ie-:Rb=.0*2.��3b=:?(0�KPQ.0*=S<V-:0eM62 3LKPQ.0JKf{e243i3O=.9 2��.KP0e}�=:C�KP0e}J24MwK`3WKX=S08=.0�R>I*2i~e-:<wR�=:C�b-:R>_*<>2.'

)¨I*2�M6_*<><>2�0JRy�fKXRw2�<V-:R>_*<>2�=:C��S_e-:0JR>_*9 R>I*2�=S<>/�KN3]3w-:R>_*<V-:Rw24}�?¨KXRwI R>I*2(a%KX0e}@B<w=��O24M6ROKP=.0 ªe-"�f�N-.M6/.']a�-:0J/=:CB_e3G?G2�<>2b{e<V3OR�R>=:�N}^Ye-.3G_*0e}J2�<wQ.<V-.}J_e-:Rw243�Ye-:�,=._*R���=13O2�-:0e}�ª�2�<>9iKH3FRV-:ROKN3OROKNM�3G�J/�-:0#-:<>Q._*9�2�01RG�fKP�.2�R>IJKN3 s�6£B=._�-D0e}��zM�-:0*0*=.R¼}SKN3ORFKX0*QS_JK`3FI �e2�RO?G2�2�0�R>I*2]~e-D<>ROKNMw�P243� n�� - o -���� o -GR>I*2�~e-:<>ROKNMw�P243[�e2�Ie-"U.2x}SKf�z2�<>2�0JRO�P/�R>Ie-:0bKfC?G2xM6=._J�N}^'��¢c(<BR>I*2�9�/*3OR>2�<FKX243[=:CeR>I*2�_*0eM62�<>RV-"KP0JRO/�~*<OKP0eMwKP~J�P2�?G2�<>2B26�*~J�N-"KP0*24} R>=�_e3yR>I1_e3 s ��)GI*2G9 =.9 2�0JR>_*9=:CBR>I*2�~e-D<>ROKNMw�P2�KN3�_*0*�10*=:?(0 � n�� - o -���� o -�KPRbIe-.3b-iIJKPQ.I��.KP0*2�ROKNM�2�0*2�<>Q./.'���g 3ORV-:0e}*-:<6}�=:Cy�P=.Q:KNM�R>Ie-:R(?G=._J�N}�e2 M6=.0e3WK`}J2�<w24} -�~e3O/*M>IJKN-:Rw<OKNM�}SKN3O=S<V}J2�<bKP0 =SR>I*2�<G{e26�N}*3�Y^KN3�R>I*2�-SM�M62�~*R>24}�0*=.<>9 KX0t�S_e-:0JR>_*9 RwI*2�=.<>/.'(��_*RR>IJKN3¨K`3¨<>24-"�f�P/#-�CE=S<>9 =:C]-:<><>=SQ1-:0eM62.Y*-.3�KfC]=.0*2�?G2�<>2�Mw�N-"KP9iKP0*Q�R>=!M6=.0JR><>=:�¼�b-:R>_*<>2b�J/�~e3O/�MwI*=.�SKP0*243LKN3�'

�L0�=._*<�9 =.<>2�I1_*9i�J�P2#USKP2�? =:C�RwIJKX0*QJ3�YGR>I*2�~*<>=.�e-D�JK��fKPRO/ }SKN3OR><FKX�*_*RFKX=S0e3R>Ie-:R ?G2�_e3O2%CE=.<�KX0JCp2�<>2�0eM62}J=�0*=.R�}J243wM6<OKP�e2 -D01/t~*<w=.~e2�<>RO/�=:C�RwI*2!?G=.<O�N}^Yy=.0J�P/v-#M62�<>RV-uKX0�3FRV-:R>2 =DCxKP0JCp=.<>9!-DROKP=.0�-:�e=S_*R�R>I*2?G=.<O�N}^')GIJKN3�K`3�0*=.R �O_e3OR!- ~*IJK��P=13F=.~*IJKNM�-"��~e=13WKXRFKX=S0 �(KPR QDKXUS243 _e3�KP9 ~,=.<>RV-D01R Rw24M>I*0JKNM�-"��-.}JUu-D01RV-DQ.243i�e24M�-D_e3O2#=:CR>I*2�9 =.<>2 �e26�JKP�J�X2d?¨-"/�?G2 M�-:0§R>I*2�0�_e3O2�~*<>=.�e-:�JKf�fKPRO/�R>I*2�=.<w/.'���0 -S}*}SKXRFKX=S0 Rw=tQ:KPU.KP0*Qv_e3�R>I*2#9�24-:0e3R>= _e3F2�~*<OKP=.<�KP0JCE=.<w9!-:ROKP=.0zYJKPRb9!-:�.243�-:0 -:0e-u�X/JROKNM�-"�H-D~*~e-:<V-:R>_e3�-4U:-"Kf�N-:�J�P2iCE=S<�3O_eMwI#R>IJKP0*Q13b-.3G26�fKP9iKP0e-:ROKP0*Q0J_JK`3w-:0eM62(~e-:<V-D9 2�R>2�<V3�Y:-:Rz?�IJK`MwI =.<wR>I*=�}J="��9 2�R>I*=*}*3B-:<>2�I*26�X~J�P243>3�'])GIJKN3[KN3B-b9!- �O=.<^<>24-.3O=S0�Cp=.<zRwI*2xQS<>24-:R>2�<M6=.9 ~*_*R6-:ROKP=.0e-"�¼2��MwKX2�0eM6/�=DCHR>I*2�+D26��<w2�/�3G9�2�R>I*=�}*3¨KP0 }*-:R6-�-D0e-"�P/�3LKN3�'

�L0�=._*<�3O/*3OR>2�9#Y^-� o � k>q1k )� ) n � KN3�- RwI*2�=.<>2�ROKNM�-"�xM6=.0e3FR><>_eM6R4Y,=.0�R>I*2�2�~JKN3ORw2�9 =:�P=.Q:KNM�-"���X2�US26�ûY[?(IJKNM>I�?G2-.3>3WKXQS0�KX0§=.<V}J2�< Rw=t<>2�~*<>243O2�0JR!-t3FRV-:R>2=:C��10*=:?G�P24}JQ.2.YG=.<�R>Ie-:Ri?G2#M�-"�NM6_J�`-DR>2�Cp<>=.9 =SR>I*2�< ~*<>=.�e-D�JK��fKPROKP243-.M�M6=.<6}SKX0*Q�R>=�RwI*2 <>_J�P243�=:C(~*<>=.�e-:�JKf�fKPRW/dR>I*2�=.<>/.'g�� o -����(-�� r�� K`3�-�~*<>=S~e2�<>RO/�=:C(R>I*2 <>24-u�]?x=S<O�N}^Y¼=S0tR>I*2=.0JR>=:�P=.Q:KNM�-"�,�P2�U.26��Y1RwIe-:R]?G2(9 24-S3O_*<>2(=.<�243OROKP9!-:Rw2.']Z.=¢CE=S<]_e3�YS~*<>=.�e-:�JKf�fKPRW/�R>I*2�=.<>/�KN3�0*=.Rx-:0%c(<V-.Mw�P2�Rw26���fKP0*QI*=:?ARwI*2�?G=.<O�N}�9i_e3ORb�e2��,KPRbKN3�-�9!-:R>I*2�9!-DROKNM�-"�¼R>=J=:�yCE=.<�=.<>Q1-:0JK �6KP0*QeYz-:0e}�2�0e3O_*<FKX0*Q�RwI*2�M6=.0e3LKN3ORw2�0eM6/ =DCFY=._*< =:?(0�<>24-.3F=.0JKP0*Qe'���_*RiKPRiKN3iCp<>=.9 R>IJKN3�=.<>Q1-D0JK ��24}�<w24-.3O=.0JKP0*QtR>Ie-DR ?G2�X24-D<>0v?(I*2�R>I*2�< =S_*<!3ORV-:Rw2!=:C�J0*=u?¨�X24}JQS2�KN3(-.}J24�S_e-:R>2�R>= }J243>M6<OKP�e2iR>I*2�<>24-u�¼?G=.<O�N}^'

)¨IJK`3[~e=DKX0JRBM6=.9 243z-.M6<w=13>3^9i_eMwI�9 =.<>2]3ORw<>=.0*Q:�P/�KX0�=._*<y0*26��Rz26�e-:9 ~J�P2.Y:?(I*2�<w2]�e26�fKP26C|RwIe-:Rz~*<>=.�e-D�JK��fKPROKP243-:<>2�<w24-"�¼~*IJ/�3LKNM�-"�B~*<>=.~,2�<>ROKP243b~*<>=*}J_eM6243�-�9!- �W=.<(�S_e-:0e}*-:<>/�Cp=.<��S_e-:01Rw_*9 R>I*2�=S<>/.YJKP0#R>I*2i&]@�� ~e-:<6-.}J="��'��R�KN3]3O=��e-.}iR>Ie-:R]3F=.9 2GIe-"U.2�M6=.0eMw�P_e}J24}^Y*?GKPR>I�R>I*2(_e3O_e-"�|M6=S0e3LKN3OR>2�0eM6/ =:C¼�S_e-:0JR>_*9 R>I*2�=.<>/.YSR>Ie-:RG�V¶D�zR>I*2�<>2KN3(0*=�<>24-"�z?G=.<O�N}^Ye-"CpR>2�<�-"�f��Ye-:0e} �W¦J�B~*IJ/�3LKNM�-"�[KX0 �e_*2�0eM6243¢R><V-"U.26�,Cû-.3FR>2�<(R>Ie-:0�fKPQ.IJR4'

�i��� �� ��� ��� � � � �����

Page 8: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

² ²

µ(_e-:0JR>_*9 a#24MwIe-:0JKNM�3��>µ�ad��K`3-�3O/�3FR>2�9 =DC¤9!-DR>I*2�9!-:ROKNM�3�R>Ie-:R?(-.3i0*=.R�}J2�U.26�P=.~e24}§R>=�26�*~*<>243>3-:01/~e-:<>RFK`M6_J�N-:<�~*I1/*3LKNM�-"�^KN}J24-.3�YSKP0�R>I*2¤3F2�0e3O2�RwIe-:RGR>I*2�9-:R>I*2�9!-:RFK`M�3�=:C¼<>26�N-:RFKXUSKPRO/ R>I*2�=.<>/�26��~*<>243w3O243�R>I*2(KN}J24-.3=:C¤&HKP0e3OR>26KP0zY]=S<�R>Ie-:R�=:C�Q.2�0*2�RFK`M�3�26��~*<>243w3O243�R>I*2 KN}J24-.3�=:C¤a�2�0e}J26��'t�(-:R>I*2�<4YHKXRiQ.<w2�? 2�9 ~JKP<OKNM�-"�f�P/.Y(=:U.2�<-:�,=._*R�Cp=._*< }J24M�-.}J243�YyR>I*<>=S_*Q.I8-%�P=.0*Q 3O2�<FKX243�=:C(R><OKN-"�f��-:0e}S�12�<w<>=.<�3FR>2�~e3�'���_*R!µ�a Ie-.3�RO?G=#}SK �M6_J�PROKP243�{e<V3ORF�X/.Y"�fKP�.2�-u���e2�9�~JKX<FK`M�-u�|24�S_e-:ROKP=.0e3�Y:R>I*2G~*<>=*M6243>3y�J/�?(IJKNM>I�KXRB?(-.3�Cp=._*0e}�Q:KPU.243y0*=¤Mw�P_*2�-S3yR>=(KPRV3y9�24-:0JKP0*Qe'µ�a Ie-.3bRwI*2�-.}*}SKPROKP=.0e-"�x}SK �M6_J�PRO/�R>Ie-:R�KPRV3(~*<w24}SK`M6RFKX=S0e3�-:<>2¢KP0eM6=.9 ~J�P2�R>2.Y¼3WKX0eM62�KX0�Q.2�0*2�<6-"�¼KPR�Q:KPU.243�=.0J�P/~*<>=.�e-D�JK��fKPROKP243�KP0e3OR>24-.}=DCH}J26{e0JKPR>2�~*<>24}SKNM6ROKP=.0e3�Ye-:0e}�KPR�}J=J243]0*=SR]KP0e}SKNM�-:R>2�?(Ie-:RG26�*R><V-¢KP0JCE=.<w9!-:ROKP=.0�?G=._J�N}�e2�<>24�S_JKX<w24}�R>= 9-:�.2�}J26{e0JKXRw2�~*<w24}SK`M6RFKX=S0e3�'

&HKP0e3OR>26KP0 -:0e} Z1MwI*<��=1}SKP0*Q.2�<!3>-"? R>IJKN3¢KP0eM6=.9 ~J�P2�R>2�0*243>3�-.3�-�}J26CE24M6R!M�-u���fKP0*QdCE=.< M6=.<w<>24M6ROKP=.0dKX0�3F=.9 2Cp_*R>_*<>2�9 =.<w2�M6=.9�~J�X2�Rw2�R>I*2�=.<>/.'v�¨KX26�N3��=.I*<iR><OKP24}�KP0e3OR>24-S}�R>=�R>_*<>0�KPRiKP01Rw= - 9 2�<OKPR �J/�{eR>ROKP0*Q�KPRiKP0JR>=IJKN3(~*IJKf�P=13O=S~*I1/�=:CBM6=.9 ~J�P2�9 2�0JRV-:<OKPRO/.Ye-.M�M6=.<6}SKX0*Q�R>=i?(IJKNM>I�=.0*2�M�-:0Ie-4US2�RW?G=i}SK��z2�<>2�0JR�3O2�R63G=:CHM6=.0eM62�~*R63�Y9i_*R>_e-"�f�P/ KP0eM6=.9�~e-:ROKP�J�P2.Ye=.0*2�3F2�Rx9�24-:0JKP0*Q:CE_J�[KX0�=.0*2�3LKPR>_e-:ROKP=.0zY*RwI*2�M6=.9 ~J�P2�9 2�0JRV-:<>/!3F2�R]KP0�-:0*=.R>I*2�<4'yg�33O2�U.2�<6-"�z=:C¼IJKN3(24-D<O�P/�-.M��S_e-"KP0JRV-:0eM6243�Ie-4US2�R>243FROKf{e24}��W�G= ��2�01RV-u�ûY[¶4³.¬:¸*�6Y.R>I*2bKN}J24-i=:C]M6=.9 ~J�P2�9 2�0JRV-:<FKXRO/Ie-.}RV-:�S2�0#M6=.01Rw<>=:�z=:C¼IJKN3�9iKP0e}#/S24-:<V3��e26Cp=.<>2�I*2�3ORV-:<>Rw24}R>= 3OR>_e}J/��._e-:0JR>_*9 ~*IJ/*3LKNM�3�'

��=.I*<"��3��";]=.~,2�0*Ie-:Q.2�0 )¨I*2�=.<>/*�#I*26�N} R>Ie-:R4YB2�US2�0�?(I*2�0vR>I*2�µ�a»3OR6-:R>2U.24M6R>=.<iQ:KPU.243�=.0J�P/8~*<w=.�e-:��JKf�fKXRFKX243�YyKPRbK`3�-�M6=.9 ~J�P2�R>2!}J243wM6<OKP~*ROKP=.0t=:CG<>24-"�fKPRW/�KP0tR>I*2 3O2�0e3F2 R>Ie-:Rb0*=.R>IJKP0*Q#9�=.<>2�M�-D0t2�U.2�<��e2��10*=:?(0 �0*=.R��e24M�-:_e3O2=:CGR>24M>I*0*=D�X=SQ:KNM�-"�G��KP9iKPRV-DROKP=.0e3�Yy�*_*R�-.3�-�9!-DR>R>2�<�=:C�CE_*0e}*-:9�2�01RV-u�x~*<OKP0eMwKP~J�P2.'#�LR�3O2�2�9 24}dR>=&yKP0e3ORw26KX0�R>Ie-DRxRwIJK`3bM6=.9 ~J�P2�R>2�0*243w3�Mw�`-uKX9�?(-.3(-iQS<V-:R>_JKPR>=._e3G-.}*}SKPROKP=.0zY,KP0�0*= ?(-4/M�-"�f�X24}%Cp=.<(�J/!RwI*2�C�-.M6RV3�-:0e}dI*2!Rw<OKP24}�R>=#<>26Cp_*R>2�KPR��J/�KP0JU.2�01RFKX0*QdR>I*=._*Q.IJR�26�*~e2�<OKP9 2�0JRV3i?�IJK`MwI�?x=S_J�`}�2�0e-D�J�X2�=S0*2!R>=�Q.2�R�9�=.<>2KP0JCE=S<>9!-:ROKP=.0dR>Ie-:0t��=.I*<�?GKN3OI*24}d_e3�R>=Ie-"U.2.'Z.=.9 2�I*=:?�Y^R>I*2i�,26��KP26C�Ie-.3b�e2�2�0�~*<>=.9i_J�PQ1-:Rw24}#RwIe-:R���=.I*<3O_eM�M6243>3WCE_J�f�P/ -:0e3F?x2�<w24}�-"�f�¼=:C]&yKP0e3OR>26KP0z��3�=.�$�O24M6ROKP=.0e3�'

��_*R ?�I*2�0�?G2�26��-D9iKP0*2 ��=.I*<4��3i-:<wQ._*9 2�0JRV3�Y�?x2�{e0e}�-dM6=.9 9 =.0��P=.QDK`M�-u�¤3OR><>_eM6Rw_*<>2��(-"�P?(-4/*3iR>I*2�/3ORV-D<>R!�J/�~,=13OR>_J�N-:RFKX0*Q§R>Ie-:RR>I*28-"Uu-uK��N-:�J�P2�9 24-.3O_*<w2�9 2�01R#-D~*~e-:<V-:R>_e3�KN3#3O_*� �W24M6R�R>=�IJKN38�6_*0eM62�<wRV-"KP01RO/*��fKP9iKPRV-:ROKP=.0e3�b-:0e}vRwI*2�0v�1/�_e3LKP0*Q8=S0J�X/vMw�N-.3>3LKNM�-"��~*IJ/�3LKNM�3%��243>3O2�0JROKN-"�f�P/.YG=.0J�P/�\,KP=._*USK��f�P2.��3R>I*2�=S<>2�9���R>I*2�/M6=.9 2�R>=�R>I*2 M6=.0eMw�P_e3LKP=.0vR>Ie-:R�3O_eMwI8-:08-D~*~e-:<V-:R>_e3�M6=S_J�`} 0*=.R��,2 _e3O24}�Cp=.<�&yKP0e3ORw26KX0z� 3�~*_*<w~e=13O2.' ��=.I*<"��3Cp=.<>2�Q.=.0*2(M6=.0eMw�P_e3LKP=.0KN3�-"�P?¨-"/*3B-.3>3O_*<w24}i�1/iIJKN3�KP0JKXRFK`-u��~,=13OR>_J�N-:Rw2.Y.?(IJKNMwI!3LKP9 ~J�P/�-D~*~e24-:<V3�=._*RB=:C^0*=u?�I*2�<>2.'��0=._*<�U.KP2�?�YJR>I*2�0zYJR>I*2�KN3>3O_*2b<>2�9!-"KP0e3�=.~e2�0�-:0e}�?G2(9i_e3OR]<V-uK`3F2�=._*<G3ORV-:0e}*-D<V}*3B=:C^�P=.Q:KNM��e26Cp=.<>2bR>I*2�<>2�M�-:0�e2i-:0J/!I*=.~,2�=:Cy<>243O=:�PUSKX0*Q�KPR4'

\�243L�fKX2��G-"�f�P2�01ROKP0*2��V¶4³J®:·J��-D0e-"�P/ ��24}iRwI*2¨��=.I*<G-:0e}i&yKP0e3OR>26KP0~e=13WKXRFKX=S0e3]-:0e}i3OI*=:?G24}�R>Ie-:RB9i_eM>Ii=:C^R>I*2MwIe-:01RFKX0*QR>= RwI*2�26��24M6RbR>Ie-:R�����=.I*<b?G=.0zY*&yKP0e3OR>26KP0��P=13ORV��KN3�3F_e3ORV-"KP0*24}��J/��._*=.RFKX0*Q�&yKP0e3ORw26KX0z� 3bU.KP2�?�3b-:0e}-:R>Rw<OKP�*_*ROKP0*Q#R>I*2�9 R>=#��=.I*<4'©�KP<>R>_e-"�f�P/8-"�f�(~*I1/*3LKNMwKN3ORV3�?(I*=�}J=#<>24-"�x�S_e-:0JR>_*9i�19�24M>Ie-:0JKNM�-"�(M�-"�NM6_J�N-:ROKP=.0e3KP01Rw2�<>~*<>2�R#RwI*26KX<�<>243O_J�PRV3�KX0 R>I*283O2�0e3O2d=:C�&HKX0e3FR>26KP0zY�-.M�M6=S<V}SKP0*Q�R>=v?(IJKNMwIA-v~*_*<w283ORV-:Rw2#<>2�~*<>243F2�01RV3�-:02�0e3O2�9i�J�P2t=:C 3LKP9iKf�`-D<O�P/ ~*<w2�~e-:<>24} 3O/*3OR>2�93!-:0e} KN3�RwI1_e3�-:0 KP0eM6=.9 ~J�P2�R>2v}J243>M6<OKP~*ROKP=.0 =:C -:0§KP0e}SKXUSKN}J_e-"�3O/*3OR>2�9#'B��=.I*<4� 3BM6=.9 ~J�P2�R>2�0*243>3GMw�N-"KP9 Ie-.3�0*2�U.2�<]~J�N-"/.24} -D01/¢CE_*0eM6ROKP=.0e-u�|<>=:�P2GKP0�-:~*~J�fKNM�-:ROKP=.0e3�Y*-:0e}�KP0R>Ie-:R3O2�0e3O2¢KPRGKN3GKP0e}J2�24}�Q.<V-:Rw_JKXRw=._e3�'

� � �)��������G����"� � � � �������� ����]�����"� ���@B_*R9 =13FR �*<OKP2��e/.Y�&HKX0e3FR>26KP0 I*26�N}�RwIe-:R R>I*2dµ�a­CE=S<>9!-"�fKN3O9´K`3�KP0eM6=.9 ~J�P2�R>28-D0e}vR>Ie-:R�KXR�KN3R>I*2 �O=.�v=:CR>I*2�=.<w2�ROKNM�-"�H~*IJ/*3LKNM�3bR>=!3O_*~*~J�P/�R>I*2�9�K`3w3LKP0*Q�~e-:<>RV3�,�]=SI*<¤Mw�N-"KP9 24}�RwIe-:R(R>I*2�<>2i-:<>2�0*=!9iKN3>3WKX0*Q�~e-D<>RV3�'()[=9 =13FR4YyR>I*26KP< ~e=13WKXRFKX=S0e3!3O2�2�9�24}v}SK`-D9 2�R><OKNM�-"�f�P/�=.~*~,=13O24}���I*=:?x2�US2�<4YyKfC¤?G2�M�-:0v_*0e}J2�<V3OR6-:0e}��e2�R>Rw2�< ?(Ie-:R��=.I*<(?(-.3GRw<>/.KP0*Q Rw=�3w-4/.Y�KXR¨K`3�~e=J3>3LKP�J�P2�Rw= <>24M6=.0eMwKf�P2iR>I*26KP<(~e=13WKXRFKX=S0e3�-:0e}�e26�fKP2�U.2iR>I*2�9��e=.R>Iz'�&]-.MwI�Ie-.}-:0KP9 ~,=.<>RV-:0JR(R><w_*R>I�R>=iR>26�f�H_e3�'

��_*R#��=.I*<�-:0e}�&yKP0e3OR>26KP0AM6=S_J�`} 0*2�U.2�<�_*0e}J2�<V3ORV-D0e}�24-SM>I�=.R>I*2�<�e24M�-D_e3O2tR>I*2�/§?x2�<w2#R>IJKP0*�SKX0*Q§=.0}SKf�z2�<>2�01R��P2�U.26�N3�'G7�I*2�0 &HKX0e3FR>26KP0 3w-4/*3bµ�a KN3GKP0eM6=.9�~J�X2�Rw2.Y^I*2�9 24-:0e3¨KPR(KP0�R>I*2�=.0JR>=:�P=.QDK`M�-u�H3O2�0e3O2��*?�I*2�0��=.I*< 3w-4/*3�µ�a¹K`3�M6=.9 ~J�P2�R>2.Y�I*2d9 24-:0e3KPR%KX0 R>I*2t2�~JKN3OR>2�9 =D�X=SQ:KNM�-"��3O2�0e3F2.' �G24M6=.QS0JK �6KP0*Q RwIJK`3�Y�RwI*26KX<3ORV-DR>2�9 2�0JRV3G-:<>2b0*=i�P=.0*Q.2�<�M6=.0JR><V-S}SK`M6Rw=.<>/.'B�L0e}J2�24}^Y|��=.I*<4� 3]U:-:Q._*2.Y*~*_����6�fKP0*Q#3O2�0JR>2�0eM6243���-u�X?(-"/*3]QS<>=.~JKP0*QCp=.<(R>I*2�<OKPQ.I1R�?x=S<V}^Y*0*2�U.2�<�{e0e}SKP0*QKXR��!2�9 2�<wQ.2�Cp<>=.9 RwI*2�Cp=.Q!-:0e}%?x2�3F2�2�R>I*26KP<b_*0e}J2�<O�P/.KP0*Q 3F2�0e3O2.Y*KfC]?G2�.2�2�~�KP0�9iKP0e}#RwIe-:R¤��=.I*<"��3(RwIJKX0*�SKP0*QKN3b0*2�U.2�<�=.0#RwI*2�=.0JR>=:�P=.Q:KNM�-"�y�P2�U.26�]R><V-S}SKXRFKX=S0e-"�¼KP0�~*IJ/�3LKNM�3�'bg��P?¨-"/*3

Page 9: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

³ ³

I*2�KN3�}SKN3>M6_e3>3WKX0*Qv0*=SR��b-:R>_*<>2.YG�*_*R=._*<iKP0JCp=.<>9!-DROKP=.0 -:�,=._*R���-:Rw_*<>2.' ��_*R!~*IJ/�3WK`M�3�}SKN}§0*=.R Ie-"U.2�R>I*2U.=*M�-:�*_J�N-:<>/�CE=S<(26��~*<w243>3LKP0*Q KN}J24-.3�=.0�R>Ie-DRG�P2�U.26��YeI*2�0eM62�R>I*2�Q.<>=.~JKP0*Qe'

@B-D_J�x¡�KX<6-.M:Yz?(I*=�?(-.3�-u�`3F=��fKPU.KP0*QtI*2�<>2�KX0 Z.R4'!+:=SI*0z��3i;]=D���P2�Q.2-:R�R>I*2 ROKP9 2�?(I*2�08I*2-:0e}t�b-:<>=:�N}+:26�z<>2�/*3i?G2�<>2#}J=:KP0*Q�R>I*26KP< 9 =13OR�KX9�~e=.<>R6-:01Ri?G=.<>�v3LKN}J2#�J/v3LKN}J2.Y(3O2�2�9!3i0*2�U.2�<�R>=tIe-"U.2�<>24-"�fK ��24}§?(Ie-:R+:26�z<>2�/*3bIe-.}�R>==:�z2�<�IJKP9 s ~*<>=.�e-D�JK��fKPRO/�R>I*2�=.<>/#-.3bRwI*2�US2�IJK`Mw�P2iCp=.<�26�*~*<>243>3LKP0*Q�2�~JKN3OR>2�9�=:�P=.Q:KNM�-"�x0*=SROKP=.0e3�S_e-:01RFKXR6-:ROKPU.26�P/.'��R -:~*~e24-D<V3�R>=�_e3�R>Ie-DR4Y^Ie-.}d26KXRwI*2�<���=.I*<�=.<�¡�KP<V-.M�_*0e}J2�<V3OR>=J=*}�R>I*2 ?G=.<>��=:C(+:26�z<>2�/*3�YR>I*2�<>24M62�0JRIJK`3FR>=.<>/�=:C�R>I*2�=.<>2�ROKNM�-"�b~*I1/*3LKNM�3 9�KXQSI1RIe-"U.2!�,2�2�0�U.2�<>/v}SK��z2�<>2�0JR4'�)GI*2�/�?x=S_J�`} Ie-"U.2�Ie-.}R>I*2�N-:0*Q._e-DQ.2 -:0e}�Rw24M>I*0JKNM�-"��-:~*~e-:<V-DR>_e3�?GKPR>I�?(IJKNMwI ��=.I*<4� 3�KN}J24-.3!M6=S_J�`} �e2�3ORV-:R>24}�-:0e} ?x=S<>�.24}d=._*R~*<>24MwKN3O26�P/?GKPR>I*=._*R]9i/*3OROKNMwKN3O9#']�b-.}iRwI*2�/�}J=S0*2�R>IJKN3�Y*-:0e}�26��~J�N-"KP0*24}#Mw�P24-:<F�X/�R>I*2�}SKN3OROKP0eM6ROKP=.0��,2�RW?G2�2�0R>I*2=.0JR>=:�P=.Q:KNM�-"�B-:0e}2�~JKN3OR>2�9 =:�P=.QDK`M�-u�¼�P2�U.26�N3�Y^&yKP0e3OR>26KP0�?G=._J�N}Ie-"U.2�_*0e}J2�<V3OR>=J=*}KPR�-:0e}�-.M�M62�~*R>24}�KPR¤-DRx=S0eM62.'

��2�24}S�P243>3iR>=�3>-"/.Yy?x2M6=.0e3LKN}J2�<!-"�f�x=DC¤&yKP0e3OR>26KP0z��3�<>24-S3O=.0JKP0*Qt-:0e}8M6=S0eMw�X_e3WKX=S0e3!M6=.<w<>24M6R�=.0�IJKN3¢�X2�US26� ��*_*RG=.0 R>I*2b=.R>I*2�<�Ie-:0e}�?x2�R>IJKP0*� R>Ie-:RG�]=SI*<x?(-.3y24�S_e-"�f�P/�M6=S<><>24M6R]=S0!IJKN3��P2�U.26��YJKP0�3>-"/SKP0*Q�RwIe-:R]R>I*2b-.M6R]=:C9 24-.3F_*<>2�9 2�0JRB9iKPQ.I1R�~e2�<>Rw_*<>� R>I*2�3F/�3ORw2�9 �e26KP0*Qi9 24-.3O_*<>24}^YS~J�N-.MwKP0*Q�-��fKP9iKPRV-:RFKX=S0!=.0�R>I*2�KX0JCp=.<>9-:ROKP=.0 ?G2M�-:0#-.M��S_JKP<>2�-:0e}R>I*2�<w26CE=.<w2�=.0�R>I*2b~*<>24}SKNM6ROKP=.0e3b?G2¤-:<w2�-:�J�P2�R>=i9!-:�.2.'B)GI*2�<>2bKN3�0*=.R>IJKP0*Q R>Ie-DRx=S0*2�M6=._J�N}=.�$�O24M6RzR>=�KP0�R>IJKN3BM6=.0 �O24M6R>_*<>2.Y.-u�XRwI*=._*Q.I�RwI*2]�*_*<V}J2�0i=:C*~*<>=J=:C*KN3z=.0�R>I*2]~,2�<V3O=.0�?(I*=b9!-:�.243,KPR4'B��_*Ry?x2�~e-:<>RM6=.9 ~e-D01/�Cp<>=.9 ��=.I*<]?�I*2�0 R>IJKN3�9 2�RV-:9 =S<>~*I*=13O243y?GKPR>I*=S_*R]26�*~J�`-D0e-:ROKP=.0�KX0JR>=i-�Mw�`-uKX9 R>Ie-DR]R>I*2G�fKP9iKPRV-:RFKX=S0=.0�R>I*2 � o -�� ) r"n )�� � l =:CHRwI*2�~*<>243O2�0JR�µ�a Cp=.<>9!-"�fKN3O9 -D<>2�-"�N3O=i� KP0�26��-.M6R"Y*9iKP01_*Rw2�}J2�RV-"Kf�z����KP9iKPRV-DROKP=.0e3b=.0R>I*2��1- q:l � o -��1-�� nöl R>Ie-:R�M�-:0��,2�9!-S}J2bKX0�R>I*2b�N-:�e=S<V-:R>=.<w/�0

\|KX�S2#&yKP0e3OR>26KP0zYG?G2�M�-D0�3O2�2�0*=��W_e3ORFK�{|M�-DROKP=.0�-:R -"�f�(Cp=.<iR>IJKN3�QS<V-:R>_JKPR>=._e3i-.3w3O_*9 ~*ROKP=.0z'd7t2�0*2�24}v-9 =.<w2�=.<6}J2�<O�P/#}SKXUSKN3LKP=.0#=DC¼�N-:�,=._*< �JKPRGKN3(3LKP9 ~J�P/�0*=.R�R>I*2�~*<>=.~,2�<(�*_e3LKP0*243>3�=:C¼R>I*2�=.<w2�ROKNM�-"�¼~*IJ/�3LKNM�3GRw=�9-:�.2~*<>=.0*=S_*0eM62�9 2�01R63�-:�e=._*Rb?(Ie-:R�M�-:0�-:0e}�?(Ie-:R�M�-:0*0*=.Rb�e2i9 24-.3O_*<w24}�KP0�R>I*2¢�`-D�e=.<V-DR>=.<>/.Y^-:0J/�9 =.<>2�R>Ie-:0KPRG?x=S_J�`}�,2(Cp=.<(-:0 26�*~e2�<FKX9�2�01R>2�<�R>=�K`3w3O_*2�~*<>=*Mw�`-D9!-:ROKP=.0e3G-:�,=._*RG?(Ie-:RxM�-D0�-:0e}M�-:0*0*=.RG�,2�~*<>24}SKNM6R>24}�KP0R>I*2�R>I*2�=S<>/.'

)¨I*2iKN3>3O_*2=:Cx?(Ie-DR��SKX0e}d=:C���KP9iKPRV-DROKP=.0v=.0�9 24-.3O_*<w2�9 2�01R�<>24-"�f�P/t26�JK`3FRV3b��=.<bKP0e}J2�24}^YB?(I*2�R>I*2�<i-:01/�fKP9iKPRV-:ROKP=.0 -:R -"�f��26�JKN3ORV3��tKN3!3ORFK��f�(�P=.QDK`M�-u���P/ -:0v=.~,2�0 �S_*243OROKP=.0zY�R>Ie-:R �,26�P=.0*Q13�R>=tR>I*2�~*<>=:USKP0eM62#=:C�R>I*226�*~e2�<OKP9 2�0JR>2�< �*�*_*RG?G2(9!-"/i�e2�-D�J�X2bR>=i3O2�R>RO�P2�KXR(3O=J=.0�KP0�R>I*2��S_e-:01Rw_*9 =S~*ROKNM�3B�N-:�,=.<V-:Rw=.<>/.Y.RwIe-:0*��3�R>=�R>I*23O~,24M6RV-.M6_J�N-:<(<>24M62�0JRx-S}JUu-:0eM6243�KP026��~,2�<OKP9 2�0JRV-"�zR>24MwI*0JK`�S_*243(3O_eMwI�-.3BR>I*=J3O2��J/ ��'J78-u�XRwI*2�<¨-D0e}!M6=:?G=.<>�.2�<63�W�G2�9�~e2#2�R -"��Yb¶4³.²J®S�¤-.3 }SKN3>M6_e3w3O24}v�J/ ¥b0JKPQ.IJR��V¶"³.²J®.��-:0e}dKP0�R>I*2�� r ) -�� n ) � r j � - o ) r6q ���W+:_*0*2t¶"³.²J®1Y~z'e¦.º��V'

7d2(�e26�fKP2�U.2�R>Ie-:RBRw=�-.M>IJKP2�U.2b-�<V-:RFKX=S0e-"�e~JKNM6R>_*<>2b=:C|R>I*2�?x=S<O�N}�KPRBKN3B0*24M6243>3w-:<>/iR>=�3O2�R�_*~!-:0*=.R>I*2�<]Mw�P24-:<}SKPU.KN3LKP=.0�=:C^�N-:�e=._*<G?GKPR>IJKP0�R>I*2�=S<>2�ROKNM�-"�z~*I1/*3LKNM�3�SKPR�K`3�R>I*2 �O=.�!=DC�RwI*2(�N-"?�3B=DC¼~*I1/*3LKNM�3�R>=�}J243wM6<OKP�e2�~*IJ/*3LKNM�-"�M�-:_e3>-DROKP=.0t-:R(R>I*2��P2�U.26�]=:C]=.0JR>=:�P=.QS/.Y|-:0e}%R>I*2 �W=S�#=:C]~*<>=S�e-:�JKf��KPRO/�R>I*2�=.<>/�Rw=�}J243>M6<FKX�,2 IJ_*9!-:0�KP0JCp2�<>2�0eM6243-:R(RwI*2��P2�U.26�¼=:CB2�~JKN3OR>2�9 =D�X=SQ./.'()GI*2 ;�=.~e2�0*Ie-:QS2�0#R>I*2�=.<w/�3>M6<6-:9i�J�X243�R>I*243O2�U.2�<>/�}SKf��2�<w2�01R�CE_*0eM6RFKX=S0e3GKP0JR>=-i0e-.3FRW/�=.9 26�P2�R>R>2¢KX0�?(IJKNM>I�R>I*2�}SKN3OROKP0eM6ROKP=.0��e2�RO?G2�2�0#<w24-"�fKXRO/�-:0e}=._*<(�J0*=:?G�P24}JQ.2�=DCH<>24-u��KPRO/�K`3¨�P=13OR4'

g��PR>I*=._*Q.Id?x2-:Q.<>2�2 ?¨KXRwI8��=.I*<�R>Ie-DRbKX0v}SKf�z2�<>2�01RiMwKP<VM6_*9!3ORV-D0eM6243 �O}SK��z2�<>2�0JR�3FRV-:R>243b=:C(�J0*=:?G�P24}JQ.2:�}SKf�z2�<>2�01R��S_e-:01RFKXRFKX243-:<>2�~*<w24}SK`M6R6-:�J�P2.YGKP0�=._*<�U.KP2�?�R>IJKN3!}J=J243 0*=SR!M�-:_e3O2�R>I*2�M6=.0eM62�~*RV3�R>I*2�9!3O26�PU.243�R>=C�-.}J2�KP0 -D0e}v=._*R �GU:-"�fKN} M6=S0eM62�~*RV3!-D<>2�0*=.R 9i_*R>_e-"�f�P/�KP0eM6=.9 ~e-:RFKX�J�P2.'�)GI*2�<>26Cp=.<>2.YGR>=�26�*~*<>243>3�~*<>24MwKN3O26�P/R>I*2i26�z24M6R�=:Cx}SKN3OR>_*<>�e-D0eM62 �1/�9 24-.3O_*<w2�9 2�01R"Y^=.0�=._*<bKP0JCE=.<w9!-:ROKP=.0t-:0e}�=._*<�-:�JKf�fKPRO/ Rw=!~*<>24}SKNM6R4Y�KN3�0*=.R�-~*IJKf�P=13O=.~*IJKNM�-"�]~*<>=S�J�X2�9 M�-"�f�fKP0*QCE=.<(M6=.9�~J�X2�9�2�01RV-D<OKPRW/��JKPRGKN3b-iR>24MwI*0JK`M�-u�¼~*<>=.�J�P2�9 M�-"�f��KP0*QCp=.<(~*<>=S�e-:�JKf��KPRO/R>I*2�=.<w/!-.3G26�*~e=._*0e}J24}%�1/+:26�z<>2�/�3�Ye-:0e}�KP0JCE=S<>9!-:ROKP=.0R>I*2�=.<w/.'B��0e}J2�24}^Y,?G2��J0*=:? RwIe-:RGR>=:?¨-D<V}iR>I*2�2�0e}=:CIJKN3G�fKfCp2.Y|��=.I*<�3FI*=u?G24}�-:0KP0JR>2�<>243OR¨KX0%KP0JCE=.<w9!-:ROKP=.0�R>I*2�=.<>/.'

�������_*R!Rw=t<>2�R>_*<>0§R>=tR>I*2�IJKN3OR>=.<OKNM�-"��-.M�M6=._*0JR �b3O=.9 2�I*=:?�Y�9!-:0J/8~*IJ/*3LKNMwK`3FRV3�e24M�-:9�2 ~,2�<V3O_e-.}J24}§R>Ie-DR R>I*23O_eM�M6243>3�=:C(R>I*2�µ�a 9!-DR>I*2�9!-:ROKNM�-"��CE=S<>9!-"�fKN3O9 ~*<>=:U.24}dR>I*2�M6=S<><>24M6R>0*243>3�=:C��]=SI*<4��3�~*<OKPUu-:Rw2�~*IJK��P=13F=.~*I1/.Y2�U.2�0 RwI*=._*Q.I Ie-:<6}S�X/-:01/���2�U.2�0�-:9 =S0*Q�IJK`3G}SKN3>MwKP~J�P243G��_*0e}J2�<63OR>=J=�}�?(Ie-:RBR>Ie-DR]~*IJKf�P=13O=.~*IJ/ ?(-.3�'yg����^R>I*2-:R>Rw2�9 ~*RV3�=:Cx&yKP0e3OR>26KP0zY�Z1M>I*<��=J}SKX0*QS2�<4Yz-:0e}�=.R>I*2�<V3�R>=~e=:KP0JR�=._*RbR>I*2�~e-:Rw2�01RbKf�f�P=.Q:KNMi=:C]R>IJKN3b?G2�<>2i<>2�O24M6R>24}-:0e}�3O0*2�2�<w24}#-:R ��KXR¨K`3b-i?G=.<>RwI1/ ~*<w=��O24M6R]Cp=.<GCp_*R>_*<>2�~e3F/�MwI*=:�P=.Q:KN3ORV3¨R>= 26�*~J�`-uKX0�?(IJ/.'

Page 10: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4· ¶4·

)¨I*2�&HKP0e3OR>26KP0J��@y=*}J=:�N3O�1/S���G=J3O2�0��O&]@]�¤��-:<>ROKNMw�P2 =:C�¶4³.«.º�KN3�&yKP0e3ORw26KX0z� 3�9!- �W=.<b26�z=.<>RbR>=26��~J�N-"KP0�IJK`3=.�$�O24M6ROKP=.0tRw=�R>I*2!M6=.9 ~J�P2�R>2�0*243w3�Mw�N-"KP9 �1/t-:0t26�e-:9 ~J�P2 RwIe-:R�I*2!RwI*=._*Q.IJR�?¨-S3�3O=CE=S<VM626CE_J�]RwIe-:R�0*=.�e=*}J/M6=._J�N}�9iKN3>3RwI*2 ~,=:KP01R"' )G?G=v3O/*3OR>2�9!3�Y�� -D0e}�� � Y(RwIe-:R!?G2�<>2�KP0§KP01R>2�<6-.M6ROKP=.0�KP0�R>I*2�~e-.3OR#-:<w2#0*=:?3O2�~e-:<6-:R>24}^Yz�*_*R�RwI*2�/ <w2�9!-"KP0 �O=:KP01RO�P/�KP0 -~*_*<w2!3ORV-:Rw2.'�)GI*2�0�&]@]��3OI*=:?G24}#RwIe-:R�-.M�M6=.<V}SKP0*Q�R>=�µ�a -:026�*~e2�<OKP9 2�0JR>2�<�M�-:0�9 24-S3O_*<>2�-��._e-:0JROKPRO/�� KP0�� Y*?(I*2�<w2�_*~e=.0�I*2�M�-:0�~*<>24}SKNM6R�?GKPR>I M62�<>R6-"KP01RO/R>I*2�U:-"�P_*2=:C�� � KX0�� � 'G�]_*RbI*2�M�-D0#24�S_e-"�f�X/�?G26���]}J24MwKN}J2iR>= 9 24-.3F_*<>2�- �S_e-:0JROKPRO/� R>Ie-:R�}J=J243�0*=.R�M6=.9 9i_*R>2�?GKPR>I� �J?(I*2�<w2�_*~e=.0�I*2�M�-:0�~*<>24}SKNM6R�?GKPR>I#M62�<wRV-"KP01RO/R>I*2�Uu-u�X_*2i=:C� � KP0�� � ')¨I*2#3O/�3FR>2�9!3 M�-:0§�e2#3O= Cû-:<-:~e-:<>RiR>Ie-:R�0*=��fKXQSI1R�3LKPQ.0e-"�¤M6=S_J�`} Ie-"U.2�R><V-"U.26�P24}��e2�RO?G2�2�0�RwI*2�9 KP0R>I*2�ROKP9 2�KX0JR>2�<>U:-"�B�e2�RO?G2�2�0 RwI*2�� -:0e}�� � 9 24-.3O_*<>2�9�2�01RV3�'�)GI*2�<>26Cp=.<>2.Y,�J/�9 24-:0e3�R>Ie-:R�M6=._J�N}#26�*2�<>Rb0*=M�-:_e3>-u�¼KP0 �e_*2�0eM62=.0 � � -.M�M6=.<V}SKP0*Q�R>=<>26�N-:ROKPUSKXRO/�R>I*2�=.<>/.Y^=.0*2 M�-:0�~*<>24}SKNM6R�?GKPR>ItM62�<>R6-"KP01RO/#26KPR>I*2�<�=DC]RW?G=0*=.0eM6=.9�9�_*RFKX0*Q �S_e-:0JROKPROKP243�Y�� � -:0e}�� � 'B&]@�� M6=S0eMw�X_e}J24}%R>Ie-:RG�e=SR>I�� � -:0e}�� � 9i_e3OR]Ie-"U.2bIe-.}�26�1KN3ORw2�0eM62-.3G}J26{e0JKPR>2�~*IJ/�3LKNM�-"�¼�S_e-:0JROKPROKP243G�e26Cp=.<>2bR>I*2b9 24-.3O_*<>2�9�2�01RV3 �1�*_*R(3LKP0eM62�0*=µ�a�3FRV-:R>2(US24M6R>=.<BKN3GM�-:~e-:�J�P2�=:C<>2�~*<>243F2�01ROKP0*QR>IJKN3�Y*R>I*2�3FRV-:R>2�U.24M6Rw=.<(M�-:0*0*=.R(�,2�R>I*2�?(I*=D�X2i3OR>=.<w/.'

Z:KP0eM62 Rw=�}*-"/ 3F=.9 2�RwIJKX0*��R>Ie-DR�9 2�<w26�X/�R>=U.2�<OKfCp/#R>I*2 M6=.<w<>26�N-:ROKP=.0e3b26�*~e2�<OKP9 2�0JRV-"�f�P/�KN3�R>=<>26Cp_*R>2iR>I*2&]@���-:<>Q._*9 2�0JR4YD�X2�RG_e3G3OR><w243>3BR>Ie-DR]&]@]��}SKN}0*=.RG�._*243ORFKX=S0�R>I*2(26�JK`3FR>2�0eM62�=:CzR>I*2�M6=.<><>26�N-:ROKP=.0e3�Y1?�IJK`MwI�-:<>2R>=b�e2�26��~,24M6R>24}�KP0 -�Mw�N-.3>3WK`M�-u��R>I*2�=S<>/.'y��0e}J2�24}^Y.?G2�<>2�R>I*2xM6=S<><>26�N-:ROKP=.0e3B-:�e3F2�01R4Y"R>I*26KP<]-:<>QS_*9 2�01Ry-:Q1-"KP0e3ORyR>I*2µ�a CE=.<w9!-"�fKN3O9 ?G=._J�N}�Ie-"U.2�Cû-uK��P24}^'�)¨I*26KX<�M6=S9 ~J�N-"KP01R�?¨-S3(R>Ie-DR4Y*?GKPR>I�~*IJ/�3LKNM�-"�xM�-D_e3>-:ROKP=.0�_*0e-"Uu-"Kf�N-:�J�P2.Y=.0J�P/�KX0e3FRV-:0JRV-:0*2�=._e3G~e3F/�MwI*=.�SKX0*243WK`3��LR>I*2�26�*~e2�<FKX9�2�01R>2�<"��3GCp<>2�26�1?¨K��f�H}J24MwKN3LKP=.0�?(IJKNMwI#26�*~e2�<OKP9 2�0JRbR>= }J=*�yK`3�P26CER�R>= M6=.01Rw<>=:��}SKN3OR6-:01RG2�U.2�0JRV3�YJR>I*2bCp=.<VMwKP0*Qi=:C�� � KX0JR>= -:0�26KPQ.2�0e3OR6-:R>2b=:C¼26KPR>I*2�<�� � =.<�� � 'B&yKP0e3OR>26KP0 M�-u���P24}R>IJKN3i��-i3O~e=J=.�J/��.KP0e}�=DC�-.M6RFKX=S0#-:R(- }SKN3ORV-:0eM624�*'

)[=_*0e}J2�<V3ORV-:0e}�R>IJKN3�Y^?G2i9i_e3ORb�.2�2�~�KP0t9iKP0e}�R>Ie-:R�&yKP0e3ORw26KX0z� 3�R>IJKP0*�SKX0*Q%KN3�-"�P?¨-"/*3(=S0#R>I*2i=.0JR>=:�P=.Q.�KNM�-"�]�P2�U.26� �BRwI*2!~*_*<>~,=13O2 =DC¨RwI*2!&]@�� -:<>QS_*9 2�01R�?(-.3bRw= 3OI*=:? R>Ie-:R�RwI*2�µ�a 3ORV-:Rw2 U.24M6R>=.<�M�-D0*0*=.R��,2!-<>2�~*<>243F2�01RV-DROKP=.0t=:C(R>I*2 �m<>24-"�]~*IJ/�3LKNM�-"�(3LKPR>_e-:ROKP=.0e�%=:C�-#3O/*3OR>2�9�'!��=.I*<�Ie-S}�0*2�U.2�<�Mw�N-"KP9 24}�RwIe-:RbKPR�?(-.3�Y-"�PR>I*=._*QSI�IJK`3b3OR><6-:0*Q.2b?¨-"/ =DCH26�*~*<>243>3LKP0*QIJKP9!3O26�fC]=:CpR>2�0�P24}�=.R>I*2�<63]Rw= R>IJKP0*�!RwIe-:R(I*2�?(-.3GMw�N-"KP9iKP0*Q�R>IJKN3�'

ª�<>=.9 IJKN3b<>2�~J�P/�R>=�&�@]��Y,?G2�{e0e}�R>Ie-:Rb�]=SI*<4��3�~e=13LKPROKP=.0�?(-.3¨�fKX�S2�RwIJK`3 s �6£B=._#9-4/#}J24MwKN}J2.Y[=:CH/S=._*<=:?(0dCE<>2�2?GKf�f��Y]?(IJKNMwI�26�*~e2�<OKP9 2�0JR R>=�}J=e'��pC�/.=._�}J=t26��~,2�<OKP9 2�0JR�� /.=._�?GKf�f��Q.2�R�<>243O_J�PR�� '��pCb/.=._}J=�� � /S=._#?GKf�f�xQS2�R�� � 'iZ:KP0eM62iKPRbKN3bCp_*0e}*-:9 2�0JRV-"�f�P/�KP9 ~e=13w3LKP�J�X2R>=�}J=��e=.RwI =S0 RwI*2�3w-:9 2�3F/�3ORw2�9#Yz-:0e}R>I*2�~*<>243O2�0JRR>I*2�=.<>/�M6=.<w<>24M6RO�P/�~*<>24}SKNM6RV3RwI*2 <w243O_J�PRV3 =DC�26KXRwI*2�<4YbI*=u? M�-:0§/.=._ 3w-4/vRwIe-:R!RwI*2#R>I*2�=.<w/�K`3KP0eM6=.9 ~J�P2�R>2:±#7�Ie-:R�9 =.<>2�M�-:0�=S0*2�-.3O�=:C�-�R>I*2�=.<>/,±m�

7�IJKf�P2(KPRyKN3B24-S3O/iR>=�_*0e}J2�<V3ORV-D0e} -:0e}i-:Q.<>2�2G?GKPR>I�R>IJKN3B=.0iR>I*2(2�~JKN3ORw2�9 =:�P=.Q:KNM�-"�,�X2�US26�ûYJR>I*2b-:0e3O?G2�<BR>Ie-:R�(-:0e}�9-:01/=.R>I*2�<63G?G=._J�N}�Q:KPU.2¢K`3�R>Ie-:R�?x2�26��~,24M6R¤-�~*I1/*3LKNM�-"�BR>I*2�=.<>/R>=!}J=9 =.<>2�RwIe-:0#9 2�<w26�X/�~*<w24}SK`M6R26�*~e2�<OKP9 2�0JRV-"�B<>243O_J�PRV3¨KP0 RwI*2�9!-:0*0*2�<b=:C]-:0#2�9�~JKX<FK`M�-u�]24�._e-:RFKX=S0 �e?G2�?(-:0JR(R>=!M6=.9�2�}J=:?(0#Rw=!&yKP0e3OR>26KP0z��3=.0JR>=:�P=.Q:KNM�-"�*�P2�U.26�¼-:0e}�_*0e}J2�<V3ORV-:0e}�?(Ie-:RyKN3�Ie-:~*~,2�0JKX0*Q�?(I*2�0!-:0!-DR>=.9 2�9iKPRV3H��KPQ.IJR4YJ?(I*2�0�-�3O~JKP0!2�0JR>2�<V3�-Z.R>2�<>0J�,¯�2�<O�N-.MwI 9!-:QS0*2�R4Y:2�RVM:'B)GI*2�;]=S~e2�0*Ie-:Q.2�0�R>I*2�=.<>/.Y:Ie-"USKX0*Q�0*=�-:0e3F?x2�<BRw=�-:01/i�._*243FROKP=.0 =:C^R>I*2GCp=.<>9 s�67�Ie-:R¢K`3¢<>24-"�f�P/8Ie-D~*~e2�0JKP0*Qt?(I*2�0�������±��*Y[CE=.<w�JK`}*3�_e3¢R>= -.3F� 3F_eM>Iv�._*243FROKP=.0e3i-:0e}tRw<OKP243�R>=�~e2�<V3O_e-S}J2_e3�R>Ie-:R¢KXR¢KN3�~*IJKf�P=13O=S~*IJK`M�-u���ö/v0e- � �PU.2!Rw=#?(-:0JR�R>=��10*=:? ?�Ie-:R�KN3�Ie-:~*~e2�0JKP0*Qe'���_*Ri��}J=#?(-:0JR�R>=��10*=:?�Y-:0e}%��}J=!0*=SR�R>IJKP0*��R>IJKN3GKN3b0e- � �PU.2��z-:0e}�3O=�CE=.<�9 2 µ�a KN3(0*=.R�-�~*I1/*3LKNM�-"�BR>I*2�=.<>/#-:R�-"�f��Ye=S0J�X/�-:0#2�9�~*RW/9!-:RwI*2�9!-:ROKNM�-"�¼3OI*26�f�yKX0�?(IJKNM>I�-�Cp_*R>_*<>2�R>I*2�=.<w/!9!-"/.YJ~e2�<wIe-:~e3�Y,�e2��*_JKf�PR4'

���#� �i����� ��#���������������¢�+:=.I*0���26���(�6¶4³.¬:¸*�]3ORw_e}SKX24}�-3LKP9 ~J�P2i<>24-"�fK �4-:ROKP=.0�=:C]R>I*2i&]@]��3>M62�0e-:<FKX=KP0�?(IJKNM>I�RO?G=!3O~JKP0v¶ %u¦i~e-:<wROKNMw�X243}J2�0*=.R>24}�J/ gA-D0e}!�§?G2�<>2 �W=:KP0JRO�P/iKP0#-�~*_*<>2�3LKP0*Q:�P2�R�3ORV-DR>2��û��KP�.2�RwI*2�Q.<w=._*0e}!3FRV-:R>2(=DC¼R>I*2��(26�fKP_*9 -DR>=.9��KP0�R>I*2i~e-.3OR4'�)GIJKN3�KN3�KP=.0JK ��24}��1/�-!3F~JKX0J�SKX0e}J2�~,2�0e}*2�0JR�KX0JR>2�<V-SM6ROKP=.0t-:0e}�R>I*2�/#9 =:U.2bC�-:<�-:~e-:<>R"Ye�*_*R�R>I*2�/<>2�9!-uKX0 �W=DKX0JRO�P/�KX0�-i~*_*<>2i3LKP0*Q:�P2�R¤3OR6-:R>2.YSKP0#?(IJKNMwI#R>I*26KP<�3O~JKP0e3�-:<w2�~e2�<OCp24M6RO�P/#-:0JROKNM6=.<><>26�N-:R>24}^'

&�-.MwI =DCxRO?G=!26�*~e2�<OKP9 2�0JR>2�<V3�YH3FRV-:ROKP=.0*24}�-:R���-:0e}�� Y[Ie-.3�-�Z.R>2�<>0J�,¯�2�<O�N-.MwI8-:~*~e-:<6-:R>_e3�Y,?(IJKNM>I�I*2M�-:0�<>=.RV-:Rw2�R>=�-:0J/�-D0*Q:�P2.'(ª*=:�f�P=:?GKP0*Q���26�f����3b0*=.RV-:RFKX=S0zYe?G2�}J2�0*=.R>2��1/ ���� ����]R>I*2�~*<>=.�e-:�JKf�fKPRO/#R>Ie-:Rb3O~JKP0��?GKf�f�¨�,2 Cp=._*0e}�_*~dKP08RwI*2!}SKP<>24M6ROKP=.0v=:CGR>I*2!_*0JKPR�U.24M6R>=.<����1� �H-D0e}��fKX�S2�?GKN3O2 ������! "��<>26Cp2�<V3�Rw=#3O~JKP0"��e26KP0*Q_*~KP0�R>I*2�}SKP<>24M6ROKP=.0 �# ��*'Bª*=.<(-i3LKP0*Q:�P2�R�3ORV-DR>2.YJR>I*243O2�-:<>2b24-.MwI�24�._e-u��Rw=�¶ %u¦¢CE<>=S9 3F/19 9�2�R><>/.'B)GI*23O~,=1=.�J/�*_e3LKP0*243>3�-:~*~e24-D<V3�KP0#R>I*2 �O=:KP0JR�~*<>=S�e-:�JKf��KPRO/.Y,?(IJKNM>Idµ�a�QDKXUS243(-.3

Page 11: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶.¶ ¶.¶

���������� "� � ¶¦ 3LKP0��"� � �u¦J� �V¶.¶:�

?(I*2�<>2#M6=J3 � � ��� :'t)GIJKN3 }J=1243�0*=.R�Cû-.M6Rw=.<�KP0vR>I*2Cp=.<>9 ����� ���� "� � �����1��*�������� "��-.3�=.0*29iKPQ.IJR26�*~e24M6RbCp=.<(KP0e}J2�~,2�0e}J2�01Ri9 24-.3F_*<>2�9 2�0JRV3�'(7d2�M�-D0 9�24-.3O_*<>21��KP0t-:01/#}SKP<>24M6RFKX=S0t?G2�~J�P24-.3O2��[?(I*2�<>2�_*~e=S0?G2�M�-:0�~*<>24}SKNM6Rb?GKPR>I M62�<>R6-"KP01RO/R>I*2�Uu-"�P_*2�=:C � KP0#RwI*2�3>-:9 2�}SKP<>24M6ROKP=.0z'

ª�<>=.9 RwIJK`3�Y|&�@]��?G=._J�N}�0e-:Rw_*<V-"�f�P/#M6=.0eMw�P_e}J2 R>Ie-:R(RwI*2�<>243O_J�PRV3b=DC�-"�f�B~e=13w3LKP�J�X2�9 24-.3O_*<>2�9�2�01RV3¨=.0 �?G2�<>2 ~*<>24}J2�Rw2�<>9iKP0*24}��1/dR>I*2 <>24-"�G~*I1/*3LKNM�-"��3LKPR>_e-:RFKX=S08-:R� � ),+.-/+��¼KfC�?G2�{e0e} ��_*~dKP0 -D01/t}SKP<>24M6ROKP=.0 :YR>I*2�0�?G2 ?G=._J�N}�Ie-"U.2iCp=._*0e}tRwI*2!3>-:9 2�<>243O_J�PRi?(I*2�R>I*2�<i=.<�0*=SR�R>I*2 ��9 24-S3O_*<>2�9 2�0JR�?(-.3¢9!-.}J2.'���=.I*<?G=._J�N}�M6=.0e3LKN}J2�<�R>IJKN3�- 9 24-D0JKX0*QD�X243w3�3FRV-:R>2�9 2�0JR4Y^3LKP0eM62 R>I*2�<>2�KN3b0*=�?(-"/�R>=�U.2�<OKfCp/�KPR�=.<�<>26Cp_*R>2�KPR4'�g��`3F=eYI*2i?G=._J�N} 3FR><>243>3�R>Ie-:Rb?G2�M�-D0 9�24-.3O_*<>2���KP0t=.0J�P/�=.0*2 }SKX<w24M6ROKP=.0zYz?(I*2�<w2�_*~e=.0tRwI*2�~e2�<wR>_*<>�e-:ROKP=.0d=:C]R>I*29 24-.3F_*<>2�9 2�0JRx}J243OR><w=u/*3B?�Ie-:R>2�U.2�<B9iKPQ.IJR]Ie-"U.2��e2�2�0#3O2�2�0�KP0�-:0J/i=.R>I*2�<G}SKX<w24M6ROKP=.0z']��=.R>2(R>Ie-DR4Y1-.3�-"�P?(-4/*3�Y��=.I*<BKN3�2�~JKN3OR>2�9 =D�X=SQ:KNM�-"� �eR>I*2�0*=.ROKP=.0=:C¼-!�6<>24-u�|~*IJ/�3LKNM�-"�z3LKPR>_e-:ROKP=.0e�¢KN3��W_e3FR]0*=.R�KX0IJKN3GU.=*M�-:�*_J�N-:<>/i=.<�IJK`3R>IJKP0*�SKX0*Q,'

&�@]� ?GKf�f��R>I*2�0�<w24�._JKP<>2�3O=.9 2�IJKN}*}J2�0�Uu-:<FK`-D�J�X243�KP0�-.}*}SKPROKP=.0�R>=�R>I*2tµ�a»3ORV-DR>2�U.24M6R>=.<iR>=�}J26{e0*2R>Ie-:R��6<w24-"�|~*IJ/�3WK`M�-u�H3LKPR>_e-:ROKP=.0e��?(IJKNM>I%K`3¨R>=i~*<>24}J2�R>2�<>9iKP0*2�R>I*2�<w243O_J�PRV3G=:CH-u���y9 24-.3O_*<>2�9�2�01RV3�=.0 � 'G��26�f�ûY3O2�2��SKP0*Q�Rw=�-.M�M6=.9 9 =*}*-:R>2GR>I*2�9�Y1}J26{e0*243G-�Mw�N-.3>3�=:CzIJKN}*}J2�0!U:-:<OKN-:�J�P2�R>I*2�=.<OKP243H��M�-"�f�|RwI*2�9 �]26�f�zR>I*2�=.<FKX243H�KP0�?(IJKNMwI -�3O2�R =DC�Uu-:<FK`-D�J�X243�}J2�0*=SR>24}vM6=:�f�P24M6ROKPU.26�P/��J/���-"�N3O=�KP0 �e_*2�0eM6243�R>I*2�=S_*RVM6=.9 2431��-:0e} � 'v�LR-:~*~,24-:<V3GR>=�IJKX9�R>Ie-:RGR>I*2¢KP01R>2�0JROKP=.0e3G=DC�&�@]��-:<>2�26�*~*<>243>3O24}�KP0#RwI*2�9 =13FRxQS2�0*2�<V-"�¼?(-"/ �J/!?(<FKXRFKX0*Q

��������!� "� �� �����1�� ��^� ������� ��,� �^���^� ��� �V¶4¦J�

-:0e}I*2�}J2�<OKPU.243�3O=.9 2�KP0*24�._e-"�fKPROKP243�RwIe-:RG9�_e3FRx�,2�3>-:ROKN3L{e24}�J/�-:01/�~*<>=.�e-:�JKf�fKPRW/�26�*~*<>243>3WKX�J�P2�KP0�R>IJKN3�Cp=.<>9#'��_*R�R>I*2%µ�a ~*<>=.�e-:�JKf�fKPROKP243 24-.3WK��P/tUSKP=:�N-:R>2R>I*243O2iKP0*24�S_e-"�fKPROKP243�Yx-D0e}�R>I*2�<>26Cp=.<>2 RwI*2�/ M�-D0*0*=.R�<>243F_J�XR�Cp<>=.9-:0J/���26�f�¼R>I*2�=S<>/.']\^2�R(_e3¨_*0e}J2�<V3ORV-:0e}�-DR(26��-SM6RO�P/!?(Ie-DRx~,=:KP01R�KP0 ��26�f����3(<w24-.3O=.0JKP0*Q R>I*2�M6=S0 �*K`M6Rb?GKPR>I�µ�aKN3GKP0JR><>=*}J_eM624}^'

cGC]M6=._*<V3F2.Y*R>I*2bCp_*0e}*-:9 2�0JRV-"�f�P/ M6=.<><w24M6Rx<w26�`-DROKP=.0 -.M�M6=S<V}SKP0*Q!R>=�~*<>=.�e-:�JKf�fKPRW/�RwI*2�=.<>/?x=S_J�`}�,2.Y

��������!� "� �� ����� ���� ��|�$����� �� "����� � �V¶4«J�

��_*RyKfC|?G2GQ.<V-:0JRzR>Ie-:Ry�J0*=u?¨�X24}JQS2x=DC|R>I*2G26�*~e2�<OKP9 2�0JR>2�<V3��"Cp<>2�2(MwI*=:KNM6243����$� "�e?G=._J�N}�Q:KPU.2G_e3y0*=bKX0JCp=.<>9-:ROKP=.0-:�,=._*R�� s ����� �� "� � �^���^���W-:0e}�KP0�R>IJKN3�U.2�<>�JKN-:Q.2 ?G2 Rw=1=�-:<>2 �,26KX0*Q�M�-:<>26Cp_J���P/t2�~JKN3ORw2�9 =:�P=.Q:KNM�-"�p�VY�R>I*2�0��26�f�û� 3GKP0JR>2�<>~*<>2�RV-DROKP=.0#=:CBR>I*2�&�@]�§KP0JR>2�01RFKX=S0e3G�fKP243�KP0#R>I*2bC�-.M6R>=.<FK �4-DROKP=.0

���������� ��^� �������1����^�$������� ��^� �V¶�¸*�?(I*2�<>24-S3GR>I*2bCp_*0e}*-:9 2�0JRV-"�f�P/ M6=.<><w24M6R]C�-.M6R>=S<OK �4-:ROKP=.0�?G=._J�N}�<>24-S} s

���� ���� ��^� ������ ���� ��^�$�������� ��^� � ����� !� ��^� ��� �� ��� ��^� �V¶4ºJ�KP0�?(IJKNM>I��e=.RwI��$� (-"�P?(-4/*3G-:~*~e24-D<�-.3GM6=.0e}SKPROKP=.0JKP0*Q#3ORV-:Rw2�9 2�01R63�'¼��=:?x2�US2�<4Y*�]26�f�]�6¶4³.²J®.�yR>IJKP0*��3¨R>Ie-:RGR>I*2&]@�� }J2�9!-:0e}�CE=S<]�P=*M�-"�fKPRW/.Y�KP0#?(IJKNMwI#2�U.2�0JRV3(-DR ��3OI*=._J�N}%0*=.RGKP0 �e_*2�0eM62i2�U.2�01R63(-:R ��?(I*2�0#R>I*2bKP0JR>2�<>U:-"�KN3�3O~e-SM626��KP�.2.Yy<>24�S_JKP<>2 R>I*2�CE=.<w9��V¶�¸*�V'���0tIJKN3�?G=.<6}*3 s �6�LR�?G=._J�N}��e2U.2�<>/�<>2�9!-:<>�:-:�J�P2iKfC �~*<>=:U.24}�Rw=!�,2-M�-:_e3>-"�yCû-SM6R>=.<�CE=.< ��Y^=.<���Cp=.<�� � )2+.-/+`Y*KfC ����� !���^�(}J2�~e2�0e}J24}d=.0 ¢=.<�������! ��|�G}J2�~e2�0e}J24}d=.0��e'���_*R-.M�M6=.<6}SKX0*Q�R>= �._e-:0JR>_*9 9�24M>Ie-:0JKNM�3�Y,3O_eM>I#-i}SKf�P2�9 9!-M�-:0�Ie-:~*~,2�0z'xa�=.<>2�=:U.2�<"Y.R>IJKN3G~,24M6_J��KN-:<��P=.0*Q:�1<6-:0*Q.2KP0 �e_*2�0eM62�KX0��._*243FROKP=.0 3O2�2�93(R>=iQ.=�Cû-.3FR>2�<GR>Ie-:0�fKPQ.I1R6�*'

��=.R>2.YJI*=:?G2�U.2�<4YJR>Ie-:RG9 2�<w26�X/��J0*=:?GKP0*Q R>I*2�}SKP<>24M6ROKP=.0�=:C¼R>I*2�� 9 24-.3F_*<>2�9 2�0JR�}J=1243¨0*=.R(M>Ie-:0*QS2�-:01/~*<>24}SKNM6ROKP=.0e3 -DR� YB-"�PR>I*=S_*Q.ItKPRiM6=.01US2�<>RV3�RwI*2iKP0JKXRFK`-u��~*_*<>2�3LKP0*Q:�P2�R�3FRV-:R>2iKP0JR>= -%9iKf��Rw_*<>2.'���R¢KN3�24-S3O/tR>=

Page 12: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4¦ ¶4¦

U.2�<OKfCp/�R>Ie-:R�-SM�M6=.<V}SKP0*Q!Rw=�µ�a�Y ������!� "���������� "��A¶ �u¦�CE=.<b-"�f� � � :'Bg�3�?x2�?G=._J�N}%26��~,24M6RbCE<>=S9 �V¶4ºJ�6YKPR KN3i0*24M6243w3>-:<>/vR>=d�10*=:? -"�N3O=dR>I*2�<>243O_J�PR=:C¤RwI*2 ��9 24-.3O_*<>2�9�2�01R �,26CE=S<>2#R>I*2#M6=S<><>26�N-:ROKP=.0�-"�z24M6RV3�=._*<~*<>24}SKNM6ROKP=.0e3�z-SM�M6=.<V}SKP0*Q!Rw=�µ�a�Y ������ � � "��� �6¶��8M6=13 � ���:¦*'x)¨I1_e3G?�IJK��P2iR>I*2�µ�a Cp=.<>9-"�fK`3F9 }SKN3>-:QS<>2�243?GKPR>It��26�f�û� 3bC�-.M6R>=.<OK �4-:RFKX=S08�6¶�¸*�VY�KPR�-:~*~e24-:<63�M6=.0e3LKN3OR>2�0JR�?GKPR>I�?(Ie-:R�?G2�Ie-"U.2 M�-"�f�P24}�R>I*2#�wCp_*0e}*-:9 2�0JRV-"�f�P/M6=.<><w24M6RV�b~*<>=.�e-:�JKf�fKPRO/�<w26�`-DROKP=.0e3G��~,2�<>Ie-:~e3y0*=:?�KPRBKN3BMw�P24-:<>2�<�?(I1/�?G2¨3w-"KN}iR>Ie-:RB3O=.9 2G=:Cz��=.I*<4��3[KN}J24-.3�M6=._J�N}Ie-"U.2��e2�2�0�26��~*<w243>3O24}�~*<w24MwK`3F26�X/%KP0 �G-"/.243LKN-:0�R>2�<>936�V'

&��._e-DROKP=.0��V¶�¸*�BKN3�Y^RwI*2�<>26CE=S<>2.Y^R>I*2i~e=:KP0JR�?(I*2�<>2 ��26�f�BKX0JR><>=*}J_eM6243�-M6=.0 �*KNM6R�?¨KXRwI8µ�a�'^�G24M6=.Q.0JK �6KP0*QR>IJKN3�Y�KPRbK`3�2�USK`}J2�0JR�R>Ie-:Rb=.0*2iM6=._J�N}#~*<w=�}J_eM62 -:0J/�01_*9i�,2�<�=:C]26�*~e2�<FKX9�2�01RV-u�HR>243FRV3(?�I*2�<>2�R>I*2�~*<>24}SKNM6ROKP=.0e3=:C�µ�a­M6=.0 �*KNM6R ?GKPR>I�Uu-:<FKX=S_e3�~*<w24}SK`M6RFKX=S0e3 =:C��V¶�¸*�V'�)GI*2!~e-D<>ROKNM6_J�N-:<!3O2�Ri=:CGKP0*24�._e-u��KPROKP243Q:KPU.2�0��J/8��26���KN3�=.0J�P/t=.0*226��-:9�~J�X2=:C(R>IJKN3�YB-:0e}d0*=.R�2�US2�08R>I*2�9 =13ORiM6=.Q.2�0JR�=.0*2.'�7d2!3OIe-"�f�G�P24-4US2 KPR�-S3�-:0�26��2�<6MwK`3F2Cp=.<(R>I*2�<>24-.}J2�<bR>=!3OI*=:?�R>Ie-:R4Y*-:RbR>IJKN3(~,=:KP01R"Y|-:~*~J�fKNM�-:ROKP=.0d=:C��G-"/.243LKN-:0�~*<OKP0eMwKP~J�X243�?G=._J�N}�Ie-"U.2�/SKP26�N}J24}t-3LKPQ.0JKf{|M�-:0eM62iR>243OR¨CE=.<b�V¶�¸*�BR>Ie-:RGKN3�9 =.<>2b~e=:?G2�<OCp_J�¼R>Ie-:0�R>I*2���26�f�yKX0*24�S_e-"�fKPROKP243�' $

�¨2�Q1-:<V}S�P243>3�YDKPR]3O2�2�9 24}iR>=�2�US2�<>/1�,=�}J/�RO?x2�0JRO/�/.24-:<V3B-DQ.=�RwIe-:R¼RwI*2¨3FRV-:Q.2G?(-.3y3O2�RyCE=S<H-:0�26��~,2�<OKP9 2�01R6-"�R>243OR�=:C(R>I*2�K`3w3O_*2��]~,2�<OCp=.<>9 26��~,2�<OKP9 2�0JRV3�?(I*2�<>2R>I*2!~*<w24}SK`M6RFKX=S0e3i=:C¤�S_e-:0JR>_*9�R>I*2�=S<>/�U.KP=:�N-:R>2�RwI*2!��26���KP0*24�._e-u��KPROKP243�YG-:0e}�3O2�2 ?(I*2�RwI*2�<�RwI*2!}*-:RV-%U.KP=:�N-:R>2�R>I*2�9 -"�N3O=e'�pC�3O=eY[R>I*2�0v-"�f�x~e=J3>3LKP�J�P2�X=*M�-"�(R>I*2�=.<FKX243¤�?(I*2�R>I*2�<bM�-:_e3>-"�z=.<(0*=SR]��-:<>2�}J2�9 =:�fKN3OI*24}%KX0�-i3LKP0*Q:�P2�3FR><>=.�.2.YJ-:0e}R>I*2�T�0JKPU.2�<V3O2�<>_*0e3G=.0�~e3O/*MwI*=.�.KP0*243LKN3�'g(RG�P24-.3FR4Y*R>Ie-:RG?(-.3�R>I*2�<>24-.3O=.0JKP0*Qe'

)¨I*2x26�*~e2�<FKX9�2�01RV3�}J243LKPQ.0*24}�R>=�Rw243OR¼RwIJK`3�Y.=:C^?(IJKNM>I RwI*2x=S0*2x=DCeg(�N-"KP0g¤3O~,24M6RG�V¶4³.²Sº*Y1¶"³.².¬J�,KN3y~e2�<>Ie-:~e3R>I*2 9�=13OR�M6=SQ.2�01R�R>=#}*-:R>2.YyIe-"U.2i?GKPR>I�=.0J�P/t=.0*2 26�eM62�~*ROKP=.0v2�0e}J24}d?GKPR>I�R>I*2 U.2�<V}SKNM6R#���S_e-:0JR>_*9 R>I*2�=.<>/M6=.0J{e<>9�24}*�*Y1-:0e}i-.M�M6=S<V}SKP0*Q:�P/�RwI*2�<>2GIe-.3y�e2�2�0!�S_JKPR>2�-�~e-:<V-.}J2G=:C^~*I1/*3LKNMwKN3ORV3 �W_*9 ~JKP0*Q�=.0iR>I*2G�e-:0e}J?(-:Q.=.0zY}J24Mw�N-:<OKP0*Q�~*_*�J�fK`Mw�P/�R>Ie-:RbR>I*2�/�0*=:? �e26�fKP2�U.2 KP0t~e3F/�MwI*=.�SKX0*243WK`3�'�cGC�M6=._*<V3O2.Y^RwI*2�/ }J=�0*=SR�_e3O2iR>Ie-:R�?G=.<V}���*_*R�-:R R>I*2�¶4³.²:¸vZ1-D01RV-dª*2#7d=.<>�*3OI*=.~ �Oa#=J=.<>2�� Z1M6_J�f�X/.Yi¶4³S².¬J��9 =.<>2�R>Ie-:0§=.0*2#?(-.3iI*24-D<V}vR>=�3>-"/ s��)GI*2�26�*~e2�<FKX9�2�01RV-u�¼2�U.KN}J2�0eM62i0*=:?§CE=.<6M6243G_e3�R>= �e26�fKP2�U.2�R>Ie-:R�-:Rw=.9!3]-D<>2�0*=.RG<>24-"��'�� -D0e}0*=.�e=*}J/!<w=13O2�R>=�S_*243OROKP=.0#RwIJK`3�Ye-"�PR>I*=._*Q.IKPRb9!-.}J2�9 2�?G=.0e}J2�<�?(Ie-:R(R>I*2�/R>I*=._*QSI1R(g��N-"KP0z��3b-:~*~e-:<V-:Rw_e3]?(-.3¨9!-.}J2�=:C>'

g��N-"KP0�g�3O~e24M6R�IJKX93O26�fC�Ie-.3�<>2�9!-uKX0*24}§-.}J9iKP<V-:�J�P/��P2�U.26�f�1I*24-.}J24} R>I*<>=._*QSI�-"�f��R>IJKN3�YG�._JKPR>2�~*<>=S~e2�<O�P/MwIe-"�f�X2�0*QDKX0*Q�_e3GR>= ~*<w=�}J_eM62 - Mw�N-.3>3WK`M�-u�H26�*~J�N-:0e-:ROKP=.0�=:CBIJKN3(26�*~e2�<OKP9 2�0JR �^�*_*R�-DR(R>I*2�3w-:9 2�ROKP9 2�<>26CE_e3WKX0*QR>= �,2�3OR6-:9 ~e24}J24}�KP01R>=�RV-:�SKX0*Q-:0#=.�JUSKX=S_e3L�P/KX0e3w-:0*2�~,=13LKPROKP=.0t-.3(}SKN}#3F=.9 2�=.R>I*2�<63�'])GI*2i}SK��P2�9 9-iKN3�0*=.RR>Ie-:R�R>I*2 µ�a Cp=.<>9-"�fK`3F9 KN3(Q:KPUSKP0*Q�?(<>=.0*Q ~*<w24}SK`M6RFKX=S0e3�Y^�*_*R�RwIe-:R(R>I*2iM6_*<><>2�0JR�-:R>R>2�9�~*RV3(-:RGKP0JR>2�<>~*<>2�RFKX0*QR>Ie-:RbCp=.<>9-"�fK`3F9�-:<>2iQ:KPU.KP0*Q�_e3 �O_e3OR�R>Ie-:R�3O~,=1=S�1/�~JKNM6R>_*<>2 =DCxR>I*2i?G=.<O�N}�R>Ie-DR�&yKP0e3OR>26KP08-:0JROKNMwKP~e-:R>24}�-:0e}=.�$�O24M6R>24}R>=,']cGCxM6=S_*<V3O2.Y*R>I*=J3O2�?GKPR>I#-i~,2�0eM>Ie-:0JR�CE=.<G9i/*3OROKNMwKN3O9 -D<>2�}J26�fKXQSI1R>24}^'

��=:? }J=�?G2�Q.2�R!=S_*R!=:CiR>IJKN36± +D_e3OR#-.3�]26�f��<>2�US24-"�P24}�IJKN}*}J2�0A-.3>3O_*9�~*ROKP=.0e3�KP0 US=.0 �(2�_*9!-D0*0z��3-:<>QS_*9 2�01R"Y�3F=�?G2�0*2�24}%R>=i<>2�U.24-"�zR>I*2�IJKN}*}J2�0t-.3>3O_*9�~*ROKP=.0e3�KP0#��26������3b-:<>QS_*9 2�01R"'H)¨I*2�<>2�-:<>2�-:R��P24-.3OR�RW?G==:CBR>I*2�9#Y*�,=.R>I�=:CB?(IJKNMwI#<>24�S_JKP<>2�R>I*2�+D26��<w2�/�3GUSKP2�?(~e=DKX0JR�-:�e=._*Rb~*<>=.�e-D�JK��fKPRO/�R>= <>24M6=SQ.0JK ��2 s�V¶:� g�3IJKN3?G=.<V}*3-:�e=:U.2t3OI*=:?�Y(��26�f��R>=J=.��KPRCp=.<!QS<V-:0JR>24}§R>Ie-:R�-8M6=.0e}SKPROKP=.0e-u��~*<>=.�e-D�JK��fKPRO/ ����� �i�

26�*~*<>243>3F243�-�~*IJ/�3WK`M�-u�¤M�-:_e3>-"��KP0 �e_*2�0eM62.YG26��2�<>Rw24}��1/�� =S0��v'��]_*Ri?G2�3OI*=:? ~*<w243O2�01RF�X/dR>Ie-:Ri=.0*2M�-D0*0*=.R]2�U.2�0�<>24-.3O=.0 M6=.<w<>24M6RO�P/�KX0�3O=i3LKP9 ~J�P2¤-¢~*<>=.�J�P2�9 -.3�}J<V-"?GKP0*Q�RO?G=��e-u���N3�Cp<>=.9 ��2�<>0*=._J�f�fK���3(T�<>0zYKfCBI*2bKP01R>2�<w~*<>2�RV3G~*<>=S�e-:�JKf��KPROKP243�KP0�R>IJKN3G?(-"/.'Bª*_*0e}*-:9 2�0JRV-"�f�P/.Y^M6=.0e3LKN3OR>2�0eM6/<>24�S_JKX<w243GR>Ie-:R(M6=.0e}SKPROKP=.0e-"�~*<w=.�e-:�JKf�fKXRFKX243�26�*~*<>243>3 ��� ) r6q �KP0JCp2�<>2�0eM6243�Y��W_e3OR -.3i�b-:<>=:�N}�+:26�z<>2�/*3 3>-"?�'���0e}J2�24}^Y�R>IJKN3�KN3 -"�N3O=�R>I*2M6<w_eMwK`-u�x~e=DKX0JRiR>Ie-:R���=.I*<�9!-.}J2iKP0�IJK`3�<>2�~J�P/tRw=#&]@]�¢Y^KP08?G=.<6}*3bR>Ie-:R���26�f���S_*=.R>24}d-:0e}�?(IJKNMwI8?G2<w2�~e24-:R(�,26�P=u?�'

�W¦J�!)¨I*2#Mw�`-S3>3 =DC¢��26�f�¤RwI*2�=.<OKP243 }J=J243 0*=.R�KX0eMw�P_e}J28-u�����X=*M�-"��IJKN}*}J2�0�Uu-D<OKN-:�J�P2 RwI*2�=.<OKP243�GKPR!-D~*~e24-:<V3�R>=_e3bRwIe-:R(KPR�26�eMw�P_e}J243 �O_e3OR�R>I*2 Mw�N-.3>3b=DC]R>I*2�=.<OKP243�RwIe-:R¤&HKP0e3OR>26KP0t?G=._J�N}�Ie-"U.2��fKP�.24}d9 =13OR"'�gbQ1-"KP0zY^?G20*2�24} R>=��P24-:<>0 CE<w=.9 +:26�z<>2�/*3iR>I*2�}SK`3FROKP0eM6ROKP=.0��e2�RO?G2�2�0�R>I*2�2�~JKN3OR>2�9�=:�P=.Q:KNM�-"��~*<>=.�e-:�JKf�fKPROKP243�=:C�R>I*2µ�a Cp=.<>9!-u��KN3O9�-:0e}R>I*2�=.0JR>=:�P=.Q:KNM�-"�^Cp<>24�S_*2�0eMwKX243�R>Ie-:R�?x2b9 24-.3F_*<>2bKP0#=._*<G26�*~e2�<OKP9 2�0JRV3�'�gAIJKN}*}J2�0

$ ÎGÓ¼øy¿GÂ.À4ÅL¿VÛ�ÇfÀ4Â.Ä�Æ�Ä"À�ýö×DÆ �:Â.¿6Ó�Ô1Ý6à ���4þ>Ô:ËpÂ�Å�¾.¿GÀ"Á.Å�Ãfâ�Æ�Ç�ÁS¾.À4ÅLÀ4ÂiâVÀ"Ì�ÌL¿VÇPÆ�ÅLÃfÀ4Â��b¿�:ÁJ¿VÌLÃfÙ�¿6ÂuÅ[øB¾.¿VÌL¿�Æ�â6â6À4Ì�ÛSÃ�ÂSÄ�ÅLÀ Í�ÅL¾.¿]ÅpøyÀ(Á.¾.À"Å�À"Â.ÓB¾1Æ 4¿�Á1Æ�ÌOÆ�ÇfÇf¿VÇJÁJÀ4ÇPÆ�ÌLÃ���Æ�ÅLÃfÀ4ÂeÔ"Å�¾.¿�Â.À4ÂDúu¿ �uÃfÓOÅ�¿6Â.â6¿]À +�â6À4ÌLÌ�¿6ÇXÆ�Å�ÃfÀ4ÂSÓ¼øB¾.¿6Â�ÅL¾.¿]ÁJÀ4ÇPÆ�Ì�Ã��V¿6Ì�ÓBÆ�ÌL¿xÆ�ÅÆ(à�GÛ.¿6Ä4Ì�¿6¿]Æ�ÂSÄ4Çf¿]ÃfÓ¼ÆGÙ�À4ÌL¿BÓW¿6Â.ÓOÃfÅ�Ã� 4¿�ýEÆ�Â.Û�¿ �:Á1¿6Ì�ÃfÙ�¿VÂ:ÅWÆ�ÇfÇ���ÓWÃfÙ�Á.Çf¿VÌOþ*Å�¿6ÓOÅzÀ�+ Í�Å�¾1Æ�Â�Æ�ÌL¿]ÅL¾.¿��y¿6ÇfÇuÃfÂ.¿��:Ü1Æ�ÇfÃfÅ�Ãf¿6Ó�Ö

Page 13: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4« ¶4«

U:-:<OKN-:�J�P2�R>I*2�=.<>/v0*2�24}§0*=.R<>2�~*<>=*}J_eM62�R>I*2#9-:R>I*2�9!-:RFK`M�-u��Cp=.<>9 =DC�R>I*2tµ�a»~*<w=.�e-:�JKf�fKXRFKX243%KP0�R>I*29-:0*0*2�<(=:CG�V¶4¦J�yKP0#=S<V}J2�<(R>=i~*<>24}SKNM6R�R>I*2�3>-D9 2�=.�e3O2�<>U:-:�J�P2�C�-.M6RV3GRwIe-:Rbµ�a }J=J243�'

)GI*2#3O~,=1=S�1/83F_*~e2�<O�P_*9iKP0e-"��3ORw_J��?x=S_J�`}dCp=:�f�P=:? CE<w=.9 �GKN}*}J2�0�g�3>3O_*9�~*ROKP=.0��V¶:� ���*_*R R>Ie-:R -.3>3F_*9 ~*ROKP=.0}SKN3>-:~*~,24-:<V3(-.3G3O=J=.0�-.3B?G2b<>24M6=.Q.0JK ��2.Y*?¨KXRwI�+:26�z<>2�/*3G-:0e}���=.I*<4YJR>Ie-:R�?(Ie-:R�K`3¨R><V-"U.26�fKP0*Q�C�-.3ORw2�<]R>Ie-:0��fKPQ.I1RKN3�0*=.R�-�~*IJ/�3LKNM�-"�(M�-:_e3>-"��KP0 �e_*2�0eM62.YG�*_*R�=.0J�P/v-�P=.Q:KNM�-"�GKP0JCE2�<w2�0eM62.' ��2�<>2�K`3i��=.I*<4� 3��S_*=.R>24}�3ORV-:R>2�9�2�01R�pKPRV-"�fKNM�3�IJK`3m� s � +BâVÀ"Ü.Ì�ÓO¿bÅ�¾.¿6Ì�¿�ÃfÓxÃfÂ�Æ�âmÆ�ÓW¿�Ç�ÃfÈ"¿�ÅL¾1Æ�Å��LÜ.ÓOÅxâ6À4ÂSÓWÃfÛ.¿6Ì�¿6ÛÂ.À �uÜS¿VÓOÅ�ÃfÀ"Â!À +�Æ�Ù�¿6â>¾1Æ�Â.ÃfâmÆ�ÇeÛ.ÃfÓOÅ�ÜSÌ�Ú1Æ�Â.âV¿�À +HÅL¾.¿Ó �:ÓWÅL¿VÙ�Ü.ÂSÛ.¿VÌBÃf 4¿6ÓOÅ�ÃfÄuÆ�Å�ÃfÀ4Â�Û.Ü.ÌLÃ�ÂSÄ�ÅL¾.¿GÇXÆ�ÓOÅzâVÌLÃfÅ�ÃfâmÆ�Ç1ÁS¾1Æ�ÓO¿GÀ�+eÅL¾.¿GÙ�¿�Æ�ÓOÜ.Ì�ÃfÂ.Ä�Á.Ì�À:â6¿VÛ.ÜSÌ�¿:Ö��yÜ.Åy¿ "¿VÂiÆ�ÅyÅ�¾.ÃfÓÓOÅWÆ�Ä4¿(ÅL¾.¿VÌL¿�ÃfÓ�¿VÓOÓO¿VÂ:ÅLÃXÆ�ÇfÇ���ÅL¾.¿ �:Ü.¿6ÓOÅ�ÃfÀ4 À +xå�ëçPë��BéJó>ë��Oó�î�ë ìöõDó���ó>íwð��Oî�ë*ñ�çfìpçNî�ë.ô�õuç��Fõ�ñ4ó �yë�ó¨ìNõ.ó�ïDîmôOôFç����fóìpðOïDóFô¢î��Bï1íOóOñ�ç��FìEçöî�ëSô�íWó��4å�íWñ�çPë���ìöõDó��>éDìEé.íOó��OóOõ.å��6çNî�í�î��GìöõDó�ô>ð6ôOìûówè� �g(CpR>2�<!�S_*=.ROKP0*Q�R>I*243O2�?G=.<V}*3�YH��26�f��-.}*}J24} s �6��0e}J2�24}���Ie-4US2!U.2�<w/t�fKPR>RO�P2KN}J24-t?�Ie-:RiR>IJKN3i9 24-:0e3�' ��gb0e}?G2#9i_e3OR!-S}J9iKPR!R>Ie-DR R>IJKN3iKN3�-�~*<FKX9�2 26�e-:9 ~J�P2�=:C�R>I*2 M6<w/1~*ROKNM%=.�e3>M6_*<OKPRO/v=:C���=.I*<4��3�?(<OKPROKP0*Q13�'�Z.=d�?GKPR>I�R>I*2 �,2�0*26{eR�=DC�3F=.9 2iCp=.<>RO/#/S24-:<V3b=:C�M6=.0JR>2�9 ~J�N-:ROKP0*Q�R>Ie-:R�3FRV-:R>2�9 2�0JR�KP0�R>I*2!M6=.0JR>26�*R�=:CGIJKN3�=SR>I*2�<?(<OKPROKP0*Q13¨�!I*2�<>2bKN3�=._*<�-:RwR>2�9 ~*RGR>= R><6-:0e3L�N-:R>2���=.I*<4��3(3FRV-:R>2�9 2�0JR�KP01R>=�~J�`-uKX0t&�0*Q:�fK`3FI sW½y¾.¿iÙ�¿�Æ�ÓOÜ.ÌL¿VÙ�¿VÂ:Å(Æ�Å � Æ�ÅbÅ�ÃfÙ�¿ � Û.À:¿6Ó�Â.À"Å�âw¾1Æ�Â.Ä"¿iÅ�¾.¿iÌ�¿�Æ�ÇyÁ.¾ �:ÓOÃ�â�Æ�ÇyÓOÃfÅ�Ü1Æ�Å�ÃfÀ4Â�Æ�Å � /yÚ.Ü.ÅbÃfÅ�â>¾JÆ�Â.Ä"¿VÓÀ4ÜSÌ(ÓOÅWÆ�ÅL¿�À�+BÈ:Â.À�øBÇf¿VÛ.Ä"¿�Æ�ÚJÀ4Ü.Å�Å�¾1Æ�Å(ÓOÃ�ÅLÜ1Æ�ÅLÃfÀ4ÂeÔeÆ�Â.Û�Å�¾S¿VÌL¿�+NÀ"Ì�¿�ÃfÅGâ>¾1Æ�Â.Ä4¿6ÓGÅ�¾.¿�Á.Ì�¿6Û.ÃfâVÅLÃfÀ4Â.Ó(øy¿�Æ�ÌL¿�Æ�Ú.Çf¿bÅ�ÀÙ�Æ�È4¿(Æ�ÚJÀ4ÜSÅ � Æ�ÅBÓOÀ"Ù�¿]ÅLÃfÙ�¿ ��� ÖzÕDÃ�ÂSâV¿GÅ�¾SÃ�Ó�ÃfÓ]Æ(ÙiÆ�Å�ÅL¿VÌBÀ +|ÇfÀ4Ä"ÃfâxÌOÆ�ÅL¾.¿VÌ�Å�¾1Æ� Á.¾ �:ÓOÃ�â�Æ�Ç*â�Æ�ÜSÓFÆ�Å�ÃfÀ4Â,Ô:Å�¾.¿6Ì�¿(ÃfÓÂ.ÀiÆ�â6Å�ÃfÀ4 Æ�ÅGÆbÛ.ÃfÓOÅWÆ�ÂSâV¿�Æ�Â.Û Â.À�Û.Ã���âVÜSÇ�Å���øBÃfÅ�¾ ÌL¿VÇPÆ�ÅLÃ� uÃfÅ����hÆ�ÇfÓOÀ1Ô:ÃfÅBÛ.À:¿6Ó]Â.À"Å]Ù�Æ�Å�ÅL¿VÌBøB¾.¿6Å�¾S¿VÌ � � ÃfÓ]ÚJ¿�+NÀ4ÌL¿uÔ¿��uÜJÆ�ÇeÅLÀ1ÔSÀ4ÌxÆ +NÅ�¿6Ì �"! Ö �

gbQ1-"KP0�?x2 3O2�2iI*=:? ��=.I*<4��3�2�~JKN3OR>2�9 =D�X=SQ:KNM�-"�xUSKP2�?(~e=:KP0JR�M6=.<w<>243O~e=S0e}*3bR>=��G-"/.243LKN-:0�KP0JCp2�<>2�0eM62.YB-:0e}�M6=._J�N}Ie-"U.2��e2�2�0�26�*~*<>243>3O24}�~*<>24MwKN3O26�P/%KX0t�G-"/.243LKN-:0�R>2�<>9!3�'G��=u?G2�U.2�<"Ye��=.I*<¤M6=S_J�`}%0*=.Rb�*<OKP0*Q!IJKP9!3O26�fCGR>=�3w-4/�KPR-.3G?G2�}SKN}^Y,�e24M�-:_e3O2¢CE=S<xIJKP9�R>I*2�~*I*<6-.3O2!�6<>24-u��~*IJ/*3LKNM�-"��3WKXRw_e-:ROKP=.0e�i?(-.3�RV-:�,=1=,'

��_*RKPR�9!-"/�3O2�2�9 ~e-:<6-.}J="�1KNM�-"��R>Ie-:R�RO?G=8}SKf�z2�<>2�01R�~*_*<w283ORV-:Rw243���26KPQ.2�0e3FRV-:R>243�=:C�0*=S0eM6=.9 9i_*ROKP0*Q�S_e-:01RFKXRFKX243�� � -:0e} � � ��M�-:0��e=.RwI <w2�~*<>243O2�0JR�R>I*2 3>-:9 2�<>24-"�B~*I1/*3LKNM�-"�¨3WKXRw_e-:ROKP=.0 �,KfC�3O=eY,R>I*2�0�~e2�<>Ie-:~e3¢R>I*2M6=.0eMw�P_e3LKP=.0 K`3�R>Ie-:R�=S0*2�Ie-.3¢�X24-D<>0*24}v-:0dKX9�~e=.<>R6-:01R�C�-.M6R -:�e=S_*R�RwI*2!<>26�N-:RFKX=S0v=:C�R>I*2�µ�a°3OR6-:R>2U.24M6R>=.<R>=<>24-"�fKPRO/.' )GIJKN3�3O_*~*~e=.<wRV3�R>I*2 &HKX0e3FR>26KP0tU.KP2�?�=:CxR>I*2i9 24-D0JKX0*Q�=:Cx-~*_*<>2!3FRV-:R>2i-.3�-:0�2�0e3O2�9i�J�P2��zCp=.<�KP03ORV-DROKN3OROKNM�-"�19 24MwIe-:0JKNM�3[KPR^KN3B-G~J�N-:ROKPR>_e}J2GR>Ie-:R[R>I*2BR><>_*2�9iKNM6<>=13ORV-DR>2B9!-"/¤-D~*~e24-:<[KP0�RO?G=¨}SKf�z2�<>2�0JR¼2�0e3F2�9��J�P243�Y<>2�~*<>243F2�01ROKP0*QRO?x= }SKf�z2�<>2�0JR�3ORV-:Rw243]=DCH�J0*=:?G�P24}JQ.2�-:�,=._*R(R>I*2�9�K`M6<w=13ORV-:Rw2.'

�i�b�!� �������]$#ö� ���!� �!� �#"������ �¡b26{e0*2�RwI*2�~*<>=.~e=J3LKPROKP=.0e3 s� � �uc(_*<�_*<>0vM6=.0JRV-"KP0e3��´�e-"�f�N3�Y[K`}J2�0JROKNM�-"�GKP082�US2�<>/�<>243O~e24M6R�26��M62�~*R�R>Ie-:R�� =:C(R>I*2�9 -:<>2i<>24}^YyR>I*2

<w2�9!-"KP0JKP0*Q � � � ?(IJKPR>2.'b7t2�Ie-"U.2�0*= KP0JCp=.<>9!-:RFKX=S0 -D�e=._*RbR>I*2��P=�M�-:RFKX=S0 =DC]~e-:<>ROKNM6_J�N-:<��e-"�f�N3�KP0RwI*2�_*<>0z'])¨I*2�/�-:<w2�}J<V-"?(0�=._*R(�J�fKP0e}SCE=D�`}J24} ?GKPR>I*=._*R(<>2�~J�N-.M62�9�2�01R4' �

�&%�� ���G24}�=.0�RwI*2�'>� R>I�}J<6-4?�Y(' �A¶ �V¦ � � � � �Z._eM�M6243>3LKPU.2}J<V-"?�3�Cp<>=.9 R>I*2�_*<>0t-:<>2�-�9iKNM6<>=*M6=13O9�=:C]R>I*2�&�@]� 26��~,2�<OKP9 2�0JR4'�ª*=.<(RwI*2�{e<63OR�}J<V-"?�Y*QDKXUS2�0=.0J�P/�R>I*2�~*<OKP=.<¨KX0JCp=.<>9-:ROKP=.0 �^YJ?G2�Ie-4US2

��� � �e� � � � � � �V¶4¬J���=u? KfC¼?G2��J0*=:?�R>Ie-:R�<>24}�?¨-S3yCp=._*0e} =S0!R>I*2¨{e<V3OR(}J<V-"?�Y.RwI*2�0!R>Ie-DRxMwIe-:0*Q.243�R>I*2�M6=.0JR>2�0JRV3B=DC¼R>I*2b_*<>0 Cp=.<R>I*2�3O24M6=S0e} s

��� � � �� ���,� � � � ��¶D���.� � �§¶:� �V¶:®.�-:0e}�R>IJKN3�M6=S0e}SKXRFKX=S0e-"�x~*<>=S�e-:�JKf��KPRO/�26��~*<w243>3O243�RwI*2�M�-D_e3>-"�yKX0 �e_*2�0eM62�=DCxR>I*2�{e<V3OR�}J<6-4?�=.0�R>I*2 3O24M6=.0e}^Y�KP0�O_e3OR(R>I*2�?(-"/ R>Ie-:Rb�]26�f�]-.3>3O_*9�24}^'

��_*RB3O_*~*~e=J3O2G?x2(-:<w2]R>=:�N}¢=.0J�P/�R>Ie-:Ry<>24}¢?¨-S3¼}J<V-"?(0�=.0�RwI*2¨3F24M6=.0e}�}J<V-"? �:?�Ie-:RzKN3y0*=:?t=._*<B~*<w=.�e-:�JKf�P�KPRO/�Cp=.<¼<w24}�=S0�RwI*2]{e<63ORH}J<6-4?¢± 7 Ie-DR>2�U.2�<yIe-:~*~e2�0e3�=.0�R>I*2(3O24M6=S0e} }J<V-"? M�-D0*0*=.R¼26�*2�<>R]-:0J/�~*IJ/�3LKNM�-"�*KP0 �e_*�2�0eM62�=.0R>I*2�M6=.0e}SKPROKP=.0�=:CzR>I*2�_*<>0�-:R]RwI*2({e<V3FR¨}J<6-4? �13O=i~*<>243O_*9-:�J�P/ =.0*2b?(I*=i�e26�fKP2�U.243(?¨KXRwI���26�f�¼R>Ie-:RG-

Page 14: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶�¸ ¶�¸

M6=.0e}SKPROKP=.0e-"�*~*<>=.�e-D�JK��fKPRO/�26�*~*<>243>3O243y-G~*IJ/�3WK`M�-u��M�-:_e3>-"�SKX0 �e_*2�0eM62.YJ?G=._J�N}�3>-"/bR>Ie-:R ����� !� � � �e� ������� �e�6'��_*R(R>IJKN3¨K`3�~e-:R>2�0JRO�P/?(<>=.0*Q �J~*<>=S�e-:�JKf��KPRO/�R>I*2�=.<w/!<>24�S_JKP<>243�R>Ie-:R

����� �� � ���,� ����� � � �� ���,��� �V¶4²J�)GIJKN3�KN3b~e-:<>ROKNM6_J�N-:<O�P/�=.�JU.KP=._e3¨KP0tR>I*2iM�-.3O2 � � ¶ �*Cp=.<�K�CG?G2��J0*=u?�R>Ie-:RbR>I*2�=.0*2i<>24}��e-"�f�H?(-.3�RV-:�.2�0%KP0R>I*2�3O24M6=S0e}#}J<V-"?�YJR>I*2�0%KXR¨K`3bM62�<>RV-uKX0�RwIe-:RGKPR�M6=._J�N}�0*=.RGIe-"U.2��e2�2�0�RV-:�S2�0 KP0#RwI*2�{e<V3OR"'

�L0��6¶4²J�(R>I*2~*<>=.�e-:�JKf�fKPRO/8=.0dR>I*2 <OKPQ.IJRi26��~*<>243w3O243i-�~*IJ/�3LKNM�-"�(M�-:_e3>-:RFKX=S0zY¼RwIe-:R�=.0�R>I*2i�P26CpRi=.0J�P/8-:0KP0JCE2�<w2�0eM62.' �(2�U.2�<wR>I*26�P243>3�Y�R>I*2�~*<>=S�e-:�JKf��KPROKP243�-:<>2�0*24M6243>3w-:<OKf�P/ 24�._e-u���e24M�-:_e3O2.Y�-"�PR>I*=S_*Q.IA- �`-DR>2�< }J<V-"?M�-:0*0*=.R�~*I1/*3LKNM�-"�f�P/�-"�z24M6R�M6=.0e}SKPROKP=.0e3 -:Ri-:0t24-:<F��KP2�< =S0*2.Y )�� � � o � q.n )�� ��-:�e=S_*R�R>I*2<>243O_J�PRi=:C(R>I*2!3O24M6=S0e}}J<V-"?�Ie-.3G~*<>24MwKN3O26�P/�R>I*2�3>-:9 2�26�z24M6R(=S0�=._*< lmnpq.n -� ��� � ��� - � � -�-:�e=S_*R(?(Ie-:R�M6=S_J�`}%Ie-"U.2��,2�2�0�RV-:�.2�0�KP0R>I*2b{e<V3FR�}J<V-"?�Y*-.3�KfC]R>I*26KP<(=.<6}J2�<(?G2�<>2�<>2�U.2�<V3F24}^'

&��e'¨�V¶4²J�yKN3(=S0J�X/�- 3O~,24MwKN-"��M�-S3O2�=:C]-i9i_eM>I�9 =S<>2�Q.2�0*2�<V-"�y<>243O_J�PR4'])GI*2�~*<>=.�e-:�JKf�fKPRO/�=:C�}J<6-4?¨KX0*Q-:01/3O24�S_*2�0eM62i=:C]<>24}#-D0e}#?�IJKXRw2��e-"�f�N3���R>I*2�I1/J~e2�<>QS2�=.9 2�R><OKNMi}SKN3OR><OKP�*_*ROKP=.0^��}J2�~,2�0e}*3�=.0J�P/�=.0#R>I*2�01_*9i�,2�<�=:C<>24}�-:0e}�?(IJKPR>2��e-"�f�N3�Y*0*=SRx=S0!R>I*2�=S<V}J2�<�KX0�?�IJK`MwI�R>I*2�/!-D~*~e24-:< ��)2+.-/+`YSKXR�KN3(-:026�eM>Ie-:0*QS24-:�J�P2�}SKN3OR><OKP�*_*ROKP=.0z'ª*<w=.9 R>IJKN3GKPR�CE=:�f�P=:?�3G�J/�-�3LKP9 ~J�P2�M�-"�NM6_J�N-:ROKP=.0�R>Ie-:R¨CE=.<(-"�f� '�-:0e}��^Y

�����&% �e� � ������� �e� � � � � �V¶4³J�)GIe-:R�KN3�Y �O_e3ORi-.3¢KX0�µ�a�Yy9 2�<>26�P/t�J0*=:?GKP0*QtR>Ie-:R�=.R>I*2�< }J<V-"?�3¢Ie-4US2!�,2�2�0v9!-.}J2�}J=1243�0*=.R MwIe-:0*Q.2=._*<~*<>24}SKNM6ROKP=.0%CE=.<G-:0J/!3O~e24MwKf{e24}�}J<V-"?�Y1-"�PR>I*=S_*Q.I KPR(MwIe-:0*Q.243�R>I*2�IJ/1~,=.R>I*243LKN3G3O~e-.M62bKP0?(IJKNM>I�R>I*2b~*<>24}SKNM6ROKP=.0KN3G9!-.}J2��J�,26CE=.<w2�R>I*2�<>2�K`3�-�MwIe-:0*Q.2�KP0#R>I*2�-.M6R>_e-u��~*<w24}SK`M6RFKX=S0KXR¨K`3¨0*24M6243>3>-:<>/�R>=i�10*=:? -"�N3O=iR>I*2�<>243O_J�PRV3�=:C=.R>I*2�<b}J<V-"?�3�'B��_*R(R>I*2 �O=:KP01Rb~*<>=.�e-:�JKf�fKPRO/K`3��J/!R>I*2�~*<w=�}J_eM6Rb<>_J�P2.Y

�����&% � ��� �e� �������&%�!���0� �e�$������� �,� ������������&% ���,� �����&%� �e� �W¦.·J�-:0e}�3O=�?x2�Ie-"U.2bCp=.<(-"�f� 'B-:0e}��^Y

�����&%����� � �e� ������������&% ���,� �W¦*¶:�-:0e}�-:Q1-"KP0 -�M6=S0e}SKXRFKX=S0e-"��~*<w=.�e-:�JKf�fKXRO/i?(IJKNMwI�26�*~*<>243>3F243y=.0J�P/�-:0�KX0JCp2�<>2�0eM62�KN3y0*24M6243>3>-:<FK��P/i24�S_e-"��Rw=(=.0*2GR>Ie-:R26�*~*<>243>3O243�-~*I1/*3LKNM�-"�¨M�-D_e3>-:ROKP=.0z'i)GIJKN3�?G=._J�N}��,2 R><>_*2i0*=.R�=.0J�P/�Cp=.<�R>I*2 IJ/1~,2�<>Q.2�=.9�2�R><OKNM }SKN3OR><OKP�*_*ROKP=.0zY�*_*RGCp=.<(-:0J/ 26��MwIe-:0*Q.24-D�J�X2i}SKN3OR><OKP�*_*ROKP=.0z'G7t2�3F2�2bCE<>=S9 RwIJK`3¨I*=u?§C�-:<(¥�-:<O�¼@y=.~*~,2�<(?G=._J�N}Ie-4US2�Q.=.RG?GKPR>IIJKN3��m~*<>=.~e2�0e3WKXRO/*�iR>I*2�=.<w/!=:CB~*<>=.�e-D�JK��fKPRO/.YeIe-S}�I*2�R><OKP24}%R>= -:~*~J�P/KXRbR>= -�Cp2�?A3LKP9 ~J�P2i~*<>=.�J�P2�9!3�'

�LR�9iKPQ.IJR!�,2tR>I*=._*Q.IJRR>Ie-:RR>IJKN3~*I*2�0*=.9 2�0*=.0�KN3�-�~,24M6_J��KN-:<FKXRO/ =DC�~*<>=.�e-:�JKf�fKPRW/�R>I*2�=S<>/.' c(0�R>I*2M6=.0JR><V-:<w/.Y"KXR�<>2�9!-"KP0e3�R><>_*2(2�U.2�0�KX0~*_*<>2�}J24}J_eM6RFKXUS2(�P=.Q:KNM �SCp=.<BKfCzg§KX9�~J��KP243(�bY:R>I*2�00*=.RO�*��KP9 ~J�fKP243G0*=.RO�Jg�'��_*R�K�Cb?x2�R><OKP24}tRw=�KP01Rw2�<>~*<>2�R#�6g�KP9 ~J�fKX243�G�#-.3�9 24-D0JKX0*Q��6g�KN3�R>I*2~*I1/*3LKNM�-"��M�-:_e3O2=:C��G�*Yy?x2M6=._J�N}Ie-:<V}S�P/#-.M�M62�~*RbR>Ie-:R��60*=SRO��� KN3(R>I*2�~*IJ/*3LKNM�-"��M�-D_e3O2�=:CB0*=.RO�Jg¤�*'��]24M�-D_e3O2�=:CBR>IJKN3¨�`-SM>�=:C]M6=.01Rw<V-:~e=J3LKPROKP=.0zY?G2#M�-:0*0*=.RiKP0§Q.2�0*2�<V-"�(KP0JR>2�<>~*<>2�R��X=SQ:KNM�-"�(KP9 ~J�fKNM�-:ROKP=.0A-.3�~*I1/*3LKNM�-"�¤M�-:_e3w-:ROKP=.0zYG-:01/�9 =.<w2�R>Ie-:0v?G2#M�-:0M6=.0e}SKPROKP=.0e-"��~*<w=.�e-:�JKf�fKXRO/.'�&y�P2�9 2�0JRV-:<>/�C�-.M6RV3��fKP�.2�R>IJKN3�-:<>2�?G26���b_*0e}J2�<V3OR>=J=�} KP0�24M6=.0*=.9iKNM�3%�>Z:KP9 =.0 ��G243>MwI*2�<4Yy¶4³.¬.¬ ��e26�f�P0*2�<4YB¶4³.²D¸*� �:KPRGKN3�IJKPQ.I#ROKP9 2�R>Ie-:RGR>I*2�/?G2�<>2�<>24M6=.Q.0JK ��24}%KP0#R>I*2�=S<>2�ROKNM�-"�¼~*IJ/�3WK`M�3�'

�����#�b� �#� ���b� � ������� ����� ������� �������=u?�M6=.0e3LKN}J2�<#�GKN}*}J2�0�g�3>3O_*9 ~*ROKP=.0 �W¦J�V'���26�f�¤R>I*2�=S<OKP243 9!-D�.2�0*=89�2�01ROKP=.0§=:C�ROKP9 2#U:-:<OKN-:ROKP=.0�=:C�R>I*2IJKN}*}J2�0tUu-D<OKN-:�J�P2 � �^�*_*RbK�C�KPRbK`3bRw=!RV-D�.2�=:U.2�<bR>I*2 �O=.��Cp=.<>9 2�<O�P/�~e2�<OCp=.<>9 24}%�1/�R>I*2µ�a 3ORV-DR>2�U.24M6Rw=.<�bYR>I*2�0 �!9i_e3OR(=.�,2�/�3F=.9 2�24�S_e-:ROKP=.0e3�=:CH9�=.ROKP=.0�?(IJKNMwI -:<>2�Rw=�<w2�~J�`-SM62�R>I*2�Z1M>I*<��=J}SKX0*QS2�<�24�S_e-:ROKP=.0z'

)¨IJK`3�KN3�KP9 ~,=.<>RV-:0JR4Y^�,24M�-:_e3O2 =.0*2�?(-4/Cp=.<�-�M�-:_e3>-"�BR>I*2�=.<w/�R>=!QS2�R�~*<>=.�e-:�JKf�fKPRW/�KP0JR>=!RwIJKX0*QJ3�K`3¢ROKP9 2-"�PR>2�<>0e-DROKP=.0 �*Cp=.<b26��-D9 ~J�P2.Y*KP0tM6=.0e}SKPROKP=.0e3b?(I*2�<>2�~*<>243O2�0JR�µ�a /.KP26�N}*3�-iRFKX9�2�KP0e}J2�~,2�0e}J2�01R�~*<>=.�e-:�JKf�fKPRW/ �Cp=.<x3O~JKP0�_*~zY � ?G=._J�N}i�e2�=J3>MwKf���N-:RFKX0*Q�KX0�3O_eMwI�-�?(-"/�R>Ie-DRBCp=.<x-¤CE<V-SM6ROKP=.0��=:CzR>I*2bROKP9 2�RwI*2(<>243O_J�PR�KN3¤�m_*~e�*Y

Page 15: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4º ¶4º

2�RVM:'��L0e}J2�24}^YB&yKP0e3OR>26KP0�?x=S_J�`}�Ie-"U.2 M6=.0e3LKN}J2�<>24} R>IJKN3�R>I*2i0e-:R>_*<6-"�H?(-"/�R>==.�*RV-"KP0tRwI*2!µ�a´~*<>=.�e-D�JK��fKPROKP243Cp<>=.9 - M�-D_e3>-"�¼R>I*2�=S<>/.YSCE=.<¨KX0�IJKN3(24-:<F�X/�~e-D~e2�<V3�I*2�}J26{e0*24}%R>I*2��6~*<w=.�e-:�JKf�fKXRO/�=:C]- 3OR6-:R>24� -.3¨R>I*2bCE<6-.M6ROKP=.0=:C]R>I*2iROKP9 2�KP0t?(IJKNMwIt-�3O/�3FR>2�9 KN3�KP0tR>Ie-DR¤3OR6-:R>2.'���_*R�R>IJKN3�KN3�-<>26�N-:ROKP=.0��,2�RW?G2�2�0�µ�a -:0e}�R>I*2 M�-:_e3>-"�R>I*2�=.<w/!=:C]-i}SKf��2�<w2�01Rb0e-:R>_*<>2�RwIe-:0KN3�3O_*~*~,=13O24}%�1/R>I*2bCp=.<>9 �V¶"¦J�V'

g�Ry{e<V3ORyQ:�N-:0eM62.YJ=.0*2G9iKPQ.I1RB=S�$�W24M6RBRw=�R>IJKN3�3ORV-:R>2�9�2�01Ry�1/i3>-"/.KP0*Q�R>Ie-DR]�]26�f�^R>I*2�=.<OKP243B}J=�0*=.RB26�*~J�fK`MwKPRO�P/Cp=.<>�JKN} �#R>=Uu-:<>/�?¨KXRwI RFKX9�2.'���_*R(KfC]KPR�}SKN}^YzRwI*2�08�6¶4¦J�]?G=._J�N}�0*=.Rb<>2�~*<>=*}J_eM62�RwI*2!µ�a´~*<>=.�e-D�JK��fKPROKP243�[KPR?G=._J�N}t/SKP26�N}�ROKP9 26��}J2�~e2�0e}J2�0JR ~*<>=S�e-:�JKf��KPROKP243�KP0 3LKPR>_e-DROKP=.0e3�?(I*2�<>2R>I*2#µ�a ~*<w=.�e-:�JKf�fKXRFKX243-:<>2M6=.0e3ORV-:0JR4'��0e}J2�24}^Y[KfCxRwI*2���26�f�xRwI*2�=.<>/KN3�-�R><>_J�P/ M�-D_e3>-"�B�P=�M�-u�]R>I*2�=.<>/�R>I*2i~*<>=S�e-:�JKf��KPROKP243iQDKXUS2�0 �J/t�6¶4¦J�(M6=._J�N}�RV-:�.2=.0�=.0J�P/�R>I*2�U:-"�P_*243�·i-:0e}t¶.Y*-:0e}%R>I*2iµ�a ~*<>=.�e-:�JKf�fKPROKP243�?G=._J�N}�e2�ROKP9 2�-"U.2�<6-:Q.243�=:C¼R>I*2�9�'

)¨Ie-:R�RFKX9�2�-u�XRw2�<>0e-:ROKP=.0�R>I*2�=.<FKX243�}SKf�z2�<bCp_*0e}*-:9 2�0JRV-"�f�P/�Cp<>=.9 µ�a KN3�Mw�P24-:<�-"�N3O=�CE<w=.9 RwI*2�C�-.M6RbR>Ie-:RR>I*2�/~*<>24}SKNM6R(0*2�? 26�z24M6RV3G0*=SR]KP0�µ�a�Y*R>Ie-DRx9�KXQSI1R�KP0�~*<OKP0eMwKP~J�X2��e2�=.�e3O2�<wU.24}26��~,2�<OKP9 2�0JRV-"�f�P/.Y,�X24-S}SKX0*QR>=-#M6<w_eMwK`-u�xR>243OR"' ª*=.<�26��-:9�~J�X2.Yy?(I*2�0dRW?G=#3O~JKP0e3i-:<>2i~,2�<OCE24M6RF�X/�-:01RFK`M6=S<><>26�N-:R>24}^YyR>Ie-:R�?G=._J�N}�~*<w243O_*9!-:�J�P/3LKPQ.0JKfCp/vR>Ie-:R R>I*26KP< �z��3�-:<>2�=13>MwKf�f�N-:ROKP0*QdKX0§~e2�<OCp24M6R�3O/10eMwI*<>=.0JKN3O9 3O=tRwIe-:R4YyCp=.<!-�QDKXUS2�0v<>243O_J�PR!=DC¤R>I*2�g9 24-.3F_*<>2�9 2�0JR4Y]RwI*2�26��-.M6R�ROKP9 2KP01R>2�<wUu-"���,2�RO?x2�2�0vRwI*2#g -:0e}v��9 24-.3O_*<>2�9�2�01RV3�M6=._J�N}�}J2�R>2�<>9�KX0*2�R>I*2-.M6R>_e-u�¨<w243O_J�PR�-:R��Y�0*=.R 9 2�<>26�P/�KPRV3µ�a­~*<>=S�e-:�JKf��KPRO/.' )GI*2�0v?G2�?G=._J�N}v�,2#~e2�0*2�Rw<V-:ROKP0*Q�R>I*2CE=SQ8-:0e}=.�e3O2�<wU.KP0*Q�9 =.<>2R>Ie-:0���=.I*<R>I*=._*Q.IJRi~e=13w3LKP�J�X2.' )¨I*2�26��~,2�<OKP9 2�01R63 =:C���'B78-"�PR>I*2�<!-D0e}vM6=u?G=.<w�.2�<V3�=.03LKP0*Q:�P2�-:R>=.9�9!-.3O2�<63B-:<>2�-"�P<>24-S}J/�3OI*=:?GKP0*Q�3F=.9 2G<>243O2�9i�J�N-:0eM62bR>=�R>I*2GR>24MwI*0*=:�P=.Q./iR>Ie-:RB?G=._J�N}i�,2(<>24�S_JKX<w24}R>= ~,2�<OCp=.<>9 3O_eMwI#-:0�26�*~e2�<OKP9 2�0JR4'

7d2�Ie-"U.2�3OI*=:?(0=.0J�P/!R>Ie-DR¨3F=.9 2b=:C¼R>I*2�M6=.0eMw�P_e3LKP=.0e3�R>Ie-:RGIe-"U.2��,2�2�0#}J<V-"?(0�CE<>=S9 RwI*2¤��26�f�f�1g¤3F~e24M6R?G=.<>�i?G2�<>2(~*<>2�9-:R>_*<>2b�e24M�-:_e3F2��V¶D�¼R>I*2�3O~e=J=.�J/!3OR>_J�#?(-.3�}J_*2�=S0J�X/R>=�R>I*2�9�K`3FRV-:�.2�0!-S3>3O_*9 ~*ROKP=.0R>Ie-:RG-M6=.0e}SKPROKP=.0e-"�e~*<w=.�e-:�JKf�fKXRO/i9i_e3ORB3LKPQ.0JKfCE/ -�~*I1/*3LKNM�-"�*KP0 �e_*2�0eM62.Ye-:0e}��W¦J�^R>I*2(�]26�f�|-:<wQ._*9 2�0JRV3¼}J=�0*=SRHM6=.0e3WK`}J2�<-"�f�e~e=J3>3LKP�J�P2(�P=*M�-"�eR>I*2�=.<OKP243�SR>I*2(��26���,KP0*24�._e-"�fKPROKP243(-:<w2]=.0J�P/��fKX9�KXR6-:ROKP=.0e3B=S0�?�Ie-:R]M�-:0i�e2(~*<w24}SK`M6Rw24}i�1/i��26���R>I*2�=.<FKX243�'�)GI*2�g¤3O~,24M6R�26��~,2�<OKP9 2�0JR�9!-"/�3OI*=:? RwIe-:R¤3F_eM>I�R>I*2�=.<OKP243b-:<>2�_*0JR>2�0e-:�J�P2.Y^�*_*Rb?GKPR>I*=._*R�CE_*<wR>I*2�<-:0e-"�P/*3LKN3GKPRG�P24-"U.243�=.~e2�0�R>I*2�3ORV-DR>_e3�=:CH=SR>I*2�<G�P=�M�-u�HM�-:_e3>-"�yR>I*2�=.<OKP243G9 =S<>2�R>=!&HKX0e3FR>26KP0z��3G�fKP�SKX0*Q,'

)¨Ie-:RBCp_*<>R>I*2�<(-:0e-"�P/*3LKN3�KN3�YSKP0Cû-.M6R"Y1-"�P<>24-.}J/�_*0e}J2�<>?(-4/.'�g�0�KP9 ~e=.<wRV-:0JR]~e-:<>RG=:C^KPRGIe-.3��e2�2�0�~*<>=:USKN}J24}�J/vZ.R>2�U.2�¯�_J�f����3#�6£B=S_�M�-:0z�hR�~*<w=.Q.<V-:9 RO?x=%KP0e}J2�~e2�0e}J2�0JRO�P/ <w_*0*0JKX0*Q�M6=.9 ~*_*R>2�<V3�R>=�2�9i_J�N-:R>2R>I*2#&]@��26�*~e2�<OKP9 2�0JRV��R>I*2�=.<>2�9#YJ?(IJKNMwI#?G2b�P24-:<>0*24}�-:�e=._*Rb-:RGR>IJKN3(9 2�2�RFKX0*Q,'B��R�3F2�2�9!3�Ye-:R�{e<V3FR(Q:�N-:0eM62.Y*R>=��e2 �O_e3OR?(Ie-:Rb?G2iIe-4US2�0*2�24}J24}��,24M�-:_e3O2iKPR�M6=._J�N}��P24-.}�R>=9 =.<>2 M6=.QS2�01RbR>243ORV3�=:C]R>I*243F2�KN3>3F_*243�R>Ie-:0t}SKN}�R>I*2 ��26���-:<>QS_*9 2�01R"' )GI*2!3O_*Q.QS243OROKP=.0�KN3�RwIe-:R�3O=.9 2i=:CGR>I*2�µ�a ~*<>24}SKNM6ROKP=.0e3iM�-:0d�e2!}J_*~J�fKNM�-:R>24}��J/��X=*M�-"�(M�-:_e3>-"�R>I*2�=.<FKX243¨=.0J�P/��1/iKP0JU.=.�SKP0*Q!R>26�P2�=:�P=.QDK`M�-u�¼26�P2�9 2�01R63�-.3�KP0#RwI*2�7 I*2�26�P2�<O�*ª*2�/J0*9!-:0�26�P24M6R><>=*}J/10e-D9iKNM�3�'G�pC]3O=eYR>I*2�0t-�M6<>_eMwKN-"�]26�*~e2�<OKP9 2�0JR�?G=._J�N}��,2iR>=�U.2�<OKfCp/#R>I*2µ�a´~*<>24}SKNM6ROKP=.0e3bKP083O_eMwItM�-.3O243�'���RbKN3b0*=.R�=S�1USKP=._e3?(I*2�R>I*2�<�R>I*2�g�3O~e24M6R�26��~,2�<OKP9 2�01R�3F2�<>U.243GR>IJKN3G~*_*<w~e=13O2.'

)¨I*2(KP9 ~J�fKNM�-:ROKP=.0�3O2�2�9!3�R>=��,2�R>Ie-:R4YDKfCHR>I*2�µ�a�~*<>24}SKNM6ROKP=.0e3bM6=.0JROKP01_*2bR>=i�e2�M6=.0J{e<>9 24}^Y�?x2�26��=.<6MwK`3F2��26�f�û� 3!3O_*~,2�<O�P_*9iKP0e-"��3O~e=J=.��=.0J�P/8R>=�C�-.M62�¯�_J�f����3iR>26�P2�=:�P=.Q:KNM�-"��3O~e=J=.�^' ��=:?G2�U.2�<4Yy?G2�3OIe-u���b0*=.Ri<>_e3OIvR>=~*<>2�9!-DR>_*<>2 �W_e}JQS9 2�01R63�'!�G24M�-u���fKP0*QtR>Ie-DRbKXR�<>24�S_JKX<w24}t3O=.9 2«.·/.24-:<V3bRw=�X=*M�-:R>2�U.=.0t�(2�_*9-:0*0z��3�IJKN}*}J2�0-.3>3F_*9 ~*ROKP=.0e3�Ye-D0e}R>I*2�0�=:U.2�<(¦.·i/.24-:<63]Rw=��P=*M�-:R>2i�]26�f����3�Y�KXR�3O2�2�9!3¨<>24-.3O=.0e-D�J�X2�Rw=�-S3O� Cp=.<(-��fKPR>RO�P2�RFKX9�2�R>=3O24-:<6M>ICp=.<�¯b_J������3�Y*�e26Cp=.<>2i}J<V-"?GKP0*Q!M6=.0eMw�P_e3LKP=.0e3�-:0e}~,=13>3LKP�J�P/ 3O_*QSQ.243OROKP0*Q 0*2�? 26�*~e2�<FKX9�2�01RV3�'

�L0#R>IJKN3(}SKN3>M6_e3w3LKP=.0�?x2�Ie-"U.2b0*=.RGCp=._*0e}�-:01/M6=.0 �*KNM6R��,2�RW?G2�2�0��]=SI*<4��3�~e=13WKXRFKX=S0 -:0e}��x-"/.243WK`-D0�~*<>=.�*�-:�JKf�fKPRW/§R>I*2�=.<>/.Y�?(IJKNMwI -D<>2��e=.RwI -:R RwI*2�2�~JK`3FR>2�9 =:�P=.Q:KNM�-"���P2�U.26��' ��2�U.2�<>R>I*26�P243>3�Y(}SK��z2�<>2�0eM6243�-D~*~e24-:<=.09 =.<w2�}J2�R6-"Kf�X24}d26�e-:9iKP0e-:ROKP=.0tRw=!�,2 <>2�~e=S<>R>24}�26�N3O2�?(I*2�<w2.'cGC�M6=S_*<V3O2.Y^R>I*2�µ�a Cp=.<>9!-"�fKN3O9 -"�N3O=#M6=.0JRV-"KP0e3Cp_*0e}*-:9 2�0JRV-"�f�P/KX9�~e=.<>R6-:01R(-:0e}M6=.<><w24M6Rx=S01R>=D�X=SQ:KNM�-"�z26�X2�9�2�01RV3 �JCE=S<x26�e-:9 ~J�P2.Y*RwI*2�<>2�Ie-S3GR>=i�e2�3O=S9 2�R>IJKP0*Q~*IJ/�3LKNM�-"�f�P/t<>24-u�¼KP0�R>I*2i26KPQ.2�01U:-"�P_*243i-:0e}�9!-:R><OKf��26�X2�9�2�01RV3b=DC]R>I*2i=.~e2�<V-DR>=.<V3¨CE<w=.9 ?�IJK`MwIt?G2�=S�*RV-"KP0t}J2��RV-"Kf�P24}�~*<>24}SKNM6ROKP=.0e3i=DC¤3O~e24M6Rw<V-"�]�fKP0*243�'��LR�3F2�2�9!3�R>Ie-:R4YyR>=�_*0e3>M6<V-:9i�J�P2!RwI*2!2�~JKN3OR>2�9�=:�P=.Q:KNM�-"��~*<>=S�e-:�JKf��KPRO/3ORV-DR>2�9 2�0JRV3[CE<w=.9 R>I*2b=.0JR>=:�P=.Q:KNM�-"�^26�P2�9 2�01R63]?G2b0*2�24} Rw=�{e0e}-�}SKf�z2�<>2�0JR�CE=.<w9!-"�fKN3O9#Y:KN3O=S9 =.<>~*IJKNM�KP0�3F=.9 23O2�0e3O2��*_*R��e-.3O24}=.0�}SKf��2�<w2�01R(U:-:<OKN-:�J�P243��KPR(?(-.3�=.0J�P/!R>I*<w=._*Q.I�3O=.9 2b?G26KX<6}9!-:R>I*2�9!-DROKNM�-"�¼-.M�MwKN}J2�01RbR>Ie-:RKPR(?(-.3G~,=13>3LKP�J�P2iR>=�{e0e}#-iU:-:<OKN-:�J�P2�v?(IJKNMwI 3>M6<V-D9��J�P243�R>I*2�9 _*~KP0#RwI*2�~*<>243O2�0JR(?(-"/.'

)¨I*2�<>2 KN3 Mw�P24-:<F�X/�-�9!- �W=S<4Y^Cp_*0e}*-:9 2�0JRV-"�f�P/�KP9 ~e=.<wRV-:0JR�9i/�3FR>2�<>/83ORFK��f��Rw=#�e2#Mw�P24-:<w24}v_*~�I*2�<>2��G�*_*R_*0J�P243>3i/.=S_89!-uKX0JRV-"KP0�/.=._*<¢Cû-"KPR>I�R>Ie-:R�R>I*2�<>2�KN3 -�<V-DROKP=.0e-"�x26�*~J�N-:0e-:ROKP=.0zY�/.=._d?GKf���b0*2�U.2�<�{e0e}tR>Ie-DR�26�*�~J�N-:0e-:ROKP=.0z'�ª�=.<�¬.·/.24-:<63�Y¼-.M�M62�~*R6-:0eM62 =:CGR>I*2�;]=.~,2�0*Ie-:Q.2�0dKP01R>2�<w~*<>2�RV-:ROKP=.0dIe-.3�~*<>2�US2�01R>24}d-:01/%CE_*<wR>I*2�<

Page 16: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4¬ ¶4¬

~*<>=.QS<>243>3�KP0��e-.3LKNM�_*0e}J2�<63ORV-:0e}SKP0*Q�=:C]~*IJ/�3WK`M�-u�¼�N-"?�'(�b-:<>=:�N}#+D26��<w2�/�3¢�V¶4³.º�®.�B~*_*R(KPR �W_e3OR�<OKPQ.I1R s �"Z1MwKP2�0eM62-:R]-:0J/i9 =.9 2�0JR]}J=J243B0*=.RGMw�`-uKX9 R>=�Ie-"U.2�26��~J�N-:0e-:RFKX=S0e3]=DC|2�U.2�<>/JR>IJKP0*Q �*-:0e} -SM�M62�~*RV-:0eM62b=:C�-:0�KX0e-S}J24�._e-:Rw226�*~J�`-D0e-:ROKP=.0 }SKN3>M6=S_*<V-:Q.243b3O24-:<VMwICp=.<(-iQ.=J=�}=.0*2.' �

��=:?��P2�Rz_e3[R>_*<>0�R>=�-D0�-:<>24-GR>Ie-DR�3F2�2�9!3¼-D�e=._*R¼-S3z}SKf��2�<w2�01R¼-S3^=.0*2xM6=S_J�`}¤KP9!-:Q:KP0*2.Y:/.2�RzRwI*2B_*0e}J2�<O�P/.KP0*Q�P=.Q:KNM�=:C^KXR�Ie-:0*Q13�=.0 R>I*2�3w-:9 2(~,=:KP01R s 7�Ie-:R�Ie-:~*~e2�0e3�KP0!RwI*2(<>24-"�e?G=.<O�N} }J2�~,2�0e}*3G=.0 ~*IJ/*3LKNM�-"�e�N-"? -:0e}�K`3=.0R>I*2G�P2�U.26�z=:C¼=S01R>=D�X=SQ./.'z7�Ie-:R�?x2�M�-:0 ~*<w24}SK`M6Rb}J2�~e2�0e}*3G=.0=._*<G3ORV-:R>2�=:Cz�10*=:?G�P24}JQ.2�-:0e}�K`3¨0*24M6243>3>-:<OKf�P/=.0�R>I*2y�P2�U.26��=DCe2�~JK`3FR>2�9 =:�P=.Q./.'B��2]?(I*=bM6=.0JCE_e3F243z<>24-u��KPRO/�?GKPR>I�IJK`3y�J0*=:?G�P24}JQ.2]=DC�<>24-u��KPRO/�Q.2�0*2�<V-DR>243^0*2�24}S�P243>3-:<>RFK�{|MwKN-"�y9�/*3OR>2�<FKX243�'

���#� �z������� � �]��� �� ��"� �G� !�g�3�?G2i�P24-:<>0dKP0826�P2�9 2�0JRV-:<>/dR>I*2�<>9 =*}J/10e-D9iKNM�3�YB¥b26�XUSKP0z��3�Cp=.<>9i_J�N-Cp=.<�RwI*2 2��MwKP2�0eM6/8=DC�- ;x-:<>0*=SR�I*24-:R2�0*Q:KP0*2�=S~e2�<V-:RFKX0*Q�e2�RO?G2�2�0�_*~*~e2�<�-D0e}��X=:?G2�<(R>2�9�~e2�<V-:Rw_*<>243�� ��� � s

��� ¶���� � �� � �W¦.¦J�

?GKPR>I�24�S_e-"�fKXRO/�KfC¨-:0e}�=.0J�P/%K�C(R>I*2i2�0*Q:KP0*2iKN3b<>2�US2�<V3LKP�J�P2.Yz26�*~*<>243>3O243�-��fKP9iKPRV-:ROKP=.0 KX9�~e=13O24} �1/�R>I*2�3O24M6=S0e}�N-"? =:C(R>I*2�<>9�=�}J/J0e-:9iKNM�3�'#��_*RiR>I*2 ?G=.<F�`}^� 3�9 =13FR�_*0JKPU.2�<V3>-u���P/v-"Uu-"Kf�N-:�J�P2#3O=._*<VM62�=:C(?x=S<>��� R>I*2!-D0JKX9-"�9i_e3>Mw�P2��!~*<w243O2�01R63G_e3G?GKPR>I�- 3O2�2�9iKP0*Q:�P/ �|-:Q.<6-:01RGUSKP=:�N-:ROKP=.0�=:C¼R>Ie-DRGCE=S<>9i_J�`-�'

c(_*<�9�_e3wMw�X243�}J26��KPU.2�<�_e3O26CE_J�b?x=S<>��?(I*2�0vR>I*2�<>2�KN3i0*=tM6=:�N}�<>243O2�<>U.=DKX< -:RiIe-:0e} ��=.0v-�I*=.R }*-"/tR>I*2-:9i�JKP2�01R�R>2�9 ~e2�<6-:R>_*<>2bKN3b-:RG=.<�-:�,=uUS2��,=�}J/�R>2�9�~e2�<V-:Rw_*<>2:�x-:0e}�-i0e- � �XUS2�-:~*~J�fK`M�-DROKP=.0�=:Cx�O¦.¦J�B?G=._J�N}��X24-S}_e3GR>=�~*<>24}SKNM6R ��2�<>=,Y*=.<G2�U.2�0#0*2�QJ-:ROKPU.2�2��MwKP2�0eM6/.'()GI*2�=.�e3F2�<>U.24}�2��MwKX2�0eM6/�=DC�-i9i_e3>Mw�P2.Y^}J26{e0*24}#-.3

� ���?G=.<>��}J=.0*2:�

�L?x=S<>��}J=.0*2 � I*24-DRBQ.2�0*2�<V-:R>24},�KN3�}SK �M6_J�PR�R>= 9 24-.3F_*<>2.Y|-D0e}KPR(KN3�}SK �M6_J�PR�R>=�{e0e}�<>26�fKN-:�J�P2 26�*~e2�<OKP9 2�0JRV-"�]U:-"�P_*243b?GKPR>I -SM�M6=._*01R63(=:CBI*=:?R>I*226��~,2�<OKP9 2�0JRV3i?G2�<>2!}J=.0*2.'�7d2�3OIe-u���(_e3O2=.0J�P/�R>I*2 �N-:Rw243OR�U:-"�P_*2�?x2Ie-"U.2��X=*M�-:R>24}^Y¨��g(�P�,2�<>RV3�Y - n�q +¶4³.²S«J�V'¼)¨I*2�I*24-:RGQ.2�0*2�<6-:R>24}R>Ie-:RGM�-:0�e2�-:R>Rw<OKP�*_*R>24} Rw=�9i_e3>Mw�P2�-.M6RFKXUSKPRO/!-:~*~e24-D<V3�R>=i�e2�-.3H�X=:? -.3G-:�,=._*R« %.®=:C�R>I*2?G=.<>�t}J=.0*2��G?(IJKNMwI�KP9 ~J�fKX243�R>Ie-:R�=.�e3O2�<>US24}�9�_e3wMw�X2�2��MwKX2�0eMwKP243M�-:0��e2#-.3�IJKPQ.I�-.3�®u·�� KP0C�-4US=._*<V-:�J�P2�M6=S0e}SKXRFKX=S0e3�Yz-"�PR>I*=._*Q.I�-�;G-:<>0*=.RG2�0*Q:KP0*2 ?G=._J�N}�<w24�._JKP<>2 -:0�_*~*~e2�<�R>2�9 ~,2�<V-:R>_*<w2� =:C]-:�,=._*R¶4·.·S·�¥ R>= -.MwIJKX2�US2�R>IJKN3�']a�-:0J/�-:_*R>I*=.<V3�Ie-"U.2�?G=.0e}J2�<>24}%I*=:? RwIJK`3bM�-:0��,2.'

)¨I*2�=.�JU.KP=._e3x{e<V3OR�-:0e3F?x2�<¨K`3�Ye=:CBM6=._*<V3O2.Y,R>Ie-:R(-i9i_e3>Mw�P2�KN3G0*=.R�-iI*24-DR�2�0*Q:KP0*2.'���R�}J<V-"?�3�KPRV3(2�0*2�<wQ./.Y0*=.R¢CE<>=S9 -:0J/tI*24-:R�<>243O2�<>U.=DKX<"Y¼�*_*R�Cp<>=.9 R>I*2�-SM6ROKPUu-:R>24}�9�=:�P24M6_J�X243�~*<>=�}J_eM624}��J/8-�M>I*2�9iKNM�-"�(<>24-SM6ROKP=.0z'c(0J�P/#?(I*2�0�?G2b{e<V3OR�-"�f�X=:? RwIe-:R(~*<OKP9!-:<w/�2�0*2�<>Q./�R>=!}J2�QS<V-.}J2�KPRV3F26��CBKP0JR>=I*24-:R�-:R(Rw2�9 ~e2�<V-DR>_*<>2� �#-:0e}R>I*2�0�26��Rw<V-.M6R�=.0J�P/tR>Ie-DR�I*24-:R�Cp=.<�=S_*<�2�0*Q:KP0*2�� }J=J243�RwI*2!¥b26�PU.KP0v2��MwKP2�0eM6/dCE=.<w9�_J�N- �W¦.¦J��-:~*~J�P/�KP0dKPRV3M6=.0JU.2�0JROKP=.0e-"�e9 24-:0JKP0*Qe'���R]-:~*~,24-:<V3BRwIe-:RB=._*<B9i_e3>Mw�P243BIe-"U.2��P24-:<>0*24}�I*=:?vR>=�M�-:~*R>_*<>2�R>I*2G~*<OKP9!-:<>/i2�0*2�<>Q./�e26Cp=.<>2bKPRbIe-.3(- MwIe-:0eM62�R>= }J2�Q.<V-.}J2��*�*_*R�I*=u?�}J= ?G2�<>26�N-:R>2�RwIJK`3¨R>= R>I*2�3O24M6=S0e}�N-"?�±

�G-.3WK`M�9!-DR>2�<OKN-"�¼=.0�9i_e3>Mw�P2�3OR><w_eM6R>_*<>2�-D0e}�2�0*2�<>Q.2�RFK`M�3b=DC]�JKX=*MwI*2�9iKNM�-"�]<>24-.M6ROKP=.0e3¨KN3(QDKXUS2�0 �J/�Z1�S_JKX<w2�V¶4³S²*¶:�¤-D0e}v\^2�I*0JKP0*Q.2�<��V¶4³.²S¦J�VYB-:0e}�~*<>=:Cp_e3O26�P/�Kf�f�X_e3FR><V-:R>24}§�J/tg��X�,2�<>RV3�Y - n�q ¢�V¶4³.²S«J�V'8)¨I*2#3O=._*<VM62�=:C2�0*2�<>Q./�CE=.<B9i_e3>Mw�P2�M6=.0JR><V-SM6ROKP=.0��W-:0e}�KX0e}J2�24}�Cp=.<G-"�P9 =13OR�2�U.2�<>/JR>IJKP0*Q�-�M626�f�[}J=J243�R>Ie-:R�<>24�._JKP<>243�2�0*2�<>QS/e�[K`3�e26�fKP2�U.24}�R>=��e2�IJ/�}J<>=D�X/*3LKN3�=:C¼-.}J2�0*=13LKP0*2�Rw<OKP~*I*=13O~*Ie-:R>2i�Lg])(@G�VYDCE=S<x?�IJK`MwI�R>I*2b<>2�~e=S<>R>24}I*24-:RG=:C¼<w24-.M6ROKP=.0KN3�� � �§��³�'�³��1M�-u� %"9 =:��Y.=.<G·*'h¸1«¢2�Ui~e2�<G9 =:�P24M6_J�P2.'x)¨IJK`3�2�0*2�<>QS/iKN3x}J26�fKPU.2�<>24}Rw=�3O=.9�2��SKP0e} =:Cx�62�0*QDKX0*24�KP0t-i9i_e3>Mw�P2�{e�,2�<4Y�CE<>=S9 ?(I*2�0eM62i2�9 2�<>Q.243¨_e3O26CE_J�B?G=.<>��1/#M6=S01R><6-.M6ROKP=.0z'G)GI*2�I*24-:R�Q.2�0*2�<V-:R>24}�KN3�M�-:<w<OKP24}=:���1/�R>I*2G�J�P=1=*}!3FR><>24-:9#Y.-DR¼�,=�}J/ Rw2�9 ~e2�<V-DR>_*<>2.Y.¦J®u« � «J® ��«*¶4·b¥i'1)GIJ_e3yR>I*2�}*-:R6-(?G2GIe-"U.2GR>=�-.M�M6=._*0JRCp=.<�-:<>2 s

g�9i�JKP2�0JR(R>2�9 ~,2�<V-:R>_*<>2 s «*¶4· ¥Z.=._*<VM62�2�0*2�<>QS/ s ·�'h¸1«�2�U$%"9 =:�P24M6_J�P2& �MwKP2�0eM6/ s ®:·��!'

Page 17: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶:® ¶:®

7t2�}J=#0*=.Ri-:R>R>2�9�~*R�R>=�-:0e-"�P/ ��2�-"�f�x26�JKN3OROKP0*Qt�JKP=:�P=.Q:KNM�-"�(�J0*=:?G�P24}JQ.2 KP0�R>IJKN3¢{e26�`}v-D�e=._*R�R>I*2�}J2�R6-"Kf�`3�=:CR>Ie-:Rb2�0*Q:KP0*2.Y¼-u�XRwI*=._*Q.I�KP0 =S_*<¤M6=.0eMw�P_e3LKP=.0e3�?G2�3FIe-"�f�]�e2 -:�J�P2iR>=!=D��2�<�3O=.9�2�R>2�0JRV-:ROKPU.2iM6=.9 9 2�0JRV3b=.0%KPR4'c(_*<]~*<w243O2�01RGM6=.0eM62�<>0�KN3B?GKPR>I RwI*2(Q.2�0*2�<V-"�^~*I1/*3LKNM�-"�^~*<OKP0eMwKX~J�P243GRwIe-:R]9i_e3ORBQ.=:U.2�<w0�M6=S01U.2�<63LKP=.0 =:C¼MwI*2�9iKNM�-"�2�0*2�<>Q./�KX0JR>=i9 24MwIe-:0JKNM�-"�z?G=.<>��KP0�-:0J/!3O/*3OR>2�9�Y.24�S_JK��fKP�*<OKP_*9 =.<�0*=.0*24�._JKf�fKP�*<OKP_e9#Y,�JKP=:�P=.Q:KNM�-"�¼=S<]=.R>I*2�<w?GKN3O2.Y?(Ie-:Rw2�U.2�<¼RwI*2x}J2�RV-"Kf�N3B=DCeR>I*2]2�0*Q:KP0*2.'B�L0iR>I*2G�10*=:?(0¢Cû-.M6R63z=:Ce9i_e3>Mw�P2G~e2�<FCE=.<w9!-:0eM62]?G2GIe-"U.2x3F=.9 2]_*0JKN�S_*26�P/M6=.Q.2�0JR(2�USKN}J2�0eM62�<w26�X2�U:-:0JR�R>=iR>IJKN3�~*<>=.�J�P2�9#'

)¨I*2�3ORV-:Rw_e3y=:CzR>I*2�3O24M6=.0e}��`-"? KX0�JKP=:�P=.Q./ Ie-S3y�P=.0*Q��,2�2�0�-¢9i/�3ORw2�<>/.'¼��=.R]=S0J�X/i?(-.3yR>I*2�<w2¤-�3O2�2�9�KX0*Q0J_*9 2�<OKNM�-"��M6=.0JR><V-.}SKNM6ROKP=.0��e2�RO?G2�2�0v9i_e3>Mw�P2!2��MwKP2�0eM6/�-:0e}dR>I*2�3O24M6=.0e} �N-4?�Y¼�*_*R -"�N3O=�R>I*2Q.2�0*2�<V-u�¨3O26�fCp�=.<>QJ-:0JK �6KX0*Qb~e=:?G2�<z=:Ce�JKP=:�P=.QDK`M�-u��3O/*3OR>2�93z3O2�2�9 24}¢R>=�M6=.0 �*KNM6RB?GKPR>I�R>I*2��6R>2�0e}J2�0eM6/�R>=�}SKN3O=.<V}J2�<6�(~*IJKf�P=13O=.~*IJ/R>Ie-:R�Ie-.}��e24M6=.9 2 -:RwRV-.MwI*24}R>=!RwI*2�3O24M6=.0e}%�N-"? �L9�_eMwI -S3���=.I*<4� 3G~*IJKf�X=J3O=.~*IJ/ =DC�M6=.9�~J�X2�9�2�01RV-D<OKPRW/�Ie-.}�e24M6=S9 2!-:R>R6-.M>I*24}�R>=#�S_e-:0JR>_*9�9�24M>Ie-:0JKNM�36�6' )GIJKN3��P24}^Yy~*<>24}SKNM6RV-:�J�P/.YyR>=#-<>24-SM6ROKP=.0�KP08RwI*2�}SKP<>24M6RFKX=S08=:CUSKXR6-"�fK`3F9#'

�L0�=._*<(USKX2�?�Y^?(Ie-:R>2�U.2�<�Ie-:~*~e2�0e3¤KX0�-i�fKPUSKX0*Q�M626�f�BK`3 �O_e3OR¤-S3(9i_eMwI -�<>24-"�¼~*IJ/�3WK`M�-u�H~*I*2�0*=.9�2�0*=.0t-.3?(Ie-:R�Ie-:~*~e2�0e3¢KP0v-�3OR>24-:9 2�0*Q:KP0*2��yCû-D<�Cp<>=.9 USKX=D�`-DROKP0*Q ~*IJ/*3LKNM�-"�]�N-"?�3�Yy�JKP=:�P=.Q:KNM�-"��3O/*3OR>2�9!3b26�*IJKP�JKPR R>I*2=.~,2�<V-:ROKP=.0v=:CbR>I*=13O2��N-4?b3�KP0vR>I*26KP<iCE_J�f��QS2�0*2�<V-"�fKPRW/v-:0e}v}SKPU.2�<V3WKXRO/.Y�R>Ie-:Ri~*IJ/�3LKNMwKN3ORV3�Ie-.}d0*=.R!M6=.0e3WK`}J2�<w24}KP0�R>I*2�IJKN3OR>=S<OKNM�-"�x}J2�U.26�P=.~*9 2�0JR�=DC]R>I*2�<>9 =*}J/10e-D9iKNM�3�'�)GI*2�<w26CE=.<w2.Y*KfCx�JKP=:�P=.QDK`M�-u�x3O/�3FR>2�9!3b3O2�2�9 Rw= U.KP=:�N-:Rw2M6=.0JU.2�0JROKP=.0e-"�H3OR6-:R>2�9 2�0JRV3G=:CBR>I*2i3O24M6=.0e}�N-"?�Y*=S_*<¤M6=.0eMw�P_e3LKP=.0�KN3b=.0J�P/�R>Ie-:R�R>I*2�3O24M6=S0e}�N-"?A0*2�24}*3�R>= �,2<>243OR6-:R>24}�9 =.<>2M�-:<>26Cp_J���P/.'�c(_*<i~*<>243O2�0JR�-"KP9 K`3¢R>I*2�<>26Cp=.<>2 Rw={e0e}8-�3OR6-:R>2�9 2�0JR�=:CxRwI*2!3O24M6=.0e} �N-4?�R>Ie-:R<>24}J_eM6243�R>= R>I*2�R><V-.}SKPROKP=.0e-u��3OR6-:R>2�9 2�0JRV3�=:CG;B�N-:_e3LKP_e3�-:0e}�¯�KP�*�e3GKP0�R>I*2�}J=S9!-"KP0#?(I*2�<w2�R>I*2�/?G2�<>2�U:-"�fK`}^Y�*_*RGKN3�Q.2�0*2�<V-"�¼2�0*=S_*Q.I�R>=iKP0eMw�P_e}J2i�JKX=D�X=SQ:KNM�-"�H~*I*2�0*=S9 2�0e-*'

)¨I*2 �6Rw2�0e}J2�0eM6/8R>=t}SKN3O=.<6}J2�<V��-:<>Q._*9 2�0JRV3i-:<>2R>=J=#U:-:Q._*2�R>=��e2�=:C¤-D01/8M6=S0e3OR><>_eM6ROKPU.2_e3O2Cp=.<iR>IJKN3~*_*<>~,=13O2��]-:0e} KP0 -D01/�2�U.2�0JR�KPR�KN3�Mw�P24-:<iR>Ie-DR�R>I*2�/�9i_e3OR��,2!9�K`3FRV-:�.2�08-D0e}�KPRi?G=._J�N}��e2KP0JR>2�<>243OROKP0*Q�R>=_*0e}J2�<V3OR6-:0e} ?�I1/��L?x2�R>IJKP0*� R>Ie-:R(a�-"�*?x26�f�^26��~J�N-"KP0*24}�?�I1/ -:R�R>I*2�2�0e}�=:C¼RwI*2¤-"Cp=.<>2�9�2�01ROKP=.0*24}�-:<>ROKNMw�P2�=.0}SKf�z_e3LKP=.0^�V']a�_e3>Mw�P2(2��MwKP2�0eM6/i?GKf�f�|~*<>=:USKN}J2(=._*<BR>243OR]M�-S3O2.Y:�e24M�-:_e3F2(I*2�<>2(?G2GIe-"U.2(3O=.9 2(�S_e-:01RFKXR6-:ROKPU.2(}*-:RV-R>=�-.M�M6=._*0JR(Cp=.<4'(��_*R�- 9i_e3>Mw�P2i=.~,2�<V-:R>243¨KP08- 0*=S0*24�._JKf�fKP�*<OKP_*9 3WKXRw_e-:ROKP=.0zY,Cp=.<(?(IJKNMwIt0*=�}J26{e0JKPR>2 3O24M6=S0e}�N-"? KN3R>=��e2�CE=S_*0e}�KP0�R>I*2�R>I*2�<>9 =*}J/J0e-:9iKNM�fKPR>2�<V-:Rw_*<>2.' )GI*2#M6=.0JU.2�0JROKP=.0e-"�¤3O24M6=S0e}v�N-"? ~*<>243F_*~*~e=13O243R>I*2�<>9-"�fK`3w-:ROKP=.0�e24M�-:_e3O2bR>2�9 ~,2�<V-:R>_*<w2�-:0e}�2�01R><w=.~1/i-:<>2�}J26{e0*24}=S0J�X/�CE=.<G3ORV-:Rw243y=:CzR>I*2�<>9!-"�e24�S_JKf�fKX�*<FKX_*9�'��=u?�}J= ?G2�MwKX<6M6_*9�US2�01R(RwIJK`3m±

Z.=S9 2iIe-4US2�RwI*=._*Q.IJR�R>Ie-:RbKPR�?G=._J�N}��e2!-IJKPQ.IJ�P/8}SK �M6_J�PRiR>I*2�=.<w2�ROKNM�-"�]~*<>=.�J�P2�9#YyM�-"�f��KP0*Q�Cp=.<�-Q.2�0*�2�<V-"�fKN3O24}�2�<>QS=�}SKNMR>I*2�=.<w/tR>=�KP0eMw�P_e}J2t-:0e-"�P/*3LKN3i=:C��69iKf�JKX0*QJ�t-:0e}���M>Ie-D=13>�*'�g�0*=SR>I*2�< 3>M>I*=J=:�G=:C�R>I*=._*QSI1RI*=:�N}*3GR>Ie-DR]?G2�0*2�24}�-�9 =*}SKf{|M�-:ROKP=.0�=:CzR>I*2�9iKNM6<>=13>M6=S~JK`Mb24�S_e-:ROKP=.0e3¨=:Cz9 =.ROKP=.0R>= MwKP<VM6_*9iU.2�01R(\,KP=._*USKf�f�X2.� 3R>I*2�=.<w2�9��WM6=S0e3O2�<>Uu-DROKP=.0#=:C]~*Ie-S3O2iU.=:�P_*9 2�KP0 Mw�N-.3w3LKNM�-"�x��-D9iKf�XRw=.0JKN-:0t3O/�3FR>2�9!3�Y,=.<(_*0JKPRV-:<FKXRO/%KX0t�S_e-:0JR>_*9R>I*2�=.<w/e�VYJ?(IJKNMwI�KN3�R>I*=._*Q.IJRGR>= �e2¢KP0 M6=.0 �*KNM6Rb?GKPR>I�R>I*2�3F24M6=.0e}��N-4?�'

7d2�3O_*Q.QS243OR4Y*=.0�RwI*2�M6=.0JR><V-:<w/.Y*R>Ie-:R(=S0J�X/�US2�<>/�3WKX9�~J�X2�~*I1/*3LKNM�-"�B<>24-.3O=.0JKP0*QiKN3b<>24�S_JKP<>24}^Y^-:0e}#-"�f�BR>I*2Mw�P_*243G0*2�24}J24}R>=i}J2�R>2�<>9iKP0*2bR>I*2¤-D0e3O?G2�<xM�-:0�e2�CE=S_*0e}!-"�P<>24-S}J/iKP0!R>I*2b?(<OKPROKP0*Q13�=:C¼+.-D9 243�;B�P2�<>�!a�-"�*?x26�f�-:0e}�+*'y7§K��f�N-:<V}§¯�KP�*�e3�=:U.2�<¶4·.·%/.24-:<V3�-:Q.=e'���=.R>I�Ie-.}�~,2�<VM626KPU.24}vR>I*22�~JKN3OR>2�9 =D�X=SQ:KNM�-"�(0e-:R>_*<>2=:C(R>I*23O24M6=.0e}��N-"?�-:0e} ?G2GR>IJKP0*� R>Ie-DR4Y:Ie-.}�26KXRwI*2�<B�fKPU.24}�-�CE2�?§/.24-:<V3H�P=.0*Q.2�<4YS=._*<]Q.2�0*2�<6-"�fK`3F24}!3O24M6=S0e}i�N-"?�?G=._J�N}�P=.0*Q!3LKP0eM62�Ie-4US2��,2�2�0Cû-:9�K��fKN-:<bR>= -"�f�¼3>MwKP2�01ROKN3OR63�']7d2�Q:KPU.2�RwI*2�-:<>Q._*9 2�0JR�KP0�R>I*<>2�2�3OR>2�~e3 s �O-J�B<>26KP01R>2�<w~*<>2�RR>I*2 ¥b26�PU.KP0dCE=S<>9i_J�`-�Yz���^�(9-:�.2�-�9 =.<w2�QS2�0*2�<V-"�]3ORV-:R>2�9�2�01Rb=:C]R>I*2 3O24M6=.0e} �`-"?�Y[�WM"�(R>243FR(KPR�0J_*9 2�<OKNM�-"�f�P/-:Q1-uKX0e3FR(9i_e3>Mw�P243�'

)¨I*2(=.�e3O2�<>US24}i2��MwKP2�0eM6/!=DC|9i_e3>Mw�P243�9!-"/��,2(9 =.<w2�M6=.Q.2�0JRyCE=S<]R>IJKN3B~*_*<w~e=13O2bR>Ie-:0�=.0*2(9iKPQ.IJRx-:Ry{e<63ORR>IJKP0*�^'�Z:KP0eM62!-D0JKX9-"�N3bIe-4US2�2�U.=:�PU.24}�R>I*2i3O2�0e3O243b=:Cx3WKXQSI1R4Y^3O=._*0e}^Y^-:0e}�3O9 26�f�BR>=R>I*2��fKP9iKPROKP0*Qt3O2�0e3LKPROKPU.KPRO/~e2�<w9iKPR>R>24}��J/~*I1/*3LKNM�-"�z�N-"?�YJKPRGKN3G=.0J�P/�R>=i�,2�26�*~e24M6R>24}%R>Ie-:RGR>I*2�/�?G=._J�N}�-"�N3O= Ie-"U.2�2�U.=D�XUS24}9�_e3wMw�X2�2�!�MwKP2�0eM6/���?(IJKNMwI�9�_e3FRx�,2�=:C¼24�S_e-"�H3O_*<wU.KPUu-u��U:-"�P_*2:�¨M6=S<><>243O~,=.0e}SKP0*Q:�P/.']�ûC�3O=,Y1RwI*2�0�R>I*2�9-"�1KP9i_*9 =.�e3F2�<>U.24}2��MwKP2�0eM6/=:C¼9i_e3>Mw�P243G3OI*=._J�N}�e2b0*=.RG9 2�<>26�P/!-¢�P=:?x2�<��e=._*0e}=S0!R>I*2b9!-"�JKP9i_*9 R>I*2�=.<w2�ROKNM�-"�z2��MwKP2�0eM6/!?G23O2�2��^Y*�*_*R�Mw�P=13O2�R>=iKPR(0J_*9 2�<OKNM�-"�f�P/.'

��b�#�b�!����"��� � � ���("����b����� ��� �!� �����

Page 18: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4² ¶4²

;]=.0e3WK`}J2�<�R>I*2�~*<w=.�J�P2�9 {e<63OR�KX0�RwI*2¤3LKP9 ~J�fKNMwKPRO/�=:C¼Mw�`-S3>3LKNM�-"�¼~*IJ/�3WK`M�3�Y1?�I*2�<>2�R>I*2��(-"/.�P26KPQ.IJ��+:24-D0e3G24�._JKP~e-:<w�ROKPROKP=.0��N-"? I*=D�`}*3�'!�ûCGKX0�R>I*2!¥b26�PUSKP0�CE=.<w9�_J�N-��W¦S¦J�(?G2 <>2�~J�N-.M62 R>2�9�~e2�<V-:Rw_*<>2 �J/ ?�Ie-:RbKPR�RwI*2�08-:9 =._*0JRV3R>=i� 2�0*2�<>QS/�~e2�<�}J2�Q.<w2�2�=:CyCE<w2�24}J=.9 � � � � �V¶ �u¦J������Y:KPR�R6-:�.243�R>I*2bCp=.<>9

��� ¶� ��� � � � � �>��� � � � �W¦.«J�?(IJKNMwI!}J=1243�0*=.Ry�P=1=S���fKP�.2(9i_eM>I�~*<>=.Q.<>243w3�Y4�*_*R��1/�R>IJKN3BR><FKXUSKN-"�e<>2�?(<FKXRFKX0*Q�?G2xIe-"U.2G<>2�9�=uUS24}�R>I*2G�fKP9iKPRV-:RFKX=S0=:C*R>I*2�<>9!-u�124�._JKf�fKP�*<OKP_*9 =.0�=S_*<¼2�0*2�<>QS/¤3O=S_*<VM62x-:0e}�3WKX0*�^'Bª*=.<G�6R>2�9 ~,2�<V-:R>_*<>24�xK`3y}J26{e0*24}�=.0J�P/(Cp=.<¼-�3O/�3FR>2�9KP0vR>I*2�<>9!-u�x24�S_JK��fKP�*<OKP_*9#YG?(IJKf�P28�62�0*2�<>QS/t~e2�< }J2�Q.<>2�2=:C(Cp<>2�24}J=.9�KN3�9 24-:0JKP0*Q:Cp_J�¨0*=SR�=S0J�X/ KX0vRwI*2�<>9!-"�24�S_JK��fKP�*<OKP_*9#Y[�*_*RGCE=S<�-:0J/�3O9-"�f�¼~e-:<>R(=DCH- 3O/*3OR>2�9 ��3O_eM>I�-.3�R>I*=13O2�-SM6ROKPUu-:R>24}%9 =:�P24M6_J�P243��!?(IJKNMwI#9iKPQ.IJR�e2¢Cû-D<]Cp<>=.9 R>I*2�<>9!-"�z24�S_JKf��KP�*<OKP_*9 ?GKPR>I#R>I*2�3F_*<><>=._*0e}SKP0*Q13�'

c(0*29iKPQ.IJR�R>I*2�0v�S_*243OROKP=.0�?(I*2�R>I*2�<�3F_eM>Iv-0*=.0*24�S_JK��fKP�*<OKN_*9´KP01Rw2�<>~*<>2�RV-:RFKX=S08=:Cb�W¦.¦J�GKN3�Uu-u��KN}^'�7t29!-"/.Y*I*=:?G2�U.2�<4YJ<>24-.3F=.0#-.3�Cp=:�f�P=u?b3�'Bg��XRwI*=._*Q.I M6=S01U.2�0JROKP=.0e-"�yR>I*2�<>9 =*}J/10e-D9iKNM�3�}J26{e0*243�R>2�9 ~,2�<V-:R>_*<>2i-:0e}2�0JR><>=.~J/#=.0J�P/�KP0�24�._JKf�fKP�*<OKP_*9 3WKXRw_e-:ROKP=.0e3�?�I*2�<>2�-u���GR><V-:0e3W�`-DROKP=.0e-"�x-:0e}�USKP�*<V-:ROKP=.0e-u�¨}J2�Q.<>2�243¢=:CGCE<w2�24}J=.9��9iKNM6<>=J3>M6=.~JKNM�M6=1=S<V}SKP0e-:R>2436�BIe-"U.2bR>I*2�3>-:9 2�-"U.2�<V-:QS2(2�0*2�<>Q./.YSKPR�M�-:0*0*=.RG9!-DR>R>2�<]Rw=�-D0!2�0*Q:KP0*2�?(I*2�R>I*2�<(-"�f�~e-:<>R63G=:CzKPRV3�2�0*2�<>Q./�3O=._*<VM62�-D<>2bKP0#24�S_JK��fKP�*<OKP_*9�?¨KXRwI#24-.MwI�=.R>I*2�<4'

c(0J�P/ RwI*=13O2�}J2�Q.<w2�243]=DC|Cp<>2�24}J=.9�?GKPR>I?(IJKNM>IR>I*2(2�0*Q:KP0*2bKP0JR>2�<V-.M6RV3�M�-:0 �,2(KP0JU.=:�PU.24}�KX0�KPRV3�2��MwKP2�0eM6/ �R>I*2(2�0*QDKX0*2bIe-.3�0*=�?(-"/�=:Cz�J0*=u?¨KX0*Q�?(I*2�R>I*2�<�R>I*2(=.R>I*2�<63]-:<>2G=.<G-:<>2(0*=SRB26��MwKPR>24}�R>=�RwI*2�3>-:9 2b-4US2�<V-:Q.2�2�0*�2�<>Q./.'B)GI*2�<w26CE=.<w2.Y13LKP0eM62��W¦.«J�^KN3B_*0e�S_*243OROKP=.0e-D�J�X/Uu-u��KN}?(I*2�0��e=.R>I�<>243O2�<>U.=DKX<63]-:<>2�KP0R>I*2�<>9!-"�e24�S_JKf�fKX�*<FKX_*9�YKPR(3OI*=._J�N}��,2¤M6=.<w<>24M6RG9 =.<>2bQ.2�0*2�<V-"�f�P/.YJKfCB?x2bRV-:�S2 � � � � � -:0e} � � � R>=i�e2�RwI*2¤-"U.2�<V-DQ.2(2�0*2�<>Q./�KX0�RwI*=13O2}J2�Q.<>2�243�=:C^Cp<>2�24}J=.9 ?GKPR>I?(IJKNM>I�RwI*2�2�0*Q:KP0*2�-.M6Rw_e-"�f�X/�KP01Rw2�<V-.M6RV3�'B��_*RG?(IJKf�P2�-�9i_e3>Mw�P2bIe-.3G-�3O9-"�f�[3F=._*<VM62<>243O2�<wU.=:KP<4YJKPR(Ie-.3�-��N-:<>Q.2�3LKP0*�^'x)¨I*2�<>26CE=S<>2bCE=S< � � � � � ?G2�9!-"/ RV-D�.2i�V¶ �u¦������ � -:RG�e=*}J/�R>2�9 ~,2�<V-:R>_*<w2.'g�3B-bM>I*24Mw��=.0iR>IJKN3y<>24-S3O=.0JKP0*QeY"KfCzR>I*2G~*<OKP9!-:<>/�2�0*2�<>QS/�KN3]M6=.0eM62�0JR><V-DR>24}bKP0!-b3LKP0*Q:�P2¤}J2�QS<>2�2G=:C*CE<w2�24}J=.9-:0e}�?G2�M�-:0 26�*R><V-.M6R�KPR]�e26Cp=.<>2�KPR(3O~*<>24-.}*3�-:Rx-"�f��YJR>I*2�0=._*<]2�0*Q:KP0*2�KN3BKP026�z24M6Rx-��6~*_*<>2(9�24M>Ie-:0JKN3O9���fKP�.2�-�P2�U.2�<4'G)GI*2�QS2�0*2�<V-"�fKN3O24}�2��MwKP2�0eM6/d�W¦.«J�BR>I*2�0�<>24}J_eM6243(Rw=#¶������ � �u¦ � =.<4YJKP0JR>2�<>~*<>2�RFKX0*Q � -.3GR>I*2�?x=S<>�}J26�fKPU.2�<>24}�R>= R>I*2b�P2�U.2�<"Y

�L7t=.<>� =S_*R�� � ��7t=S<>�iKP0^� ���6¶ �u¦J����� � � �W¦:¸*�)GI*2��N-.3OR�Rw2�<>9 KN3 �W_e3FR�R>I*2 9�24-:08RwI*2�<>9!-"�]2�0*2�<>QS/t=:C(R>I*2i�P2�U.2�<�KPRV3O26�fC>YB?(IJKNM>IvM�-:0*0*=.Ri�,2!26�*R><V-.M6Rw24}�<>2��~*<>=*}J_eMwKP�J�X/d�1/�-:0t-:~*~e-:<V-:Rw_e3(R>Ie-DRbK`3�KPRV3F26��C�-:RbR>2�9 ~,2�<V-:R>_*<w2 � � =.<bIJKPQ.I*2�<4'�g(Rb�P24-.3OR4Y,KfC¨-D01/.=S0*2�3FI*=._J�N}3O_eM�M62�24}�KP0v}J=:KP0*Q�R>IJKN3�YzRwI*2�0tI*2 ?G=._J�N}�0*2�24}�=.0J�P/�R>=�?(-"KPR�-�3OI*=.<>RbROKP9 2 _*0JROKf�]R>I*2i�P2�U.2�<�Ie-.3�-:�e3O=.<w�e24}-:0*=.RwI*2�< �V¶ �:¦J����� � CE<w=.9 KPRV3i3O_*<><w=._*0e}SKP0*Q13�Y]-:0e}d<>2�~,24-:R��8-:0e}d?G2 ?G=._J�N}tIe-"U.2 RwI*2!~,2�<>~e2�R>_e-u�¨9�=.ROKP=.09!-.MwIJKP0*2 R>Ie-:RbR>I*2 3O24M6=.0e} �`-"? I*=:�N}*3¢R>=!�,2iKP9 ~e=J3>3LKP�J�P2.' )GI1_e3��O¦:¸*�(3OROKf�f�x26�*~*<>243>3O243�-U:-"�fK`}�3O24M6=.0e}%�N-"?�fKP9iKPRV-:ROKP=.0zY]-D0e}tR>I*2�3LKP9 ~J�P2�Q.2�0*2�<V-u��KN3>-DROKP=.0��O¦.«J�(=:C�¥b26�PU.KP0z��3�CE=.<w9�_J�N-�-:~*~e24-:<63�Rw=#Ie-"U.2!-%<V-:R>I*2�<�?GKN}J2<V-:0*QS2�=:C�-D~*~J��KNM�-:RFKX=S0z'

��_*R#-"�PR>I*=S_*Q.I�R>I*243O2t-:<>2%KX0JR>2�<>243FROKP0*Q�IJKP01R63�Y(?G2t-:<>2�-"CERw2�<�3O=S9 2�R>IJKP0*Qv9 =.<>2�Q.2�0*2�<6-"��Y(?(IJKNMwIAM�-:0<>2�~J�N-.M62 RwI*2�3F24M6=.0e}��N-"?�CE=.<�-u���]~*_*<w~e=13O243�Y^0*=.R�9 2�<>26�P/�2�0*Q:KP0*243�' )[=#-.M>IJKP2�U.2iR>IJKN3¢?x2i9i_e3ORb_*0e}J2�<V3ORV-D0e}Mw�P24-:<O�P/ R>I*2��e-.3LKNMG~*IJ/�3LKNM�-"�^<>24-.3O=S0 ?(IJ/�R>I*2�<>2¨K`3G-�3O24M6=S0e}��N-4? �fKX9�KXR6-:ROKP=.0=.0 ~*<>=*M6243>3O243�'�7t2(3O_*Q.Q.243OR�R>Ie-:RR>I*2bCp_*0e}*-:9 2�0JRV-"�¼�S2�/1?G=.<V}MwIe-:<V-.M6R>2�<FK �6KP0*QR>I*2�3F24M6=.0e}��N-4? K`3�0*=.R���}SK`3F=.<V}J2�<V�*Y��*_*R o - � o ��� � r ) k )� ) n � '

���#� ������y��� ��� � ��)GI*2t3O24M6=.0e} �N-"?�-:<OKN3O243�Cp<>=.9 -v}J2�2�~§KX0JR>2�<>~J�N-"/��e2�RO?G2�2�0�R>I*2�2�~JK`3FR>2�9 =:�P=.Q:KNM�-"��9-.M6<>=13OR6-:R>2��*),+ - +PY�R>I*2Uu-D<OKN-:�J�P243G�fKP�.2i~*<>243>3O_*<w2.Y*U.=:�P_*9 2.Y*9-:Q.0*2�ROK �4-:ROKP=.0�RwIe-:R(-:0�26��~,2�<OKP9 2�0JR>2�<�9�24-.3O_*<>243(-D0e}?(IJKNM>I�R>I*2�<>26Cp=.<>2<>2�~*<>243F2�01Ri=._*<i�J0*=u?¨�X24}JQS2#-:�e=._*RiR>I*2�3O/*3OR>2�9���-:0e}dR>I*2=.0JR>=:�P=.Q:KNM�-"�(9iKNM6<>=13FRV-:R>2��LR>I*2�M6=J=.<V}SKP0e-:Rw243 -:0e}9 =.9�2�01RV-�=:CBKP0e}SKXUSKN}J_e-"�¨-DR>=.9!3�Y�?(IJKNM>It}J2�R>2�<>9�KX0*2�?(Ie-:R(R>I*2 3O/*3OR>2�9 ?GKf���BKP0�C�-.M6R¤}J=��V'�ª�=.<(26�e-:9 ~J�P2.Y,KP026KPR>I*2�<�-iI*24-:R(2�0*Q:KP0*2i=.<�-�9�_e3wMw�X2�R>I*2�QS=1-"�^KN3(R>=i<>24M�-D~*R>_*<>2�2�0*2�<wQ./!RwIe-:RGKN3�3F~*<>24-.}KP0�-:0�_*0*�10*=:?(0�-:0e}_*0eM6=.0JR><>=:�f�P24}i?(-"/�=:U.2�<y9!-:0J/�9iKNM6<>=J3>M6=.~JKNM(}J2�Q.<>2�243�=:C*Cp<>2�24}J=.9 =:C^R>I*2(3O=._*<VM62(<w243O2�<>U.=:KP<4Y.-D0e}�M6=S0eM62�01R><6-:R>2KPR��e-SM>��KP01R>=- 3LKP0*Q:�P2 }J2�Q.<>2�2�=DC¼Cp<>2�24}J=.9#Y�R>I*2�9 =.ROKP=.0�=DC�-i~JKN3ORw=.0#=.<�R>2�0e}J=.0z'G)GI*2�9 =.<>2bKPRbIe-.3(3O~*<w24-.}^YR>I*2�9 =S<>2�}SK �M6_J�PRbKXR�?GKf���B�e2�R>= }J=!RwIJK`3�'

Page 19: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¶4³ ¶4³

)¨I*2 �e-.3LKNM�<>24-.3O=.0 CE=.<�R>I*2 ��3F24M6=.0e}��N-"?�����KP9iKPRV-DROKP=.0v=.0t2��MwKP2�0eM6/dKN3�RwIe-:R�R>I*22�0*Q:KP0*2!9i_e3OR�?x=S<>�<>2�~*<>=*}J_eMwKP�J�P/ � -:0§2�0*Q:KP0*2tR>Ie-:R�}J26�fKPU.2�<>24}�?G=.<>�v=S0J�X/§=�M�M�-S3LKP=.0e-"�f�P/.Y��1/�MwIe-:0eM62���?(I*2�0*2�US2�<�R>I*2�KX0JKPROKN-"�9iKNM6<>=13FRV-:R>2G=:Ce<>243F2�<>U.=:KP<V3B-:0e}�2�0*Q:KP0*2bIe-:~*~e2�0*24}�R>=��e2 �O_e3ORB<OKPQ.IJR��^?G=._J�N}i�e2G_*0e-.M�M62�~*RV-D�J�X2�KP0 2�0*Q:KP0*2�2�<OKP0*Q-:0e}�JKP=:�P=.Q./#-u��KP�.2.'

)¨I*2 KP0JKPROKN-"��9iKNM6<>=J3ORV-:R>2�K`3�_*0*�10*=:?(0��e24M�-:_e3F2KXR�KN3i0*=.R��e26KP0*Q8M6=.0JR><>=D���P24}��J/8-:0J/�=:C�R>I*2�KP9 ~e=13F24}9!-.M6<w=13>M6=.~JKNM�M6=.0e}SKPROKP=.0e3�'G)GI*2¢KX0JKPROKN-"�B9iKNM6<>=13FRV-:R>2b9iKPQ.IJR(�e2i-:01/J?(I*2�<>2bKP0�3O=.9 2b�N-:<>QS2�~*Ie-.3O2�U.=:�P_*9 2�� %M6=.9 ~e-DROKP�J�X2?GKPR>ItRwI*2iKP0JKXRFK`-u�¨9-.M6<>=13OR6-:R>2 � % �y-:0e}�R>I*2�2�0*Q:KP0*2!9i_e3ORi3OROKf�f�x?G=.<>�^'i��R¢K`3¢R>I*2�08\,KP=._*USKf�f�X2.� 3R>I*2�=.<w2�9 R>Ie-:R�~J�N-.M6243�R>I*2��fKP9iKPRV-:ROKP=.0�=.0�?(Ie-:R#M�-D0 �e28}J=S0*2��i~*I1/*3LKNM�-"���N-"?�}J=J243�0*=.R�~,2�<>9iKPR�_e3�R>=M6=.0eM62�0JR><V-:Rw2�R>I*2b{e0e-"�z9iKNM6<>=13OR6-:R>243�KP0JR>=!-i3O9!-"�f�P2�<b~*Ie-.3O2�U.=:�P_*9 2�R>Ie-:0�� %B-:0e}R>I*2�<w26CE=.<w2�?x2�M�-D0*0*=.R(Q.=<>2�~*<>=*}J_eMwKP�J�P/�Rw=�-:0J/b{e0e-"��9-.M6<>=13OR6-:R>2 ���(?(I*=J3O2]~*Ie-.3F2]U.=:�P_*9 2����GKN3¼3F9!-"�f�P2�<BR>Ie-:0�� % '¼)GI*2�KX0*24�S_e-"�fKPRO/� % � ���bK`3�-�0*24M6243w3>-:<>/!M6=S0e}SKXRFKX=S0�Cp=.<(-:01/i9!-SM6<>=13>M6=.~JKNMb~*<>=*M6243>3 � %� ���R>=i�e2�<>2�~*<w=�}J_eMwKP�J�P2�Cp=.<(-"�f�KP0JKPROKN-"�H9�K`M6<w=13ORV-:Rw243�KP0�� %O'

cGCxM6=S_*<V3O2.Ye3O=S9 2�R>IJKP0*Q!9-4/Ie-:~*~,2�0 �J/#MwIe-:0eM62�R>Ie-DRGKN3(0*=.Rb<>2�~*<>=*}J_eMwKP�J�P2.'(g�3�- Mw�P=13F2�-D0e-"�P=.Q./.Y*?G2M�-:0�~*_*9 ~�R>I*2�?(-:R>2�<¨CE<>=S9 - R6-:0*�!=DC]U.=:�P_*9 2�� KX0JR>=�-i�N-:<wQ.2�<�R6-:0*�!=DC]U.=:�P_*9 2�� �� � Y,�*_*R�0*=SR(KP0JR>=- 3O9-"�f�X2�<b=.0*2�=:CHUS=:�P_*9 2�������� '])GI*2�<>26Cp=.<>2i-:01/~e-:<>RFK`M6_J�N-:<bRV-:QSQ.24}?(-:R>2�<G9 =:�P24M6_J�P2iKP0#=.0*2�RV-:0*��M�-:0�e2�9�=uUS24}t<>2�~*<w=�}J_eMwKP�J�P/�KP01R>=t-%�N-:<>Q.2�<iRV-D0*�t�*_*R 0*=.R¢KX0JR>=8-�3O9-"�f�X2�<�=.0*2��]RwI*2!~*<>=S�e-:�JKf��KPRO/v=:C�3O_eM�M6243>3?G=._J�N} �,2�3O=.9 2�RwIJKX0*Q���KP�.2���� ��� ']��2�<>2�RwI*2�RV-D0*��3GM6=.<><w243O~e=.0e}�R>=iR>I*2b9!-.M6<>=J3ORV-:R>243 ��YJR>I*26KP<(U.=:�P_*9 243��M6=.<><w243O~e=.0e}�R>=�~*Ie-.3O2bU.=:�P_*9 243�� YJR>I*2bRV-:QSQ.24}i9 =:�P24M6_J�P2�<w2�~*<>243O2�0JRV3BR>I*2b_*0*�J0*=u?�0!R><w_*2�9iKNM6<>=J3ORV-:R>2.YJ-:0e}R>I*2bC�-.M6R(R>Ie-DRxRwI*2�?(-:R>2�<��e=:?�KN3�KP0eM6=.9 ~*<>243w3LKP�J�X2M6=.<><>243O~,=.0e}*3GR>=\,KP=._*U.Kf�f�P2.��3�RwI*2�=.<>2�9#'

��=:? ?G2 �10*=:?�R>Ie-:RbKP0 Mw�N-.3w3LKNM�-"�(R>I*2�<>9 =*}J/10e-D9iKNM�3�YB-.3�?(-.3�{e<V3FR�0*=.R>24} �1/t��=:�PR���9!-:0*0zYyR>I*2�R>I*2�<>�9 =*}J/10e-D9iKNM2�01R><w=.~1/d=:C�-:0824�S_JKf�fKX�*<FKX_,9 9!-.M6<>=J3ORV-:R>2 � KN3�QDKXUS2�0vR>=�?GKPR>IJKP0�-:0 -S}*}SKXRFKXUS2 M6=.0e3OR6-:01R��1/�]��� � � ���P=.Q�� ��� �VYJ?(I*2�<w2 ��K`3b��=:�PR���9!-:0*0z� 3(M6=.0e3ORV-D01R4'B)GIJKN3G<w26�`-DROKP=.0#?(-.3�R>I*2�0#3ORw<>243>3O24}�J/�@H�N-:0eM>�-:0e}t&HKP0e3OR>26KP0zYy?(I*=�9!-.}J2�KP9 ~e=S<>RV-:0JR�_e3O2 =:C�KPR�KP0tR>I*26KP<�<w243O24-:<VMwIz'���_*R�R>I*2 -:�e=:U.2 -:<>QS_*9 2�01R63b9!-:�.2�KPRMw�P24-:<GR>Ie-:R�R>I*2�<>2(?(-.3�0*=�0*2�24}�R>=�<>243OR><OKNM6R�R>IJKN3]Rw=�24�S_JK��fKP�*<OKP_*9 9!-.M6<w=13ORV-:Rw243 � 'ygb01/ 9-.M6<>=13OR6-:R>2���24�S_JKP��fKP�*<OKP_*9 =S<¼0*=.0*24�S_JKf�fKX�*<FKX_,9���Ie-.3B-:0�2�0JR><>=S~1/ �]� � � � ���X=SQ�� � � �VY"?(I*2�<>2�� � � �eKN3yR>I*2G~*Ie-.3O2�U.=:�P_*9 2M6=.9 ~e-DROKP�J�X2�?¨KXRwI8R>I*2M6=.01Rw<>=:�f�P24}�=.<�=.�e3F2�<>U.24}�9!-SM6<>=:Uu-:<OKN-:�J�P243 � % ��~*<>243>3F_*<>2.YyU.=:�P_*9 2.Yy9!-:Q.0*2�RFK �4-DROKP=.0zYI*24-:R �e_J�zY*26�P24M6R><OKNMiM6_*<><>2�0JR4Y�- npr 'X�¤RwIe-:R(}J26{e0*2 ��'])GI*2�0 -�Q.2�0*2�<V-"�fKN3O24}�3O24M6=.0e}��N-"?

���pKP0JKXRFK`-u��� � �]�û{e0e-"�p� �W¦.ºJ�Cp=:�f�X=:?�3�KP9 9�24}SK`-DR>26�P/�Cp<>=.9 \,KP=._*USKf���P2.��3 R>I*2�=.<>2�9#Yb-.3-t0*24M6243>3w-:<>/ M6=S0e}SKXRFKX=S0�CE=S<�R>I*2tM>Ie-:0*QS2#=:C 3ORV-:R>2� %� ���R>=i�,2�<>2�~*<>=*}J_eMwKP�J�P2.'

Z.R6-:R>24}�9 =S<>2!M�-:<>26Cp_J�f�P/.YB?G2 9 24-:0 �m<>2�~*<>=*}J_eMwKX�J�P2��J/t-:0826�*~e2�<FKX9�2�01R>2�<i?(I*=�M�-:08M6=.0JR><>=D�]=.0J�P/tR>I*29!-.M6<w=uU:-:<OKN-:�J�P243�� � %��bR>Ie-:Rx}J26{e0*2�RwI*2(9!-.M6<>=J3ORV-:R>243 ���*'yg��fKPR>RO�P2�R>I*=._*QSI1R�9!-:�.243HKXR(Mw�P24-:<GR>Ie-:R�R>IJKN3�~*<>=.�USK`3F=�?(-.3�0*2�24}J24}#-"�P<>24-S}J/iKP0�R>I*2¤Mw�N-.3w3LKNM�-"�z24�._JKf�fKP�*<OKP_e9�R>I*2�=.<>/.YSKP0�=.<V}J2�<GR>=�Ie-4US2¤-:0�-"KP<O�1RFKXQSI1RG3ORV-:R>2�9�2�01R=:C]R>I*2 3O24M6=S0e}��N-"? ?(IJKNMwI M6=S_J�`} 0*=.R��,2 USKX=D�`-DR>24}��1/�-!Mw�P2�U.2�<�26�*~e2�<OKP9 2�0JR>2�<4'iª*=S<(KfC¨a�<4'bg }J26{e0*243¢IJK`3R>I*2�<>9�=�}J/J0e-:9iKNM(3OR6-:R>243y�J/�RwI*2�9-.M6<>=:Uu-:<FK`-D�J�X243�� � � � � �����(R>Ie-:RBI*2GKN3]M6=S01R><w=:�f��KP0*Q -:0e} %4=S<B=.�e3O2�<>USKP0*QeYIJKN3b2�01Rw<>=.~J/ ���KN3�-�CE_*0eM6ROKP=.0�=:C]RwI*=13O2 dUu-D<OKN-:�J�P243�'b�pCx0*=:? a�<4'��bY,_*0*�10*=:?(0�R>=�a�<4'�g�Y,9!-:0JKP~*_J�N-:R>243-�0*2�? 9!-.M6<>=:Uu-D<OKN-:�J�P2 ��� � =._*RV3WK`}J2�RwI*2�3O2�R�R>Ie-:Ria#<"'#g KN3iM6=.0JR><>=:�f�fKP0*Qt=.<�=.�e3O2�<>USKP0*QeYBI*2�M�-:08�*<FKX0*Q-:�,=._*R4Y^<>2�~*<>=*}J_eMwKP�J�P/.YH-�MwIe-:0*Q.2�=:C¨3FRV-:R>2¢CE=.<b?(IJKNMwI ���#}J24M6<w24-.3O243�3F~e=.0JRV-:0*2�=._e3W�X/.Yz-u�XRwI*=._*Q.I ��� � }J=J2430*=.R4'b)GIJ_e3(I*2i?GKf�f�x-:~*~e24-D<�R>=�a�<4'�g -.3b- 9!-DQ:KNMwK`-D0 ?�I*=�M�-:0�~*<>=*}J_eM62 3O~e=S01RV-D0*2�=._e3bU.KP=:�N-:RFKX=S0e3b=:C]R>I*23O24M6=.0e}��N-4?�Y�-DR(?GKf�f�û'

��_*RB0*=:?�?G2G9i_e3ORyC�-.M62(-:0!-:9i�JKPQ._JKPRO/�KP0!RwI*2¨}J26{e0JKPROKP=.0#-D0e}�9�24-:0JKP0*Q�=:C!� �SKPR]-:~*~e24-D<V3BR>=�Ie-"U.2(}SKfCp�Cp2�<>2�01RG-.3O~,24M6RV3�'])GI*2b~*Ie-.3O2bU.=:�P_*9 2"� ��� � � �������HM6=S0e3LKN3OR>2�0JRx?¨KXRwI�-¢Q:KPU.2�0�3F2�Rx=DC�26�*R>2�0e3LKPU.2b9!-.M6<w=uU:-:<OKP�-:�J�P243#� � � � �����$��KN3b-�}J26{e0JKPR>2.YzM�-u�`M6_J�N-:�J�P2 �S_e-:01RFKXRO/?(IJKNM>I�<>2�~*<>243O2�0JRV3G=S0�R>I*2�=.0*2�Ie-:0e}%R>I*2�}J2�Q.<>2�2�=:CM6=.0JR><>=:�e=DC�-:0 26�*~e2�<FKX9�2�01R>2�<G=:U.2�<�R>I*2(9iKNM6<>=13FRV-:R>2.Y:?(I*2�0I*2�M�-:0�9!-:0JKP~*_J�N-:R>2�=.0J�P/iR>I*=13O2�9!-.M6<>=:Uu-D<OKN-:�J�P243�R>IJ_e3�� -:~*~e24-D<V3�=.01Rw=:�P=.Q:KNM�-"��'�c(0�R>I*2�=SR>I*2�<]Ie-:0e}^Y%�»<w2�~*<>243O2�0JRV3�24�._e-"�f�P/?x26�f�z=._*<(}J2�Q.<>2�2b=:C^KPQ.0*=.<V-D0eM62-:�,=._*R¼RwI*2x9�K`M6<w=13ORV-:Rw2]?(I*2�0i?G2]�J0*=:?8=.0J�P/iR>I*=13F2]9!-.M6<w=uU:-:<OKN-:�J�P243B-:0e}�0*=.R>IJKP0*Q�26�N3O2��J-:0e}�R>I1_e3�KPR]-:~*~e24-D<V32�~JKN3OR>2�9 =D�X=SQ:KNM�-"��'���_*Ri-.3�Kf���P_e3ORw<V-:R>24}d�1/�R>I*2!3>M62�0e-D<OKP=#=:C(a#<"'ig -D0e}ta�<4'�� -D�e=:U.2.Y,KPR�KN3i-9!-:R>Rw2�<�=:C

Page 20: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦.· ¦.·

Cp<>2�2�MwI*=:KNM62=.08=S_*<�~e-:<>R�?(IJKNM>Iv3O2�Ri=:C(9!-.M6<w=uU:-:<OKN-:�J�P243�?G2!3OIe-"�f�(_e3O2R>= }J26{e0*2=._*<i9!-.M6<>=J3ORV-:R>243 �zR>IJ_e3KPR�-:~*~,24-:<V3�-"�N3O=#-D01R>I*<w=.~e=.9�=.<>~*IJKNM 0 ª[KP0e-"�f�X/.Yy?G2iIe-"U.2i�e2�2�0tU:-:Q._*2!-:�,=._*R �O_e3OR�I*=:? 9!-:0J/#9iKNM6<>=13wM6=.~JKNM}J2�Q.<>2�243�=:CzCp<>2�24}J=.9 -:<>2�Rw=��,2�KP0eMw�P_e}J24}�KP0���'])GI*2�0�?(Ie-:RGKN3�R>I*2�9 24-:0JKP0*Q=:CHRwI*2�3O24M6=.0e}�N-"? �W¦SºJ�>±!�O3KPR�-:0#=S01R>=D�X=SQ:KNM�-"�¼�N-"? =:C]~*IJ/�3WK`M�3�Y¼-:0�2�~JK`3FR>2�9 =:�P=.Q:KNM�-"�GI1_*9-:0#~*<>24}SKNM6ROKP=.0zY[=.<�-:0t-:01RwI*<>=.~e=S9 =.<>~*IJKNMi-:<>RCp=.<>9�±

@B-D<>RG=:CHRwI*2�-:0e3O?G2�<GKN3GR>Ie-:Rb&]�,'^�W¦.ºJ�]M�-:0*0*=SR(�e2i-:0�=.0JR>=:�P=.Q:KNM�-"�¼3ORV-DR>2�9 2�0JR���R>Ie-:R�KN3�Ye-�}J24}J_eM6ROKPU.26�P/~*<>=:U.24}�M6=.0e3O24�S_*2�0eM62#=:CbR>I*2�N-4?b3�=DC¤~*IJ/�3WK`M�3m���e24M�-:_e3F2�R>I*2�9 2�<>2#M�-"�NM6_J�N-:ROKP=.0§=:C � 9!-:�.243�0*=�_e3O2�=:CR>I*2�24�._e-:RFKX=S0e3(=:C]9�=.ROKP=.0zY,?(IJKNM>It-"�P=.0*2i}J2�R>2�<>9iKP0*2i?(IJKNM>I�9!-SM6<>=13ORV-DR>2�?¨K��f�BKP0�Cû-SM6R(2�U.=:�PU.2�Cp<>=.9 -iQDKXUS2�09iKNM6<>=13FRV-:R>2iKP0�� %O'��Ri9!-"/#�,2!RwIe-:R4Yy�e24M�-:_e3F2!=:C(~*<>=S~e2�<>ROKP243�=:C(R>I*2 24�S_e-:ROKP=.0e3�=:C(9 =SROKP=.0tR>Ie-:R�?G2!}SKN}0*=.R�_e3O2.YJ=._*<G26��~,2�<OKP9 2�01Rw2�<4��3�9 2�R>I*=*} =DC¼<>24-"�fK �6KP0*Q R>I*2b9!-.M6<>=13FRV-:R>2 � %[?x=S_J�`}�0*=.R4YDKP0�9!-:0J/�<w2�~e2�ROKPROKP=.0e3�Y~*<>=*}J_eM62¤-u���^9iKNM6<>=13OR6-:R>243yKP0 RwI*2�U.=D�X_*9�2�� %OY.=S0J�X/-�0*2�Q:�fKPQ:KP�J�P/#3O9!-"�f�|3O_*�e3O2�RG=:C^R>I*2�9 =�M�M6_*~J/SKX0*Q -¢~*Ie-.3O2U.=:�P_*9 2�� �� � � %O'()¨I*2�0 RwI*2�~*<>=*M6243>3 � % � � � 9�KXQSI1R�3OROKf�f�H�,2i~e=13>3WKX�J�P2 <w2�~*<>=�}J_eMwKP�J�P/�2�U.2�0#RwI*=._*Q.I� % �!�1YJKfC � � � �!�J'G;]=.0JU.2�<V3O26�P/.Y*�,24M�-:_e3O2�=:CH3O~,24MwK`-u��MwKP<VM6_*9!3FRV-:0eM6243b3O_eM>I#-S3]_*0J_e3O_e-"�BM6=.0e3ORV-:0JRV3�=:CBR>I*29 =.RFKX=S0zY1RwI*2�~*<>=�M6243w3 � %� ���9iKPQ.IJRG~*<>=:U.2bR>=i�e2bKP9 ~e=J3>3LKP�J�P2�2�US2�0�R>I*=._*Q.I � % � �!�*'B)GI*2�3O24M6=.0e}��N-"?M�-:0*0*=.R��e2�~*<w=uUS24}�1/�}J24}J_eM6ROKPU.2�<w24-.3O=.0JKP0*Q�CE<>=S9 RwI*2�KP0JCE=S<>9!-:ROKP=.0�RwIe-:RG?x2�-SM6R>_e-"�f�P/�Ie-4US2.'

c(0�R>I*2B=.R>I*2�<[Ie-:0e}^YJ�W¦.ºJ�JKN3y-"�P?¨-"/*3,2�~JK`3FR>2�9 =:�P=.Q:KNM�-"�e�,24M�-:_e3O2�KXR[KN3z-"�P?(-"/�3^Rw<>_*2BR>Ie-:R � � � �e9 24-.3F_*<>243=._*< }J2�Q.<>2�2=:C(KPQ.0*=S<V-:0eM62�-:�e=._*RiR>I*29iKNM6<>=13FRV-:R>2?(I*2�0�?x2�J0*=u?�=.0J�P/8RwI*2!9!-SM6<>=13ORV-DR>2 ��' )GIJ_e3�R>I*2=.<OKPQ:KP0e-"��3F24M6=.0e}§�N-"?�-:0e}§=._*<�Q.2�0*2�<V-"�fKN3>-:RFKX=S0 �W¦.ºJ��=:C�KPR�Ie-"U.2�R>I*2t3>-:9 2��P=.Q:KNM�-"��3FRV-:R>_e3-.3��G-"/.243LKN-:0KP0JCE2�<w2�0eM62��*R>I*2�/i<>2�~*<>243O2�0JR]RwI*2(�e243OR�~*<>24}SKNM6ROKP=.0e3G?G2�M�-:0�9!-:�.2�Cp<>=.9 R>I*2�KP0JCE=.<w9!-:ROKP=.0 ?G2GIe-"U.2.'y��0�Cû-SM6R4Y.-<>26{e0*24}�CE=.<w9 =DCx�W¦SºJ�HM�-:0��,2�}J2�<OKPU.24}�-.3G-:0�26�e-:9 ~J�P2�=:CB�x-"/.243WK`-D0KX0JCp2�<>2�0eM62.'()GI*2�<w26CE=.<w2�R>I*2�3O24M6=.0e}��N-"??G=.<>�*3GCp_*0eM6ROKP=.0e-"�f�P/��fKP�.2�-:01/�=.R>I*2�<��G-"/.243LKN-:0�KP0JCE2�<w2�0eM62��BR>I*2i~*<>24}SKNM6ROKP=.0e3i-:<>2i_e3O_e-"�f�P/t<OKPQ.IJR4Y,KP0e}SKNM�-:ROKP0*QR>Ie-:R�R>I*2bKP0JCE=.<w9!-:ROKP=.0�_e3O24}�?(-.3G-.}J24�S_e-:R>2¢CE=.<�R>I*2�~*_*<>~e=J3O2.'(c(0J�P/�?(I*2�0#R>I*2�~*<w24}SK`M6RFKX=S0e3�-:<>2�?(<>=S0*Q!}J=?G2b�P24-:<>0#0*2�? R>IJKP0*Q13�-D�e=._*R(RwI*2�=.01Rw=:�P=.Q:KNM�-"�z�N-"?�3G=:Cy~*I1/*3LKNM�3��O3O_eM>I�-.3�0*2�? M6=S0e3ORV-:0JRV3�=:CBR>I*2�9 =.ROKP=.0^�6'

�LRiKN3 QS<>24-:RO�P/tR>=d=._*<!-.}JU:-:01R6-:Q.2R>=t<>24M6=.QS0JK ��2�R>IJKN3�'���/�Q.2�R>ROKP0*Qt=._*<��X=SQ:KNM#3OR><6-"KPQ.I1Ri?G2�0*=.Ri=.0J�P/-"U.=:KN}�R>I*2�a%KP0e}t@�<>=��O24M6ROKP=.0 ª,-"�f�N-.M6/�=:CxMw�N-"KP9iKP0*Q#9 =.<w2�RwIe-:0#Ie-.3b�,2�2�0t~*<>=:U.24}^Y,?G2�QJ-"KP0 -D0�KP9 ~e=S<>RV-:0JRR>24MwI*0JKNM�-"� �e26�JKP�JK��fKPRO/�KP0t_e3LKP0*Q#RwI*2�3F24M6=.0e}��N-"?�'��L0e3OR>24-.}�=:C(M6=.9 9iKPR>RFKX0*Q�RwI*2�2�<w<>=.<�=:C(3O_*~*~e=13WKX0*Q�R>Ie-:R�-Q:KPU.2�0�~*IJ/�3WK`M�-u�H3O/*3OR>2�9 Ie-.3�=.0*2�-:0e}=.0J�P/=.0*2!�6R><w_*24��=.0JR>=:�P=.Q:KNM�-"�z2�0JR><>=.~J/.YJ?G2�<>24M6=SQ.0JK ��2�R>Ie-:RG?G2�M6=._J�N}Ie-"U.2�9-:01/#}SKf�z2�<>2�0JR�3ORV-:Rw243(=:C]�J0*=:?G�P24}JQ.2 -:�e=S_*RbKXR"Y,�X24-S}SKX0*Q�R>=9!-:0J/#}SK��z2�<>2�0JR�2�0JR><>=.~JKP243b<>26Cp2�<><OKP0*Q�R>=R>I*2 3>-:9�2�~*IJ/�3LKNM�-"�(3O/*3OR>2�9 �W-.3¨KX0dR>I*2 3>M62�0e-:<OKP=�=:Cxa�<4'�g -:0e}�a�<4'��A-:�,=:U.2:�VY,?(IJKNM>I8M�-D0 3F2�<>U.2�9-:01/}SKf�z2�<>2�01R�~*_*<>~e=13F243�'

+D_e3OR -.3�R>I*2Mw�`-S3>3�=:C(~*I*2�0*=.9 2�0e-�R>Ie-DR�-:0t26�*~e2�<FKX9�2�01R>2�<M�-:0t2�U.=.�S2iCE<w=.9 -%Q:KPU.2�0 3F/�3ORw2�9 KP0vR>I*2�N-:�e=S<V-:R>=.<w/¤}J2�~,2�0e}*3y=.0�R>I*2��.KP0e}�=:Ce-:~*~e-:<V-DR>_e3^I*2GIe-.3y��?�IJK`MwIi=:CJKXR63z9!-SM6<>=:Uu-:<OKN-:�J�P243[I*2(M�-:0�9!-:0JKP~*_J�N-:R>2:�VY3O=�R>I*2 Mw�N-.3>3¢=:C]~*I*2�0*=.9 2�0e-%R>Ie-:R�?G2 M�-:0�~*<>24}SKNM6R�?GKPR>IdR>I*2�<>9 =*}J/10e-D9iKNM�3bCp=.<¤-QDKXUS2�083O/*3OR>2�9 }J2�~e2�0e}*3=.0�R>I*2��.KP0e}�=:CB�10*=:?G�P24}JQ.2�?G2�Ie-4US2�-:�e=._*R¨KXR"'x)GIJKN3¨KN3(0*=.Rb-i~e-:<V-.}J="�zY*�*_*R�-�~J�N-:ROKPR>_e}J2���KX0e}J2�24}^Y,KP0�-:01/3>MwKP2�0JROKf{|M��._*243ORFKX=S0zYz?(Ie-:R�?G2�M�-D0t~*<>24}SKNM6R }J2�~e2�0e}*3�YB=S�1USKP=._e3L�P/.Yy=.0t?(Ie-:RbKP0JCp=.<>9!-DROKP=.0t?G2 Ie-"U.2.'i�pC(?G2C�-"Kf�HR>=3O~e24MwKfCp/ ?�Ie-:R(�JKP=:�P=.Q:KNM�-"�BKP0JCp=.<>9!-:RFKX=S0#?G2�~*<>=S~e=13O2�R>= RV-D�.2bKP01R>=�-.M�M6=._*0JR4Y,R>I*2�0#RwI*2�<>9 =*}J/10e-:9�K`M�39!-"/ 0*=.R��e2�-D�J�X2�R>= Q:KPU.2�_e3�-:01/_e3O26Cp_J��-D0e3O?G2�<x�,24M�-:_e3O2�?x2�Ie-"U.2�0*=SR�-.3O�.24}�-D01/?G26���y~e=13O24}��._*243FROKP=.0z'

&�U.2�0?(I*2�0 KPR�}J=J243�0*=.R��P24-.} Rw=�}SKf�z2�<>2�0JR�{e0e-"�z<>243O_J�PRV3�YJRV-:�SKP0*Qi~*<OKP=.<�KX0JCp=.<>9-:ROKP=.0�KX0JR>= -.M�M6=._*0JR(M�-:0-"�z24M6R�M6=.9�~*_*RV-:ROKP=.0e-"�y2��MwKP2�0eM6/�KP0t-:~*~J�P/.KP0*Q�R>I*2i3O24M6=.0e}�N-"?�Y*�,24M�-:_e3O2�KPR¤M�-D0#I*26�P~�_e3(R>=�9!-:�.2�-i9�=.<>2~e-:<V3WKX9�=.0JKP=._e3�MwI*=:KNM62�=DCHR>I*2�9�K`M6<w=uU:-:<OKN-:�J�P243bR>Ie-:R�?x2�3FIe-"�f�zKP0eMw�X_e}J2�KX0 � '�ª*=.<GKPRbR>=i�e2�Q.2�0*2�<V-"�f�P/#U:-"�fK`}^YR>I*22�01Rw<>=.~J/#KP0��W¦SºJ��9i_e3OR��e2.YyKP0v~*<OKP0eMwKP~J�P2.Y(R>I*2R>=.RV-u�]2�01R><w=.~1/�=:C�-"�f��3F/�3ORw2�9!3�R>Ie-DR�RV-:�S2!~e-:<wR�KP0vR>I*2~*<>=*M6243>3�'b�]_*RbR>IJKN3b}J=1243b0*=.R"YJKP0 ~*<6-.M6ROKNM62.Yz}J2�R>2�<>9iKP0*2i26�e-.M6RO�P/�I*=:?A9i_eMwI#=:CBR>I*2i=._*RV3LKN}J2�?x=S<O�N}KN3bR>= �,2KP0eMw�P_e}J24}^'G��0 -�3O2�0e3O2�2�U.2�<>/JR>IJKP0*Q�KX0�RwI*2�_*0JKPU.2�<V3O2bKN3¨KP0 M6=.0e3OR6-:01R�KP0JR>2�<V-.M6ROKP=.0�?¨KXRwI#2�U.2�<>/JR>IJKP0*Q 26�N3O2.Y^-:0e}=.0*2b9i_e3OR(}J24MwK`}J2�?(I*2�0�R>=i3OR>=.~�KP0eMw�X_e}SKP0*Q�R>IJKP0*Q13�'B��0eMw�P_e}SKP0*Q�9 =.<>2bR>Ie-:0?G2�0*2�24}�KN3�0*=.RGIe-:<>9�CE_J�^KP0�R>I*23O2�0e3O2�=:Cy�X24-S}SKX0*Q�Rw= 2�<><>=.<63�Y*3LKP0eM62�RwIJK`3�=.0J�P/#-.}*}*3GRwI*2�3>-:9�2��._e-:0JROKPRO/!Rw= �e=.RwI 3LKN}J243�=:Cx�O¦.ºJ�V']��_*RGKPR�M�-:0M6=13OR�_e3G?(-.3OR>24}26�z=.<>R�KP0 M�-u�`M6_J�N-:RFKX0*Q_*0*0*24M6243>3>-D<>/#}J2�RV-"Kf�N3bR>Ie-:R(M�-:0eM626�¼=S_*R(=:CB=._*<G{e0e-"�¼<w243O_J�PRV3�'

g�R!R>IJKN3~,=:KP01R�R>I*2 -"Cp=.<>2�9�2�01ROKP=.0*24} �e26�JKP�JK��fKPRO/ =:Ci=._*<!9�2�R>I*=�}*3�,24M6=.9 243�KP9 ~,=.<>RV-:0JR4' 7d2#Ie-"U.2-"�P<>24-.}J/�9!-.}J2i_e3O2i=:CBKPRbKP0�R>I*2 }SK`3wM6_e3>3LKP=.0dCE=:�f�P=:?GKP0*Q#&]�,'z�O¦.«J� �,0*=:?A?G2i?(-:01R�R>=�-D~*~J�X/�R>Ie-DR�<>24-S3O=.0JKP0*Q

Page 21: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦*¶ ¦*¶

R>=i~*Ie-.3O2�U.=:�P_*9 243(-D0e}�R>=iQ.2�0*2�<V-u�¼~*<>=*M6243>3O243�'B�L0 -¢C�-.3OR(~*<>=*M6243>3�Y�R>Ie-:RGIe-:~*~e2�0e3¨KP0 -iRFKX9�2�3O=!3OI*=.<wR(R>Ie-:RR>I*2�<>9-"�e24�._JKf�fKP�*<OKP_*9 =:C^R>I*2G?(I*=:�P2�3O/*3OR>2�9�KN3B0*2�US2�<]<>24-.MwI*24}^Y.=S0J�X/iR>I*2G~*Ie-.3F2(U.=:�P_*9 2G�e26�P=.0*QDKX0*QiR>=�RwI*=13O2}J2�Q.<>2�243b=DC¼Cp<>2�24}J=.9�-.M6Rw_e-"�f�X/%KP01U.=D�XUS24}�KP0�R>I*2¢KX0JR>2�<V-SM6ROKP=.0e3�M6=._J�N}��e2i<>26�P2�Uu-:0JR �^R>I*2 3O24M6=S0e}��N-"?�9!-"/!�,2-:~*~J�fKP24}%KX0�Rw2�<>9!3G=:CB\,KP=._*U.Kf�f�P2.��3bR>I*2�=.<w2�9 KP0#-i<>26�N-:ROKPU.26�P/#3O9!-u���¼3O_*�e3F~e-.M62�=:CyR>I*2bCE_J�f�¼=S0*2�R>Ie-:RG?G2�_e3O2bKP024�S_JK��fKP�*<OKP_*9�RwI*2�=.<>/.'B�L0#R>I*2�-:~*~J�fKNM�-:ROKP=.0�R>=�9�_e3wMw�X2�2��MwKP2�0eM6/.YeRwIJK`3�9 24-:0e3¨R>Ie-:R(?G2�0*2�24}#M�-u�`M6_J�N-:Rw2�=.0J�P/~*Ie-.3O2�US=:�P_*9 243�M6=S<><>243O~,=.0e}SKP0*Q!R>= }J2�Q.<w2�243G=:CyCE<>2�24}J=S9 R>Ie-:R(-:<>2�}SKP<>24M6RO�P/�KP0JU.=:�PU.24}�KX0�9i_e3>Mw�P2�=.~e2�<V-DROKP=.0 �=.0*243�R>Ie-:R!-D<>2 -"�z24M6R>24} =.0J�P/��N-:R>2�<4Y(-"CpR>2�< RwI*2#9i_e3>Mw�P2tM6=.01Rw<V-.M6ROKP=.0�KN3=:U.2�<4Y�9!-"/8�,2�<>26�P2�Uu-:0JRCE=S< R>I*2_J�PROKP9!-:R>2¢Cû-DR>2�=DCHR>I*2�I*24-:R(Q.2�0*2�<6-:R>24}^YJ�*_*R�RwI*2�/�M�-:0*0*=SR�-"�z24M6R�KXR63(2��MwKP2�0eM6/.'

)¨IJK`3GM6=.<w<>243O~e=S0e}*3GR>=�-¤Cû-D9iKf��KN-:<�~*<>=�M624}J_*<w2bKX0R><>24-DR>9 2�0JR]=:CH3F~JKX0�3O/*3OR>2�9!3�']Z.~JKP0J��3F~JKX0�<>26�N-"�e-:ROKP=.0�K`3=:CpR>2�0i=.<V}J2�<V3y=DCe9!-:Q.0JKPR>_e}J2GC�-.3ORw2�<¼R>Ie-D0�3F~JKX0J�S�`-DR>ROKNM62�<w26�`-u��-:RFKX=S0zY.3O=�=.0*2(M�-:0 M6=.0e3LKN}J2�<]RwI*2(9iKNM6<>=:Uu-:<FK`-D�J�X243=:CeR>I*2G3O~JKP0 3O/�3FR>2�9 -S3^Cp=.<>9iKP0*Q�-(0*24-D<O�P/�KN3O=:�N-:R>24}i}J/J0e-:9iKNM�-"�e3O/*3OR>2�9 KX0iR>I*26KP<B=:?(0�<OKPQ.I1R"Y4?GKPR>I -i�6~*<OKPUu-DR>24�3O24M6=.0e}��N-"? =:CyR>I*26KP<(=:?(0z'�Z:��KNMwI1Rw2�<��V¶"³.².·J�¼3OI*=:?�3�R>Ie-DRxRwIJK`3�-:~*~*<>=1-.MwI2�0e-:�J�P243(=.0*2�Rw=�~*<w24}SK`M6R�9!-.3>3O243�=:C}J2�RV-"Kf�N3bM6=.<><>24M6RO�P/.'

�L0�R>I*2�-:�e=:U.2b?G2�Ie-"U.2�3O_*~*~e=J3O24}R>I*2�Mw�`-S3>3LKNM�-"�¼24�S_JKP~e-:<>ROKPROKP=.0%�`-"? �J�*_*RG=._*<(-:<>QS_*9 2�01R63x3FI*=._J�N}0*2�24}9 =*}SKfCE/SKP0*Q�=.0J�P/§KfC�R>I*2�2�0*Q:KP0*2v��RwI*2 ~JKN3ORw=.0�=.<!Rw2�0e}J=.0^�iKP01R>2�<6-.M6RV3�}SKP<>24M6RO�P/�?GKPR>I }J2�Q.<>2�243%=:C�CE<w2�24}J=.9Cp=.<i?(IJKNM>I§24�._JKP~e-:<>RFKXRFKX=S0vC�-"Kf�`3�'8�L0vR>I*2#M�-.3O2�=DC�9i_e3>Mw�P243�YBKPR!-D~*~e24-:<V3�R>Ie-:RiR>I*2#}SKP<>24M6RiKP0JR>2�<V-.M6ROKP=.0e3�-:<>2?GKPR>IvM6=1=S<V}SKP0e-:R>243�=:C(�P=:?G�.Cp<>24�S_*2�0eM6/tU.KP�*<V-DROKP=.0v9 =*}J243�=DCx�N-:<wQ.2!~*<w=.R>26KP0v9 =:�P24M6_J�P243�'t��=u?�2�0*2�<>Q./tQS2�RV3R><V-D0e3LCE2�<w<>24}�CE<w=.9 -:0�26��MwKPR>24}�26�P24M6R><>=S0JK`M�3ORV-:Rw2�=:CHg])�@vR>=!3F_eM>I#-iUSKP�*<V-:ROKP=.0�9 =*}J2�?x=S_J�`}%<>2�9!-"KP0%KX0�R>I*2~*<>=:USKX0eM62�=:C]�._e-:0JR>_*9 RwI*2�=.<>/��1�*_*R�R>IJKN3�M�-:0��,2�USKP<>R>_e-"�f�P/8¶4·S·�� 2��MwKP2�01R4'

� �����#����x������#� ���b���¤����"� ���=u?�?G2�-:<w2 <>24-.}J/�Cp=.<i-#3O~,24MwK�{|M�M�-"�NM6_J�N-:ROKP=.0v=:C�9i_e3>Mw�P22��MwKP2�0eM6/v_e3LKP0*Q�R>I*2�-D�e=:U.2 ~*<OKP0eMwKP~J�P243�'v)GI*2~*Ie-.3O2�U.=:�P_*9 243"� R>Ie-:R(?G2iM�-"�NM6_J�`-DR>2 -:<>2.Y*=:CxM6=S_*<V3O2.Y�CE_*0eM6ROKP=.0e3�=:C]R>I*2�9!-.M6<>=:U:-:<OKN-:�J�P243(RwIe-:R�}J26{e0*2iR>I*29!-.M6<w=13ORV-:Rw243�'z�L0#R>I*2�M�-.3O2�=:C]-�9i_e3>Mw�P2.Y*?(Ie-:RGKN3GIe-D~*~e2�0JKP0*Q KN3 �W_e3FRxRwIe-:RG2�0*2�<>Q./ � KN3G�e26KP0*Q#-:�e3FR><V-.M6R>24}Cp<>=.9 R>I*2�3F=._*<VM62�<>243O2�<wU.=:KP<�-:0e}2�0*2�<>QS/ � � K`3b}J26�fKPU.2�<>24}�R>= R>I*2�3WKX0*�^Y*R>I*2�}SKf�z2�<>2�0eM62 -:~*~,24-:<OKP0*Q�-S3]?G=.<w�|'&B0*2�<wQ./tKN3iRwI*2!=.0J�P/v9!-SM6<>=:Uu-:<OKN-:�J�P2��,26KX0*Q�9!-:0JKP~*_J�N-:R>24}^Y(3F= =S_*<�~*Ie-S3O2�U.=:�P_*9 243i?¨K��f���e2Cp_*0eM6ROKP=.0e3i=:C3O=._*<6M62�-:0e}�3LKP0*��2�0*2�<>Q:KP243�'�7t2�0*2�24}�0*=SR¨M6=S0e3LKN}J2�<¤-i~*Ie-S3O2�U.=:�P_*9 2¢CE=.<GR>I*2�2�0*QDKX0*2.Y,�e24M�-D_e3O2�R>Ie-DR]KN3�R>I*23>-:9�2¨-DR¼R>I*2G�,2�Q:KP0*0JKX0*Q -:0e}�2�0e}��pKP0 M6/�Mw�fKNM�=.~e2�<V-DROKP=.0zY:R>I*2G2�0*Q:KP0*2GKN3B<>243FR>=.<>24}¢<>24-.}J/�Rw=�<>_*0 -:QJ-"KP0^�V'zg�3[KP0M6=.0JU.2�0JROKP=.0e-"�H3OR6-:ROKN3OROKNM�-"�¼9�24M>Ie-:0JKNM�3�Y,?G2�KP0JR><>=*}J_eM62�R>I*2i}J2�0e3LKPRW/Cp_*0eM6ROKP=.0e3��e� � �6Y1=DCER>2�0#M�-u���P24}�3OR><w_eM6R>_*<>2Cp_*0eM6ROKP=.0e3�Y*=:CB3O=._*<VM62�-:0e}3LKP0*���J/!M6=.0e3LKN}J2�<OKP0*QR>I*26KP<(2�0*2�<>Q:KP243��10*=:?(0R>= 3O=.9 2bR>=:�P2�<V-D0eM6243 � �!'y)GIJ_e3GR>I*2~*Ie-.3O2�U.=:�P_*9 243�Cp=.<�3F=._*<VM62�-:0e}�3LKP0*�#-:<w2

� ��� ��� � � � �W¦.¬ �*�

� � ��� � ��� � � � � � �W¦.¬ "�

)GI*2�0�R>I*2bKP0JKXRFK`-u��-:0e}�{e0e-"�¼~*Ie-.3F2�U.=:�P_*9 243b-:<>2� % ��� � � ��� � ��� � � � � � � � �W¦J® �*�

� � ��� ��� � � ��� � ��� � � � � � � � � � � �W¦J® "�

7§KPR>I � -D0e} � � }J26{e0JKPR>2��._e-D01ROKPROKP243�YJR>I*2bR>=:�P2�<V-D0eM6243 � � -:0e}�� � � -D<>2�RwI*2�3>-:9 2�-:RBR>I*2b�e2�QDKX0*0JKP0*Q�-:0e}2�0e}^Ye3O=�R>I*2�/�M�-D0eM626�¼=._*R(-:0e}R>I*26KP<(U:-"�P_*243�}J= 0*=SR(9!-:R>Rw2�<4'¼)GI*2�0*24M6243w3>-:<>/#M6=.0e}SKPROKP=.0�=:C¼<>2�~*<w=�}J_eMwKP�JKf�fKNRO/� % � � � ?(I*2�0�?x2�9-:0JKP~*_J�`-DR>2�=.0J�P/�2�0*2�<>QDKX243�0*=:? �e24M6=S9 243 s

� ��� ��� � ��� � � � � ��� � � ��� � ��� � � � � �,� �W¦.²J�

\^2�R�_e3¢R><>/�R>=�~*<>24}SKNM6R�R>I*2 9!-"�JKP9i_*9 ?x=S<>��=.�*RV-"KP0e-:�J�P2 �J/#_e3WKX0*Q�=.0J�P/�R>IJKN3�<>26�N-:ROKP=.0 ��?(IJKNM>I�9!-D�.243b0*=_e3O2(=DC�3O_eMwI 0*=.ROKP=.0e3�-.3yR>2�9 ~,2�<V-:R>_*<w2.Y:24�._e-:RFKX=S0 =:C�3FRV-:R>2.Y:I*24-:RGM�-:~e-.MwKPRO/.Y.=.<B<w2�U.2�<V3LKP�J�P2�=S~e2�<V-:RFKX=S0^�V'�¯(KPU.2�0

Page 22: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦.¦ ¦.¦

R>I*2�2�0*2�<>QS/ � 26�*R><V-.M6R>24}�Cp<>=.9 R>I*2�3F=._*<VM62.YJR>I*2�9-"�1KP9i_*9 ?G=.<>��?x2�M�-:0�Q.2�R�<>2�~*<>=*}J_eMwKX�J�P/%K`3 � � � � Y?(I*2�<>2bCp<>=.9 �W¦.²J�VY � � K`3�R>I*2�<>=J=.RG=:C

�P=.Q�� ��� � � �P=.Q � � ��� � � �v�P=.Q � ��� � � � � �P=.Q � � ��� � � � � � � �W¦.³J�

��=u? Uu-:<>/ � ��R>I*2��(�¢Z!=:CG�W¦.³J�B<>2�9-"KP0e3(M6=.0e3ORV-D01R4Y*-:0e} � � � � KN3�-�9!-"�JKX9i_*9 ?�I*2�0�� �

�X=SQ�� ��� � � � ��� � �

�P=.Q�� � ��� � � � � � � · �W«.·J�

)GI*2�<>26Cp=.<>2�RwI*2�9!-"�JKX9i_*9 2��MwKX2�0eM6/%KN3

� � � � � �� �W«*¶:�

?(I*2�<>2 � � � � -:<>2(RwI*2�3LKP9�_J�PRV-D0*2�=._e3G<>=J=.RV3�=:C]�W¦.³��H-:0e}%�W«.·J�6'¼��=.R>2bR>Ie-:RGR>IJKN3�K`3¨R>I*2��mQ:�P=.�e-"�N��2��MwKP2�0eM6/R>Ie-:RB?G2(0*2�24}�CE=.<�R>IJKN3]-:~*~J�fKNM�-:ROKP=.0zY�KX0�?(IJKNM>I?G2�M6=.0JR>2�9 ~J�N-:R>2(26�*R><V-SM6ROKP0*Q�-.3B9i_eMwI =:C|RwI*2(R>=.RV-u��-"Uu-uK��N-:�J�P22�0*2�<>Q./�� -.3�~e=13>3WKX�J�P2.Y[?(I*2�<>24-.3�R>I*2�¥b26�PUSKP0tCp=.<>9i_J�N-��O¦.¦J�BKN3bR>I*2i}SK��z2�<>2�0JROKN-"�]2��MwKP2�0eM6/.Y[I*=:�N}SKX0*Q�?�I*2�0R>I*2G-:9 =._*0JR¼=DC�2�0*2�<>QS/ � 26��Rw<V-.M6R>24}¤K`3B3F9!-"�f��M6=S9 ~e-:<>24}¢R>=(R>I*2GR>=.R6-"�.2�0*2�<>Q./� KP0iR>I*2�IJKXQSI�Rw2�9 ~e2�<V-DR>_*<>2<>243O2�<wU.=:KP<4Ye3O=iR>Ie-DRGKPRV3GR>2�9 ~,2�<V-:R>_*<w2bK`3�0*=.R�MwIe-:0*Q.24}�-D~*~*<>24MwKN-:�J�P/#�J/!R>I*2�=.~e2�<6-:ROKP=.0�=:CBR>I*2�2�0*Q:KP0*2.'

��=:?�?x2�0*2�24}%R>= }J24MwKN}J2�=S0�R>I*2bCE_*0eM6RFKX=S0e3 � � � �]-:0e} � � ��� � �V'B�G24M�-"�f��3F=.9 2bC�-:9iKf�fK`-D<�26�e-:9 ~J�P243G=:C3O_eMwI�Cp_*0eM6ROKP=.0e3�JCp=.<�-D0K`}J24-u�¼Q1-.3G=DC �~e-:<>RFK`Mw�P243¨KP0#U.=:�P_*9 2��Y

�,����� � � � �W¦ ��� ��� � ��� � " �y�O« ��u¦J� � �W«.¦J�

ª*=S< �Mw�`-S3>3LKNM�-"�BIe-:<>9 =.0JKNMb=13wMwK��f�N-:R>=S<V3(?¨KXRwI�Cp<>24�._*2�0eMwKP243#��� � � �� ���1Y�e����� � �W¦ � � �

���%�� %L� �H��[� � � � �W«.«J�

��0��,=.R>ItM�-.3O243�Y �,�����BKN3b~*<>=.~e=S<>ROKP=.0e-"�BR>= ��� � � Y^?(I*2�<w2 � K`3bRwI*2�0J_*9��,2�<�=:Cx}J2�Q.<>2�243b=DCBCE<>2�24}J=S9 =:C]R>I*23O/*3OR>2�9#'�)GIJKN3GKN3b-:~*~*<>="�1KP9!-DR>26�P/!R><w_*2bCE=.<�9 =13OR�3F/�3ORw2�9!3�2�U.2�0�KP0 �S_e-:0JR>_*9 3OR6-:ROKN3OROKNM�3�Y*?�I*2�<>2 � 9!-"/ �,2<>2�Q1-D<V}J24}�-.3�-�3L�P=:?G�P/ U:-:<>/SKP0*Q�Cp_*0eM6ROKP=.0t=:C �!Y^3LKPQ.0JKfCp/.KP0*Q�R>I*2 26�z24M6ROKPU.2i0J_*9��,2�<�=:C(}J2�Q.<>2�243b=:C�CE<w2�24}J=.926�eMwKXRw24}#-:R(2�0*2�<wQ./��'�Z.=i�P2�Rb_e3GRV-:�.2

�P=.Q � ��� � �� ¦ �P=.Q � � M6=S0e3OR � �W«:¸ �*�

�P=.Q � � ��� � � �� �¦ �P=.Q � � � M6=S0e3OR � �W«:¸ "�

?(IJKNMwI�3F2�2�9!3B�._JKPR>2G<>24-u��KN3ORFK`MxCE=.<[R>I*2(M�-.3O2]=DCe9�_e3wMw�X243�'H&H�fKX9�KX0e-DROKP0*Q � � Cp<>=.9��W¦.³J�6Y.�W«S·J�VY � KN3B}J2�R>2�<w9iKP0*24}Cp<>=.9� � � � � �i�P=.Q�� � � �

� � � � � �P=.Q�� � � �� � � � �W«.ºJ�

-:0e}R>I*2�0 � � KN3¨CE=._*0e}�CE<w=.9��W«.·J�V'B��_*RGCp<>=.9��W¦.«��H?G2�<>24M6=SQ.0JK ��2�R>I*2i�._e-:0JROKPRO/

� � � � �� � �

�W«.¬J�

-.3GRwI*2�-:0e-"�P=.Q =:CG� � � �� �BKP0#24�S_JK��fKP�*<OKP_*9�RwI*2�=.<>/.'])GI*2�0�-"CpR>2�<(3O=.9 2�-"�PQ.2��*<6-*Y*?G2b{e0e}�R>Ie-DR��O«*¶:�yKN3

Page 23: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦.« ¦.«

� �A¶ �� ��

� � � � � � �� � ��� �� ��� � �

� �W«J®.�

��0�R>I*2 M�-.3F2 � � � � YeR>IJKN3�KN3��V¶ � � � � � Y^M6=.0JR><V-.3ORw24}�?GKPR>It¥b26�PU.KP0z��3�}SKf��2�<w2�01ROKN-"�]2��MwKX2�0eM6/d�V¶ � � �V'gb~*~*<>=.~*<OKN-:R>2¢CE=S<�9i_e3>Mw�P243¨K`3bRwI*2��fKP9iKPROKP0*Q�Cp=.<>9 -.3 � � ��� Y � � � � � � �V¶ �u¦J����� � � M6=.0e3OR �^��R>I*2��J�X=J=*}3OR><w24-:9 KN3GU.2�<w/��N-:<wQ.2¤M6=S9 ~e-:<>24}�R>=�-�9i_e3>Mw�P2b{e�e2�<��V'GZ.=.9 2�M�-:<>2¨K`3¨0*2�24}J24}�KX0�R6-:�.KP0*QiR>I*2��fKX9�KXR"Ye-:0e}%�W«J®.�R>I*2�0�<>24}J_eM6243(Rw=

� �A¶ � � � � �P=.Q � � �W«.²J�

��=u? 2�U.2�<>/JR>IJKP0*Q!�,=:Kf�`3�}J=:?(0�R>= R>I*2i�._*243FROKP=.0 s ?(Ie-:RGKN3 � Cp=.<�-i9i_e3>Mw�P2:±tg�3(�,26CE=.<w2.YJ�P2�R�_e3(RV-D�.2bCE=S<(R>I*2�N-:<>Q.2 3LKP0*��<>243O2�<>U.=DKX<"Y� � ���V¶ �u¦J� � � ��� � Y,?(I*2�<>2 � � � «*¶4·��'�)GI*2i9!-"�JKX9i_*9 R>I*2�=S<>2�ROKNM�-"�B2��MwKP2�0eM6/3O_*<>26�P/ M6=.<><w243O~e=.0e}*3%R>=�R>I*2t9!-"�JKP9i_*9°M6=.0eM62�01Rw<V-:ROKP=.0�=:Ci~*<OKP9!-:<>/�2�0*2�<>Q./§R>Ie-:R#3O2�2�93~e=13>3WKX�J�P2dKP0A-9i_e3>Mw�P2��*R>I*2�2�0*2�<>QS/!=:CBg])(@�IJ/�}J<w=:�P/�3LKN3�=:C¼=.0*2�9�=:�P24M6_J�X2�KN3(M6=.0eM62�0JR><V-DR>24}�KP01R>=-�3WKX0*QD�X2�U.KP�*<V-DROKP=.0#9 =*}J2-:0e}�K`3bM�-:~*R>_*<w24}��e26Cp=.<>2¢KPR¤3O~*<w24-.}*3(Rw= =.R>I*2�<V3�'x)GI*2�<w26CE=.<w2bCE=.<bR>I*2�3O=S_*<VM62.Y*�P2�R�� � ·�� ¸1« �2�U^Y*R>I*2�I*24-:R=:CB<>24-.M6ROKP=.0�=:C��g])(@v9�=:�P24M6_J�X243�Yz-:0e} � � ¦ ¼Y^M6=.<><w243O~e=.0e}SKP0*QR>= =.0*2�U.KP�*<V-DROKP=.0#9 =*}J2�~,2�<�9�=:�P24M6_J�X2.')GIJKN3�Q:KPU.243

� � «*¶4· ! ¶ ��«.¬ ! ¶4· " ��·��h¸1« ! ¶ ��¬ ! ¶4· " � � ·���·.¬S¦�� �W«.³J�

Cp<>=.9 ?(IJKNM>I��W«S²J�¼Q:KPU.243� � ®u¬ ��º�� � ��¸1·J�

¡b=._*�*RO�P243>3�Y¼RwI*2 0*24-:<�-DQ.<>2�2�9 2�0JR�?GKPR>IdR>I*2!U:-"�P_*2!<w2�~e=.<>Rw24}��1/�g��P�e2�<>RV3�2�Ri-"���V¶"³.².«J��KN3�Cp=.<>Rw_JKXRw=._e3�yR>I*226�JK`3FROKP0*Q!9 24-S3O_*<>2�9 2�0JRV3(-:<w2�R>=1=�_*0eM62�<>RV-"KP0�R>= }J<V-"?A-:0J/!<w24-"�HM6=.0eMw�P_e3LKP=.0e3�'(��_*R(=S0*2�9iKPQ.IJR(Ie-"U.2�I*=.~,24}R>Ie-:R�R>I*2 9!-u�1KP9i_*9�R>I*2�=S<>2�ROKNM�-"�(2��MwKP2�0eM6/t?G=._J�N}8M6=S9 2!=S_*R �W_e3OR -:�,=:U.2 R>I*2 9-"�1KP9i_*9�=S�e3O2�<>U.24}d2�!�MwKP2�0eM6/ �(-D0e}v-:R��P24-.3ORiR>Ie-DR�9i_eMwI8Ie-S3��,2�2�0v<>24-"�fK ��24}^'���R -:~*~e24-D<V3�R>Ie-:RiR>I*2�KX0JCp=.<>9-:ROKP=.0�?x2_e3O24}�?(-.3-.}J24�S_e-:R>2bCp=.<(R>I*2�~*_*<w~e=13O2.Y,-:0e}�R>I*2�<w2bK`3�0*=i�P=.0*Q.2�<b-:01/9i/�3FR>2�<>/.'

� ������� �7t2i}J2�<OKPU.24}�R>I*2�2��MwKP2�0eM6/�Cp=.<>9i_J�N-��W«S²J�B?GKPR>I*=._*R�-.3>3O_*9iKP0*Q#-:0J/#3L�P=:? <>2�U.2�<63LKP�J�X2�=.~e2�<V-DROKP=.0 -.3bM6=.0JU.2�0*�ROKP=.0e-"�]RwI*2�<>9 =*}J/10e-:9�K`M�3�}J=J243�'�c(0tR>I*2i=.R>I*2�<�Ie-D0e}^Y^0*26KXRwI*2�<�}SKN}�?G2 -.3>3O_*9 2iR>Ie-DR(KPR�KN3b0*=.R�3W�X=:?�Yz3F= KfC=._*<G}J2�<OKPUu-:ROKP=.0%KN3xM6=S<><>24M6R4YSR>I*2(Cp=.<>9i_J�N-�=S_*Q.I1R�R>=�<w2�9!-"KP0�Uu-"�fKN}�KP0�R>I*2G�fKP9iKPR(?(I*2�0�R>I*2b~*<>=*M6243>3�KN3x3F=�3L�P=:?R>Ie-:R�R>I*2�M6=.0JU.2�0JROKP=.0e-"�|RwI*2�=.<>/!}J=J243G-:~*~J�P/.'x)[= M>I*24Mw� R>IJKN3�YJ�P2�RG_e3(-:~*~J�P/�M6=.0JU.2�01RFKX=S0e-"�|R>I*2�=S<>/ R>=i-�3F9!-"�f�3O=._*<6M62(?(I*=13O2GR>2�9�~e2�<V-:Rw_*<>2�� }J<>=.~e3B3L�P=:?G�P/ -.3yR>I*2(2�0*Q:KP0*2(<w_*0e3�Y13O=�?G2GIe-"U.2(-�3O24�S_*2�0eM62(=:C,KP0J{e0JKXRw243LKP9!-"�<>2�U.2�<63LKP�J�X2i;G-:<>0*=.R]M6/*Mw�P243�'GZ._*~*~e=J3O2�R>Ie-:RBR>I*2�3LKP0*�iKN3G3O=��N-:<wQ.2(R>Ie-:R � � <>2�9!-"KP0e3GM6=.0e3OR6-:01R"'¼)GI*2�0�}J<V-"?GKP0*QI*24-:R � CE<w=.9 R>I*2�3O=S_*<VM62.Y*R>I*2�9!-u�1KP9i_*9 ?G=.<w� ?G2�M�-:0�Q.2�R�-.M�M6=S<V}SKP0*Q R>=!Mw�N-.3>3WK`M�-u�HR>I*2�<w9 =�}J/J0e-:9iKNM�3¨KN3

� � � � �� ��

�O¶ � � �� � � � � � � � ��¸e¶:�

��=u? 3O_*~*~e=J3O2.Y]M6=.<><w243O~e=.0e}SKP0*QtRw=#R>I*2!��-4/S�P26KPQ.IJ��+:24-:0e3�-.3>3O_*9 ~*RFKX=S0e3�KP0v=._*<¢{e<V3ORi}J2�<OKPUu-:ROKP=.0zY�R>Ie-:R�R>I*23O=._*<6M62�Ie-S3�-!M6=.0e3FRV-:0JR�I*24-:R�M�-D~e-.MwKPRW/ � Yz3O=R>Ie-:R � � � ��� � � � ����Y^?(I*2�<>2 � KN3bR>I*2�KP0JKPROKN-"�¨3F=._*<VM62R>2�9 ~,2�<V-:R>_*<w2��zR>I*2�0�� ��� � '�)GI*2i2�0*Q:KP0*2 ?¨K��f�G<>_*0t=.0J�P/ -S3��X=S0*Q -.3�� � � � � � Yz3O=�R>I*2i9!-u�1KP9i_*9=.�*RV-uKX0e-D�J�X2?G=.<>�%K`3¢Q:KPU.2�0t?(I*2�0�R>I*2 _*~*~,2�<���KP9iKPRi=:C�KX0JR>2�Q.<6-:ROKP=.0�KN3 � ���i� � � � � �V' a�-:�.KP0*Q�R>I*243O23O_*�e3ORFKXRw_*ROKP=.0e3�Y,R>I*2bKP01R>2�QS<V-"�^KN3(24-.3WK��P/�2�U:-"�P_e-:R>24}^Y,?GKPR>I#R>I*2�<w243O_J�PR

������� ��� � � � � � � � � �P=.Q � �� � � ��¸1¦J�

Page 24: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦:¸ ¦:¸

¡�KPU.KN}SKP0*Qv�J/ � � � � Y�?x2<>24M6=:U.2�<iR>I*2�<>243F_J�XR%�W«.²J��R>Ie-:Ri?G2#}J2�<OKPU.24} ~*<>2�U.KP=._e3W�X/v_e3WKX0*Qd=.0J�P/v~*Ie-.3O2U.=:�P_*9 2iM6=.0e3LKN}J2�<V-:RFKX=S0e3�'x)¨IJK`3bM6=.0J{e<>93GR>Ie-:RG=._*<(QS2�0*2�<V-"�fKN3O24}�3O24M6=.0e}�N-"? <>24}J_eM6243�Y|-.3xKXRb3OI*=._J�N}^YeRw= R>I*2M6=.0JU.2�0JROKP=.0e-"�¼=.0*2�?�I*2�0#R>I*2b�N-:R>Rw2�<GKN3�-:~*~J�fKNM�-:�J�P2.'

��_*R�R>IJKN3�M6=.0JU.2�0JROKP=.0e-"�¤��3L�P=:?�Y[<>2�U.2�<V3LKP�J�P24��3O24M6=.0e}��N-"? KN3¢0*=.R�-:~*~J�fKNM�-:�J�P2�R>=#-%9�_e3wMw�X2.Yy�,24M�-:_e3O2iKfC-�9�_e3wMw�X2�=.~e2�<6-:R>24}#3W�X=:?G�P/�2�0*=._*Q.I#Rw= 9!-:�.2¢KPRV3�-S3>3O_*9 ~*ROKP=.0e3�Uu-u��KN}^Y^=.RwI*2�<¤}J2�Q.<w2�243(=:CyCp<>2�24}J=.9�R>Ie-:R(?G2Ie-"U.2i�P26CpR =._*R�=DC�=._*<�M�-u�`M6_J�N-:RFKX=S0�?G=._J�N}tR6-:�.2 =:U.2�<i-:0e}tRwI*2�<>9!-"�fKN3O2�R>I*2~*<OKP9!-:<>/d2�0*2�<>Q./.YB9!-D�.KP0*Q�R>I*29i_e3>Mw�P2�_e3O26�P243>3�']�LR(KN3 �W_e3OR�R>= -4US=:KN}�R>I*2�<>9-"�fK`3w-:ROKP=.0#RwIe-:RG�JKX=D�X=SQ:KNM�-"�H~*<w=�M6243>3F243(9i_e3OR(R6-:�.2�~J�N-.M62�<6-:~JKN}S�X/.Y-:0e}R>IJ_e3G?G2�<>24�S_JKP<>2�-#�VCû-.3FRV�i3O24M6=.0e}�N-"? R>= -:0e-u�X/ ��2�RwI*2�9#'

c(_*<yQ.2�0*2�<V-u��KN3>-DROKP=.0�=:CeRwI*2]3O24M6=.0e}b�N-"?�0*=.Rz=.0J�P/�~*<>243O2�<wU.243^R>I*2G}J/10e-:9�K`M�3y-:0e}¢R>I*2�<>26Cp=.<>2BR>I*2G\,KP=._*U.Kf�f�P2R>I*2�=.<w2�9#YGKPR�~*<>243O2�<wU.243 RwI*28;��`-D_e3LKP_e3�<>26�N-:ROKP=.0 � % � � � -:0e}§R>I*2t��=:�PR���9!-:0*0�2�0JR><>=.~J/�CE=S<>9i_J�`- � ����P=.Q�� �i-:0e} KPR#2�U.2�0�~*<>243O2�<wU.243�R>I*2�KP0JR>_JKPROKPU.289�24-:0JKP0*Q�=:C�KPR#RwIe-:R�?(-.3 <w24M6=.Q.0JK ��24} �J/ ��=:�PR���9-:0*0zY&yKP0e3ORw26KX0zY*-:0e}@y�N-:0eMw�^'H)¨I*2�<>26CE=S<>2(?G2(Ie-"U.2G0*=.RxMwIe-:0*Q.24}�R>I*2(�e-.3LKNMG<6-:ROKP=.0e-"�P2b_*0e}J2�<O�P/.KP0*Q R>I*2b3O24M6=.0e}��N-"?-:0e}R>I*2i¥b26�PU.KP0�2��MwKP2�0eM6/#<>_J�P2¢KX0�-:0J/!?(-"/ �S?G2�Ie-4US2�=.0J�P/�=.~e2�0*24}%=._*<(2�/.243GRw= R>I*26KP<GCp_J���B9 24-:0JKP0*Qe'

ª,-:<bCp<>=.9��e26KP0*Q�KX0�M6=.0 �*KNM6R�?GKPR>ItRwI*2�3F24M6=.0e}��N-"?�Yz\,KP=._*USK��f�P2.��3iRwI*2�=.<>2�9�KN3�R>I*2i<>24-S3O=.0�CE=S<bKXR"'��b-.}\,KP=._*USKf���P2.��3�R>I*2�=.<w2�9��e2�2�0�}SKN3>M6=:U.2�<w24}t�,26CE=.<w2!R>I*2�?x=S<>��=:C�;x-:<>0*=.R"Y,KXR -:~*~,24-:<V3�R>=�_e3�R>Ie-:R�R>I*2!3O24M6=S0e}�N-"?�YJKP0�R>I*2bCE_J�f�BQ.2�0*2�<V-"�fKPRO/#?G2�Ie-"U.2�Q:KPU.2�0%KXR"Ye9iKPQ.IJR(Ie-"U.2��,2�2�0 -D01ROKNMwKP~e-:R>24}�R>I*2�=S<>2�ROKNM�-"�f�P/#?GKPR>I*=._*Rb-:01/<>26Cp2�<>2�0eM62�Rw=�I*24-DR(2�0*Q:KP0*243�,=.<GKP0e}J2�24}�R>= R>I*2�0*=.RFKX=S0e3G=:CBR>2�9 ~e2�<6-:R>_*<>2�-:0e}RwI*2�<>9!-"�¼24�S_JKf�fKX�*<FKX_*9�'

7d2�Ie-"U.2�9!-.}J2i0*=�_e3O2i=:CGR>I*2i0*=.ROKP=.0e3b=:C]=.<6}J2�<�-:0e}�}SK`3F=.<V}J2�<4'���0e}J2�24}^Yy-.3�a�-"��?G26�f�B0*=.R>24}%KP0tR>I*2-:<>RFK`Mw�P2�=.0�}SK��z_e3LKP=.0zYbR>I*=J3O2#R>2�<w9!3 -:<>2�=.0J�P/�26�*~*<>243>3LKP=.0e3=DC�I1_*9!-D0 -:243ORwI*2�ROKNM �O_e}JQ.9 2�0JRV3�'���_*R KP0 -?G26�f���J�10*=:?(0t?G=.<w�#=.0t3ORV-DROKN3OROKNM�-"�]9 24MwIe-:0JKNM�3i�W@y2�0*<w=13O2.Y]¶"³J®u·J��KPRbK`3i3OR6-:R>24}�RwIe-:R!� � ���eRwI*2��P2�R>Rw2�<V3�=:CGR>I*2-"�P~*Ie-:�,2�R¨M�-D0 �e2�-:<><V-D0*Q.24}�KP0!¦.¬$0y?(-"/�3�Y:=:Cz?(IJKNM>I=.0J�P/i=.0*2(KN3�R>I*2(~e2�<FCE24M6RO�P/=.<V}J2�<>24}�-:<><V-:0*QS2�9 2�01RBg���;'P'P'��b£ �¼Y,-"�f�HR>I*2�<>243OR(Ie-"USKP0*Q!U:-:<>/SKX0*Q#}J2�QS<>2�243(=DC�}SKN3O=.<6}J2�<4'��)z=!3F_*~*~e=13O2iR>Ie-DR���-DR>_*<>2bKN3�KP0 �e_*2�0eM624}��1/?(Ie-:R�/.=._=.<(�(M6=.0e3LKN}J2�< �6=.<V}J2�<O�P/*��KN3�-D0�2�Q.<>2�Q:KP=._e3(M�-S3O2�=:CBR>I*2�a%KX0e}�@B<>= �W24M6RFKX=S0#ªe-"�f�N-.M6/.'

g�3]-b9�=.<>2(~,2�<>ROKP0*2�01R�26��-D9 ~J�P2.Y��b-:R>_*<w2(Ie-.3B}J24M6<>2�24}�R>Ie-:RB?(-:R>2�<BU:-:~e=S_*<]Ie-.3�-bIJKXQSI*2�<x2�0JR><>=S~1/�R>Ie-:0�fKN�._JKN}�?(-:R>2�<"Ye-"�PR>I*=._*Q.I�9 =13OR�=:CH_e3�?G=._J�N}#M6=.0e3WK`}J2�<�RwI*2�Uu-D~e=._*<�Cû-D<�9 =S<>2!�6=.<V}J2�<F�X/*��KX0��e=.RwI 3OR><w_eM6R>_*<>2-:0e}��,2�Ie-"U.KP=.<4' )¨I*2 Uu-:~,=._*<�Ie-S3�-�IJKPQ.I*2�<�2�0JR><>=S~1/�R>Ie-:0�R>I*2i�fKN�._JKN}^YB0*=SR��e24M�-:_e3O2�KXR¢KN3b�P243>3��6=.<V}J2�<F�X/*�*Y�*_*RG�e24M�-:_e3F2�R>I*2(9iKNM6<>=13FRV-:R>243�M6=.9 ~e-:ROKP�J�P2�?GKPR>IR>I*2bUu-:~,=._*<G9!-.M6<>=13FRV-:R>2(=*M�M6_*~J/!-b�N-:<>QS2�<x~*Ie-S3O2�US=:�P_*9 2.')GIJ_e3z?G2GM�-:0*0*=.RB_*0e}J2�<V3OR6-:0e}�R>I*2(3O24M6=S0e}��N-"?�Y�KP0 26KPR>I*2�<B�JKP=:�P=.Q./�=S<¼~*IJ/�3WK`M�3�Y"KX0iR>2�<w9!3z=DC*KX0JR>_JKPROKPU.2(0*=SROKP=.0e3=:CG=.<V}J2�<�-:0e}t}SKN3O=S<V}J2�<4'�c(0tR>I*2 =.RwI*2�<�Ie-:0e}^YzR>I*2 3O24M6=S0e}��N-4?��fKP9iKPRV-:RFKX=S08=.0�9!-SM6<>=13>M6=.~JKNMi~*<w=�M6243>3F243�K`324-.3LKf�P/ _*0e}J2�<V3FR>=1=*}�KX0=.�$�O24M6ROKPU.26�P/ 9 24-D0JKX0*QDCE_J�zR>2�<>93�Y:KP0�e=.R>I��JKX=D�X=SQ./!-:0e}�~*I1/*3LKNM�3�Y*-.3�R>I*2(~*<OKNM62b?x2�~e-4/Cp=.< o - � o � � � r ) k )� ) n � '

� � ���i�]���z"���g�3BR>I*=13F2(~*<>=.9iKN3O24}�R>2�0JRV-:ROKPU.2(M6=.9�9 2�01R63B=.0 �JKP=:�P=.QDK`M�-u�|KP0JCp=.<>9!-DROKP=.0zY.?G2�3O2�2�R>I*2�-:�,=uUS2�-.3B2�USKN}J2�0eM62�R>Ie-:RR>I*2�2�0*2�<>QS/!=:Cyg])(@�I1/*}J<>=:�P/*3LKN3GKN3(M6=S0J{e0*24}�R>= -i3LKP0*Q:�P2�USKP�*<V-:ROKP=.0�9 =�}J2bKP0#3ORw<OKN-:R>24}9i_e3>Mw�P2��JKfC¼KPR�3F~*<>24-.}R>=�RW?G=�9 =*}J243�YyR>I*2�0�?G2!?G=._J�N}dIe-4US2 � � ¦�!t·�� ·.¬.¦*� ·��P¶4¦:¸,Yz-:0e}v�O«.²J�(?G=._J�N}t~*<w24}SK`M6R-�R>I*2�=.<w2�ROKNM�-"�9!-"�JKP9i_*9 2��MwKP2�0eM6/�=:C�=.0J�P/ ¬.¦ �!' ��-S}vR>I*2�2�0*2�<>Q./�3F~*<>24-.}vRw=8R>2�0§U.KP�*<V-DROKP=.0�9 =�}J243��e26Cp=.<>2��,26KX0*Q<>24M�-:~*Rw_*<>24}^Y.R>I*2�~*<>24}SKNM6R>24}2��MwKP2�0eM6/ ?G=._J�N} �,2(=.0J�P/!²��'z��RG-:~*~e24-D<V3BR>Ie-DRx-:0JKP9!-"�N3�Ie-4US2GKP0e}J2�24}2�U.=:�PU.24}9i_e3>Mw�P2�2��MwKP2�0eM6/8Rw= RwI*2!9!-u�1KP9i_*9 R>Ie-:R�M6=S_J�`}��,2!<w24-"�fK ��24} KP0�-��JKP=�MwI*2�9iKNM�-"��2�01USKP<>=.0*9 2�0JRi~e=:?G2�<>24}�J/�R>I*2�g])(@§IJ/�}J<w=:�P/�3LKN3b<>24-SM6ROKP=.0zY|-u�XRwI*=._*Q.It-i<>24-.M6RFKX=S0 ?¨KXRwI -�Q.<>24-:R>2�< � � ?x=S_J�`}�~,2�<>9iKPR�3OROKf�f�HIJKPQ.I*2�<2��MwKP2�0eM6/.'

ª[KP0e-"�f�P/.YG?(Ie-:R�?(-.3�R>I*2!26�z24M6ROKPU.2�_*~*~,2�< R>2�9 ~,2�<V-:R>_*<w2 � Cp=.<iR>I*2!9i_e3>Mw�P2:± 7§KPR>IvRO?G= }J2�Q.<>2�243�=:CCp<>2�24}J=.9 ~,2�<�g])(@ 9 =:�P24M6_J�P2.YeRwIJK`3¨KN3(QDKXUS2�0#�J/ ��� � ·��h¸J«�2�U^Y*=.<

� �·�� ¸1«�!8¶ ��¬�!t¶4· " �¶ ��«S¬ !t¶"· " �� � º.·.¬.· � � ��¸1«J�

)GIJKN3bKN3�3ORV-:<>RF��KP0*Q��,24M�-:_e3O2�KXRbKN3�-:�e=._*R�RwI*2 R>2�9 ~,2�<V-:R>_*<>2 -:R�RwI*2�3F_*<OCû-SM62 =:CxRwI*2�3F_*0�0i��R�-:~*~,24-:<V3�Y[R>I*2�0zYR>Ie-:R�-9i_e3>Mw�P2iKN3�-:�J�P2iR>=�?G=.<>��2��MwKX2�0JRO�P/�0*=.R��e24M�-D_e3O2iKPR�U.KP=:�N-:Rw243�-:0J/��N-"?�3�=:CxR>I*2�<w9 =�}J/J0e-:9iKNM�3�Y[�*_*R

Page 25: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦.º ¦.º

�e24M�-D_e3O2�KPR�K`3¨~e=:?G2�<>24}��J/!RFKX0J/t�6I*=.R�3O~,=.RV3>��=:CB9 =:�P24M6_J�N-:<�3LK ��2.Y|-S3GI*=.R�-.3�R>I*2i3O_*0z' $)¨IJK`3�3OI*=:?�3[I*=u?�C�-:<]-b�JKP=:�P=.Q:KNM�-"�z3O/*3OR>2�9�KN3[CE<w=.9 R>I*2�<>9!-u��24�S_JKf��KP�*<OKP_,9 KP0 R>I*2G<>243O~,24M6RV3BR>Ie-DR¼9!-DR>R>2�<4'

�pC]=S0*2�3>-"/*3]RwIe-:R(R>I*2�R>2�9 ~e2�<6-:R>_*<>2¢KX0�-��fKPU.KP0*Q M626�f�yKN3��6_*0JKfCp=.<>9!��Y*I*2�M�-:0�9 24-:0�=.0J�P/�R>Ie-:RGKPRGKN3b_*0JKfCE=S<>9-.3b<>2�QDK`3FR>2�<>24}d�1/�-�R>I*2�<>9�=.9 2�R>2�<�?(I*=J3O2i�*_J�X��KN3¢R>I*=._e3>-:0e}*3¢=:CxRFKX9�243�M6=1-:<63O2�<4Yz-:0e}�?�I*=13O2 <>243F~e=.0e3O2�K`3R>I*=._e3w-:0e}*3G=:CBROKP9 243(3L�P=:?G2�<4Y*R>Ie-D0�R>I*2�_*0JKPRV3(RwIe-:R(-:<>2�~e2�<FCE=.<w9iKP0*Q!R>I*2�243w3O2�01RFK`-u�¼�JKP=:�P=.Q:KNM�-"�yCE_*0eM6ROKP=.0e3�'

�ûC|?G2]26�e-:9iKP0*2(RwI*2xM6_*<><>2�0JRy�fKPR>2�<V-:R>_*<w2x=DCe�JKX=J2�0*2�<>Q.2�RFK`M�3�?GKPR>IiR>IJKN3[KP0 9iKP0e}^Y.?G2x-D<>2x3ORw<>_eM>���J/�RwI*2]C�-.M6RR>Ie-:RbUSKX<wR>_e-"�f�P/ -u���]Rw<>24-:R>9 2�0JRV3��e2�Q:KP0t�J/ 3FRV-:ROKP0*QR>Ie-:R��JKP=:�P=.Q:KNM�-"�x3O/*3OR>2�93�-:<>2�-DR�_*0JK�Cp=.<>9 Rw2�9 ~e2�<V-DR>_*<>2-:0e}�R>I*2�MwI*2�9iKNM�-"��<>24-.M6RFKX=S0e3�~*<w=�M62�24} K`3F=.R>I*2�<>9!-u���P/��GR>I*2�0vUSKX<wR>_e-"�f�P/ -"�f��RwI*2�}SKN3>M6_e3>3WKX=S0vKN3�KP0�R>2�<w9!3�=:C<>24-.M6RFKX=S0�CE<>2�22�0*2�<>Q:KP243���� =.< ��� '��(=:? R>I*2�CE<>2�2�2�0*2�<wQ./8MwIe-:0*Q.2�=:C¤-�<>24-SM6ROKP=.0�KN3i=.0J�P/ -%{|M6ROKPROKP=._e3�SKX0e}d=:C(2�0*2�<>Q./.YyR>Ie-DR�M6=._J�N}�KP0�~*<OKP0eMwKX~J�P2��e2=.�e3O2�<>U.24} KX0�U.2�<>/t3O~,24MwKN-"��MwKX<6M6_*9!3ORV-:0eM6243�'���R¢K`3�R>I*2�?x=S<>�9!-.}J2�-"Uu-"Kf�N-:�J�P2�?(I*2�0R>I*2bR>2�9 ~e2�<6-:R>_*<>2�-:0e}M6=.0eM62�01Rw<V-:ROKP=.0e3G-:<>2�_*0JK�Cp=.<>9 -:0e}�R>I*2b<>24-.M6ROKP=.0~*<>=*M62�24}*3G3O=3L�P=:?G�P/#R>Ie-DR(KPRb<>2�9!-"KP0e3�-:Rb24�._JKf�fKP�*<OKP_*9 ?GKPR>I�<>243O~e24M6R�Rw=!R>I*2i=.<FKXQDKX0e-u�HR>2�9�~e2�<V-:Rw_*<>2 -:0e}#M6=.0eM62�0JR><V-DROKP=.0 �),+ - +PY,?(I*2�0tI*24-:R�M�-:0 �e=:? KP0t=S<�=._*R�=DC]R>I*2 M626���]<6-:~JKN}S�X/�2�0*=._*QSIzYz-:0e}�R>I*2i<>24-.M6RV-:0JRV3b-:0e}�~*<>=*}J_eM6RV3�M�-:0}SKf�z_e3O2�KP0 -D0e}=._*R(<V-:~JKN}S�P/#2�0*=S_*Q.IzY*R>=i9!-"KP0JRV-"KP0#RwI*2bKX0JKPROKN-"�]_*0JKfCp=.<>9iKPRO/.'

;�=.0e}SKPROKP=.0e3¢KX0v-�JKP=:�P=.Q:KNM�-"�(~*<>=*M6243>3i3O_eMwI8-.3�0J_eMw�P2�=.ROKN}J2�3O/10JR>I*243LKN3i-:<>2-:�e=._*R�-S3bC�-:<�Cp<>=.9 R>IJKN3�-.3M�-:0��,2�KP9!-:Q:KP0*24}^Y�KP0 -:RG�P24-.3FR(RO?x=i<>243F~e24M6RV3 sýOÝVþiÎ�â6¿VÇfÇ:Ù�Æ �G¾1Æ "¿ 4¿6Ì ��+N¿6øtýNÇf¿6ÓOÓeÅ�¾JÆ�Â�ÿ�4þ,Ù�À"Çf¿Vâ6Ü.Çf¿VÓ*À +�Æ�Ä"Ã� "¿VÂbÅ��:Á1¿:Ô:Æ�Â.Û�ÅL¾.¿�bÆ�Ì�¿�Â.À4Å +NÌL¿V¿BÅLÀGÛ.Ã.-eÜ.ÓO¿]Æ�ÚJÀ4Ü.ÅÚJ¿6âmÆ�Ü.ÓO¿(À�+zÃfÂ:Å�ÌWÆ�âV¿6ÇfÇfÜ.ÇPÆ�ÌBÙ�¿6Ù�Ú.ÌOÆ�Â.¿6Ó�/4ÅL¾uÜSÓxÅL¾.¿bÜ.Â.Ã.+NÀ4ÌLÙ âVÀ"Â.â6¿VÂ:Å�ÌOÆ�ÅLÃ�À"Â.ÓGÁ.Ì�¿6ÓOÜ.Á.ÁJÀ4ÓO¿6Û ÃfÂ�ÅL¾.¿bÛ.¿��JÂ.ÃfÅ�ÃfÀ4 À +ÌL¿mÆ�âVÅLÃfÀ4 +NÌ�¿6¿�¿VÂS¿VÌLÄ4Ãf¿VÓGÓO¿6¿VÙ Â.À"Å(À4ÂSÇ���Â.À4Å(ÌL¿mÆ�ÇfÃ��6¿6ÛeÔJÚ.Ü.ÅbÂ.À4ÅG¿ 4¿6Â!Ù�¿mÆ�Â.ÃfÂ.Ä�+NÜSÇEÖ �*¿6¾.Â.ÃfÂ.Ä"¿VÌ�ýOÝVà"É4ÿ4þ�øBÆ�ÌLÂ.ÓÜSÓ]Å�¾JÆ�Å]ÅL¾.ÃfÓ]Ù�Ã�Ä"¾:żÃf 4Æ�ÇfÃfÛ1Æ�ÅL¿(â6À4 4¿6Â:Å�ÃfÀ4Â1Æ�ÇeÅL¾.¿VÌLÙ�À:Û �:Â1Æ�Ù�ÃfâGÅ�Ì�¿�Æ�ÅLÙ�¿6Â:Å�Ó�Ö

ýpÿ4þiÎ�ÌL¿mÆ�âVÅLÃ�À"Â(ÃfÓ^À� 4¿6Ì*úxÅL¾.¿ ��À"Ú(ÃfÓ|ÛSÀ4Â.¿[ú(Ã�ÂbÆBÅ�ÃfÙ�¿zÅ�À:ÀGÓO¾.À4ÌLÅ$+öÀ4Ì^Å�¾.¿yÂ.À"Å�ÃfÀ4ÂbÀ�+ L¿��:Ü.ÃfÇfÃfÚ.Ì�ÃfÜ.Ù �]ÅLÀ]ÚJ¿]Æ�Á.Á.ÇfÃfâ�Æ�Ú.Çf¿:Ö� À4ÌiÙ�Æ� ��Ì�¿�Æ�â6Å�ÃfÀ4ÂSÓ�ÅL¾.¿ �Ì�¿�Æ�Ç���Á.¾ �uÓOÃfâ�Æ�Ç]¿6Â.¿6Ì�Ä"Ã�¿6Ó ����� � � Å�¾1Æ�Å�¾JÆ 4¿!Æ%Ù�¿�Æ�Â.ÃfÂ.Ä�ÃfÂ.Û.¿6ÁJ¿VÂ.ÛS¿VÂ:Å�Ç��tÀ +ÅL¾.¿6Ì�Ù�Æ�Ǽ¿��:Ü.ÃfÇfÃ�ÚSÌ�ÃfÜ.Ù!Ô,Ù�Æ �ÚJ¿�Å�¾S¿�À"Â.¿6Ó�Ù�À4ÓOÅ(Ì�¿6Çf¿ 4Æ�Â:Å+NÀ4ÌbÚ.ÃfÀ4ÇfÀ"Ä �4Ö�ËpÂ.Û.¿6¿VÛeÔ^ÚSÃ�À:â>¾S¿VÙ�Ã�â�Æ�Ç[Á.Ì�À:â6¿VÓOÓO¿VÓbÆ�Ì�¿ÂSÀ�ø ÚJ¿6Ã�ÂSÄ ÓOÅ�Ü.Û.Ãf¿6Û�+NÌ�ÜSÃ�Å +NÜ.ÇfÇ���øBÃfÅ�¾�Á.Ãfâ6À4ÓO¿Vâ6À4ÂSÛ!ÅLÃ�Ù�¿�Ì�¿6ÓOÀ4ÇfÜ.Å�ÃfÀ"Â.Ó�Ö��GÂ�Å�¾S¿�ÓOâmÆ�Çf¿�À�+BÓWÃ��6¿VÓ(Æ�Â.Û#ÅLÃ�Ù�¿VÓGÅL¾1Æ�ÅÙiÆ�ÅLÅ�¿6ÌVÔ1ÆbÇfÃ� :ÃfÂ.Ä�â6¿6Ç�Ç*ÃfÓBÂ.¿ 4¿6ÌBÃfÂ!ÆbÓOÅWÆ�Å�¿(ÌL¿VÙ�À4Å�¿6Ç���ÇfÃ�È"¿GÅ�¾.¿6Ì�ÙiÆ�Ç*¿��uÜSÃ�ÇfÃfÚ.ÌLÃ�ÜSÙ À4ÌBÜ.Â.Ã.+NÀ"Ì�Ù â6À4Â.â6¿6ÂuÅLÌWÆ�Å�ÃfÀ4Â.Ó�Ö

�G24M6=.QS0JK �6KP0*Q RwIJK`3�Y�?G28M�-D0 _*0e}J2�<63ORV-:0e}�-:0*=.R>I*2�<�<w24-.3O=.0�?(IJ/��JKX=D�X=SQ:KNM�-"��R>I*2�<w9 =�}J/J0e-:9iKNM�3%Ie-.3��,2�2�0~*_����6�fKP0*Q�KP0tR>I*2�~e-.3OR4'¢;]=.0JU.2�01RFKX=S0e-"�zCp<>2�2i2�0*2�<>Q./�R>I*2�<>9�=�}J/J0e-:9iKNM�3�KN3�}J=._*�*RO�P243>3�-.}J24�S_e-:R>2iR>=}J243>M6<OKP�e23L�P=:?�YBQ.<w=13>3�~*I*2�0*=.9 2�0e-t3F_eM>I�-.3�=13F9 =.ROKNM�26��24M6R63�YB�*_*RiKPR 9!-"/t�,2KP<><>26�P2�Uu-:0JR�CE=.<i�JKP=:�P=.Q:KNM�-"��CE_*0eM6ROKP=.0e3�fKP�.2 9i_e3>Mw�P2 M6=.01Rw<V-.M6ROKP=.0�-:0e}�~*<>=.R>26KP0t3O/J01R>I*243WK`3�Y^?(IJKNM>I�0*24M6243>3>-D<OKf�X/.YyR>=-4US=:KN}#RwI*2�<>9!-"�fKN3>-:ROKP=.0�Cp<>=.9�R>I*23O_*<><w=._*0e}SKP0*Q13�Y,RV-:�.2b~J�N-.M62�<V-D~JK`}S�P/�-:0e}=.0�R>I*2�9 =D�X24M6_J�N-:<�3wM�-"�P2�=:C�3WK ��2.'

g�3�=._*<�-:0e-u�X/*3LKN3(3OI*=:?�3�Y1RwI*2¤3O9-"�f�H3>M�-"�P2�}J=J243G0*=.R�KP0KXR63O26�fC]~*<>24Mw�P_e}J2�R>I*2�-:~*~J�fKNM�-:ROKP=.0�=:C¼R>I*2�<w9 =�}J/J�0e-:9iKNM�3�Y^�*_*R�-DR>R>2�9 ~*RV3�R>=�}J=!RwIJK`3�M6=._J�N}�0*=.R�Ie-"U.2�3O_eM�M62�24}J24} _*01ROKf�]R>I*2 -:�,=:U.2�~,=:KP01RV3b?G2�<>2i<>24M6=SQ.0JK ��24}-:0e}�?G2iIe-.}�-��._JKPR>2 }SKf�z2�<>2�01R"Yx�wC�-.3ORV��3ORV-:R>2�9�2�01Rb=:CxRwI*2�3F24M6=.0e}��N-"?�'icGC¨M6=S_*<V3O2.Y^9i_e3>Mw�P2 ~e2�<FCE=.<w9!-:0eM62KN3�=.0J�P/8-#3O~,24MwKN-"��M�-.3O2 =:C(R>I*2Q.2�0*2�<V-u�x~*<>=.�J�P2�9#Yy�*_*R 3O2�26KP0*Q�I*=:? R>=�-:~*~J�P/tR>I*2!3O24M6=S0e}��N-"? R>=�9i_e3>Mw�P2�e2�Ie-"USKP=._*<¤3FI*=._J�N}�Q:KPU.2i-�_e3F26CE_J�]Mw�P_*2�Cp=.<(=.R>I*2�<bM�-.3O243�'

�L0 R>I*243O2�{e<V3FR]M6<>_e}J2(243OROKP9!-DR>243zRw=bK��f�P_e3OR><6-:R>2(R>I*2G~*<OKP0eMwKP~J�P2.Ye=S_*<¼<>24-S3O=.0JKP0*Q�?(-.3y3O=�Q.2�0*2�<V-u�1��M6=.0eM62�<w0*�KP0*Q�=.0J�P/#~*Ie-.3F2�US=:�P_*9 243G��R>Ie-:Rb?G2�}SKN}�0*=.Rb0*2�24}�R>=�KX0JU.=.�S2�-:0J/�~e-:<>ROKNM6_J�N-:<�}J2�RV-uK��N3¢=:C]R>I*2�9�24M>Ie-:0JKN3O9=:CG9�_e3wMw�X2-.M6ROKP=.0z'i)GI*2�<>26Cp=.<>2 R>I*2 -:0e-u�X/*3LKN3�3FI*=._J�N}t-:~*~J�P/t-.3b?G26���GR>=�3OR><OKN-:R>24} 9�_e3wMw�X2.Yy3O9 =J=.R>I�9i_e3>Mw�P2.Y�|-:Q.26�f�N-*YS=.<H-D01/�=.R>I*2�<y9 =.ROKf�P2�3OR><w_eM6R>_*<>243�Y:-:0e}¢KPRB?x=S_J�`}��e2G=:CeQ.<>24-DRzKP0JR>2�<>243ORBR>=bIe-"U.2G26��~,2�<OKP9 2�0JRV-"�eUu-u�X_*243=:C¼RwI*26KX<G2��MwKP2�0eM6/��eIe-"U.2bR>I*2�/!-u���z9!-D0e-:Q.24}�R>=�2�U.=D�XUS2¤}J=:?(0R>= -i3LKP0*Q:�P2�U.KP�*<V-:RFKX=S0�9 =�}J2bR>=iR><V-D0e3LCE2�<�R>I*22�0*2�<>Q./,±

��=:?G2�U.2�<4Y"R>I*2]9i/.=13WKX0��*<OKN}JQ.2G9 24MwIe-:0JKN3O9 ~*<>=.~,=13O24}��1/iZ:KP<Bgi'uªG'"�(_J�J�P2�/!�6¶4³.ºJ®.�JCp=.<B3OR><OKN-:R>24}¢9i_e3>Mw�P2-:0e}�}J243>M6<OKP�e24} �1/�Z1�S_JKP<>2��V¶4³.²�¶:��-:0e}dg(�P�e2�<wRV3�Y - n�q +d�V¶"³.².«J��-:~*~,24-:<V3�0*=.R�=.0J�P/8M6=.0e3LKN3OR>2�0JRi?GKPR>I�=._*<$ ½y¾.ÃfÓBÓOÜ.Ä4Ä"¿VÓOÅLÓzÓOÀ4Ù�¿'+EÆ�ÓWâ6ÃfÂ1Æ�ÅLÃfÂ.Ä(ÓOÁ1¿6â6Ü.ÇPÆ�Å�ÃfÀ"Â.Ó�/�+NÌLÀ4Ù ÅL¾.¿]ÚJ¿6Ä4ÃfÂ.Â.ÃfÂ.Ä�Æ�ÇfÇ.ÇfÃ.+N¿BÀ4Â�Å�¾.¿�¿mÆ�Ì�ÅL¾�¾1Æ�ÓBÚ1¿6¿VÂ�ÌLÜ.Â.Â.ÃfÂ.Ä�À"ÂÅ�¾S¿�ÅL¿VÙ�Á1¿6ÌWÆ�Å�Ü.ÌL¿�Û.Ã.-e¿6Ì�¿6Â.â6¿xÚJ¿6Åpø¼¿6¿VÂ�Å�¾.¿bÓOÜ. Æ�Â.Û ÅL¾.¿b¿mÆ�Ì�Å�¾,ÖHá[Ì�¿6ÓOÜ.Ù�Æ�Ú.Ç��4Ô.ÅL¾.¿��1ÌLÓOÅ]ÇfÃ.+N¿(øBÆ�Ó]ÁJÀ�øy¿VÌL¿VÛ ÛSÃ�ÌL¿Vâ6Å�Ç��+NÌLÀ4Ù ÅL¾.¿iÓWÜSÂeÔ^ÃfÂ.ÓOÅ�¿�Æ�Û#À +]Ü.ÓOÃfÂ.Ä!ÅL¾.¿iÃfÂ.Û.ÃfÌ�¿6âVÅbÌ�À"Ü.Å�¿iÀ +]μ½Bá^Öz½y¾.¿6 ÁJ¿6Ì�¾1Æ�Á.Ó�Ú.ÃfÀ4ÇfÀ4Ä"ÃfâmÆ�Ǽ¿ 4À"Ç�ÜSÅ�ÃfÀ4Â�â>¾SÀ4ÓO¿�μ½BáÆ�ÓGÃfÅ�ÓG¿6Â.¿6Ì�Ä �iâ�Æ�ÌLÌ�Ãf¿VÌ���ÜSÓWÅ�Ú1¿6â�Æ�Ü.ÓO¿bÃ�ÅLÓGÌ�¿�Æ�â6Å�ÃfÀ4 ¿6Â.¿6Ì�Ä�� Û.Ü.Á.ÇfÃfâ�Æ�Å�¿6Û ÅL¾.¿�¿�-e¿6â6Å�Ó]À +¼Å�¾S¿�À"Ì�ÃfÄ4ÃfÂ1Æ�Ç|ÓOÀ"Ü.Ì�â6¿0/,Æ�Â.ÛÅ�¾.¿Ù�¿6Ù�À"Ì ��À +¼Å�¾.ÃfÓ�¾1Æ�ÓGÚJ¿V¿6 Ì�¿6ÅWÆ�ÃfÂ.¿VÛ�¿ "¿VÌBÓOÃfÂ.â6¿uÖ[Ë +¼ÓOÀ1Ô.ÅL¾.¿6Â!Æ�Á.ÇPÆ�Â.¿VÅ�øBÃfÅ�¾!Æ¢¾.À4ÅLÅ�¿6ÌxÓOÜ.Â�ø¼À"Ü.ÇfÛ ¿ "À4Ç� 4¿�Ç�Ã.+N¿GøBÃfÅ�¾ÆbÓOÅ�ÃfÇfÇ*¾.ÃfÄ4¾.¿6Ì]Ù�ÜSÓWâ6Çf¿]¿ ��âVÃf¿6Â.â �4Ö

Page 26: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦.¬ ¦.¬

3O~,24M6_J�`-DROKP=.0e3�yKPR�{eR63bKP0tU.2�<>/�0JKNM626�X/�?GKPR>ItRwI*2�9#' )GI*2 �,2�0e}SKX0*Qd=:CxR>Ie-DR��*<OKN}JQ.2iKN3�-�}J2�Q.<>2�2 =:C�CE<w2�24}J=.9R>Ie-:R]M6=S<><>243O~,=.0e}*3�R>=�-��P=u?¨�.CE<w24�._*2�0eM6/ USKP�*<V-:ROKP=.0�9 =�}J2�Cp=.<B?(IJKNM>IR>I*2�Mw�N-.3w3LKNM�-"�|24�S_JKP~e-:<>ROKPROKP=.0�N-"?�?G=._J�N}I*=:�N}^Y^-:0e}�R>I*2�<>26�N-:ROKPU.2i3OROKf�z0*243>3�-D0e}�9!-.3w3LKPU.2�0*243>3�=:CHRwI*2�9i/.=13LKP0�I*24-.}%9!-:�.243xKXR�3O2�2�9�?G26���]-.}*-:~*Rw24}�R>=<>243LKN3ORFKX0*Qi<V-D~JK`}�R>I*2�<>9-"�fK`3w-:ROKP=.0?(IJKf�X2�Rw<V-:0e3LCp2�<><OKP0*Q�KPRV3B2�0*2�<>QS/iKP01R>=�R>I*2b9!-.M6<>=13wM6=.~JKNM(3L�fKN}SKX0*Q=:CzR>I*2�-.M6ROKP0{e�e2�<"'�7t2iM6=._J�N}�Ie-:<V}S�P/�Ie-"U.2�-S3O�.24}%CE=S<¤-�,2�R>R>2�<�M�-:0e}SKN}*-:R>2iCp=.<b=._*<�=.0*2iU.KP�*<V-DROKP=.0e-"�]9 =*}J2iR>=!<w24M626KXUS2R>I*2�g])(@§IJ/�}J<w=:�P/�3LKN3�2�0*2�<>Q./.'

@�<>243O_*9!-D�J�X/.Y�=._*<!-D<>Q._*9 2�0JR M6=._J�N}v�e2�<w26{e0*24}v�J/8RV-D�.KP0*Q�Cp_*<>R>I*2�<�KP0JCE=S<>9!-:ROKP=.0v=DC¤R>IJKN3i�SKP0e}�KP0JR>=-.M�M6=._*0JR4YJ-"�PR>I*=._*Q.I RwI*2(=.�e3O2�<>US24}�Cû-SM6RV3]3O_*QSQ.243ORBR>Ie-:R�R>I*2G{e0e-"�zM6=.0eMw�P_e3LKP=.0#M�-:0*0*=.R��e2(US2�<>/ }SK��z2�<>2�0JR � ),+ - +PY9 =13FR�=:C(R>Ie-:RbKP0JCE=S<>9!-:ROKP=.0d?GKf���(�,2 KP<><>26�P2�U:-:01R�Cp=.<�~*<>24}SKNM6ROKP0*QtR>I*2�0*2�R�2��MwKP2�0eM6/.Y]-"�PR>I*=S_*Q.ItKPR¢K`3�IJKPQ.IJ�P/<>26�P2�Uu-D01R�CE=S<x~*<w24}SK`M6RFKX0*Q�=SR>I*2�<�}J2�RV-"Kf�N3b3O_eM>I�-.3�Cp=.<VM626�1US26�X=*MwKPRO/�M6_*<>US243�YJC�-:ROKPQ._*2.Y*2�RVM:'

�b-"U.KP0*Q�3O2�2�0 R>IJKN3�JKX=D�X=SQ:KNM�-"��9 24MwIe-:0JKN3O9#Y�KPRKN3�24-.3F/�R>=��e26�fKP2�U.2�R>Ie-:R�3O/10JR>I*243LK ��24} =.<26��R><6-.M6R>24}9!-.M6<w=.9 =:�P24M6_J�P243�M6=._J�N}�}J=#3LKP9iKf�N-:<iR>IJKP0*Q13 )�����) npo �,'��L0e}J2�24}^Y¼RwI*2i{e<V3OR�3ORw2�~#KP0�R>IJKN3�}SKP<>24M6ROKP=.0dIe-.3��,2�2�0RV-:�S2�08-"�P<>24-.}J/.'���0�R>I*2iC�-.3>MwKP0e-:ROKP0*Q��69i/.=13LKP0�9 =.Rw=.<V�=:CbZ.IJKX9�K ��_��6¶4³J®u³J�(?G2iIe-"U.2!-%9 =:�P24M6_J�N-:<i2�0*Q:KP0*2=.~,2�<V-:ROKP0*Q )�����) npo � �B0*=.RiU.2�<>/�2��MwKP2�0JRO�P/.Y]�*_*Ri0*2�U.2�<>RwI*26�X243w3 M6=.0J{e<>9iKP0*Q�R>I*2�KN}J24-*'���0�ROKP9 2R>I*2�}J243WKXQS0=:C¼_e3F26CE_J�H-D01ROKf�e;G-:<>0*=.R�9 =:�P24M6_J�N-:<(2�0*Q:KP0*243¢�W-:<>ROKf{|MwKN-"�z9i_e3>Mw�P2436�]9iKPQ.IJRG�e24M6=.9�2�-:�e=._*Rb-.3G3O/�3FR>2�9!-:ROKNMb-:0e}?G26�f�¼_*0e}J2�<V3OR>=J=*}#-.3GRwI*2�}J243LKPQ.0#=:C]}J/.243�Y,}J<>_*Q13�Ye-D0e}�-:01RFKX�JKP=.RFK`M�3¨KN3(0*=:?�'

�� �������� ���¢��b'Jg(�P�e2�<wRV3�Ye¡i'*��<V-"/.Y1+*',\^2�?GKN3�Yea�'*�(-"�]Y1¥i',�G=.�e2�<wRV3�Y*-:0e}�+*'*¡i'J78-:RV3F=.0��V¶4³S².«J�VY�� � - r � qSo�� )�� ��� � � �

n�� -�� -��WY,¯�-:<O�N-:0e}�@B_*�J�fKN3OIJKP0*Qt;�=e'PY*�(2�? £B=.<>���*~*~z'eº.º.·u��¬.·.³*'gi'.g�3O~e24M6R�-D0e}!@y'*¯b<V-:0*Q:KP2�<b�V¶4³S².ºJ�VY*��)[243ORV3B=DCH��26������3¨��0*24�S_e-"�fKXRFKX243w�*YJKP0�� � � � � l )�� � � � n�� - � � � � qSn )�� � l

� ��� ����- o ��� � �"l ) r�l� ���� � - qSo>l � � n�� -�������� - � q � �/- � -�� � - o ) �1-�� n Y¼@y'y\z-:IJROK¨-:0e}�@y'Ba�KPR>RF�X243FRV-.}JR4Y&�}SKPR>=.<V3b�L7t=.<O�N}�Z1MwKP2�01RFK�{|Mi@�_*�J��KN3OIJKP0*Qd;]=e'PY,Z:KP0*Q1-:~,=.<>2:�V'

gi'^g¤3O~,24M6Ri�V¶4³.²S¬J�VY¼��)[243ORV3�=:Cx��26�f����3��L0*24�._e-"�fKPROKP243i?GKPR>It@B-"KP<V3�=:C(\^=:? &�0*2�<>Q./t;�=.<><>26�N-:R>24}�@BI*=.Rw=.0e3>�*Y�KP0a�=J=.<>2 � Z1M6_J�f�P/t�V¶"³.².¬J�V'

\B'e&�'*�x-u���P2�0JROKP0*2��V¶4³�®u·J�VYe��)¨I*2iZ.RV-:ROKN3OROKNM�-"�y��0JR>2�<>~*<>2�RV-DROKP=.0�=:CGµ(_e-:01Rw_*9 a�24M>Ie-:0JKNM�3>��Ye�G2�U^'ea�=�}^'e@�I1/*3�'��� Y*~*~z',«.º.²"��«S²*¶.'

+*'^Ze',�]26�f�G�V¶4³.¬D¸*�VY|�uc(0�R>I*2�&�@]� @B-:<6-.}J="���*YJ@BIJ/�3WK`M�3 �eY�~*~z'z¶4³.º:��¦S·.·*Y+*'^Ze',�]26�f�]�6¶4³.¬.¬J�6Y|�"c(0�R>I*2�@B<>=S�J�X2�9 =:C��¨KN}*}J2�0�©]-:<OKN-:�J�P243GKP0dµ(_e-:01Rw_*9 a�24M>Ie-:0JKNM�3 s Ye�G2�U^'ea�=�}^'e@�I1/*3�'

!#" Y*¸S¸*®1'+*'^Ze',�]26�f�]�6¶4³.²J®.�6Y � �$- q � q1k - q � ��$ � l � - q � q1k - )��&% � q � n � �'� - r �Jq � ) r�l Y*;x-D9��*<FK`}JQS2�T(0JKPU.2�<V3WKXRO/#@�<>243>3�'

;�=.01R6-"KP0e3G<>2�~*<OKP0JRV3G=:C]-"�f�¼=:C]��26������3�~e-:~,2�<V3(=S0#&]@]� _*~#R>=#¶"³.²J®1'��'x��=.I*<��V¶4³.«SºJ�VY(�";x-:0 µ(_e-:0JR>_*9°a�24M>Ie-:0JKNM�-"��¡b243>M6<OKP~*ROKP=.0�=:C��¨24-"�fKXRO/§�e2�;]=.0e3LKN}J2�<>24} ;]=.9 ~J�P2�R>2:±��*Y

@�I1/*3�'e�¨2�U|' �(" Ye¬S³.¬*'¯�'J\B'*��<>2�R>R>I*=.<63OR(�V¶"³.².²J�VY �(q � - l ) q � � � - r4npo � � j � q �"l ) l�q � �)� q.oOq �1- n - o � l�n ) � qSn )�� ���^Z.~*<OKP0*Q.2�<�\^24M6R>_*<w2

��=.R>243xKX0dZ.RV-:ROKN3ORFK`M�3�Y*©B=:��'*¸1²*'gi'e&yKP0e3OR>26KP0zY^�b'e@y=�}J=D�`3F�1/.Ye-D0e}���'e�¨=13O2�0t�6¶4³.«.ºJ�6Y|�";x-D0�µ(_e-:01Rw_*9 a�24M>Ie-:0JKNM�-"�B¡b243>M6<OKP~*ROKP=.0#=DC��G24-u��KPRO/

�,2 ;]=S0e3LKN}J2�<>24}�;]=S9 ~J�P2�R>2:±m�*Y,@BIJ/�3�',�G2�U|' �+* Y�®.®.®1'gi'eªG'*�(_J�J�P2�/t�V¶4³SºJ®.�VYJ@B<>=.Q,'���KP=.~*IJ/�3�'^;]I*2�9#' * Ye¦.º.º�'&('*)�',+.-"/10*243b�6¶4³.¬.ºJ�6Y|�"¯�KX�*�e3¨U�3(��=:�PR���9-:0*0#&B0JR><>=.~JKP243>��Y1gb9#'e+�'e@BIJ/�3�' !#! Ye«S³*¶6��«.³S²*'.�G2�~*<OKP0JR>24}%KX0#&�'

)¢'.+.-"/10*243�Y�� q �$- owl � �,� o � kwq1k )� ) n � � � npqSn ) l�n ) r�l(q � � � npqSn ) l�n ) r6q -� � �"l ) r�l Y:��'J¡i'.�G=13O2�0*�J<V-:0JR��.Y.&]}SKPR>=S<4Y¡i'*�G26KN}J26�x@�_*�J��KN3OIJKP0*Qd;]=e'PY*¡b=.<V}J<w24M>IJRO����=:�f�N-:0e}��V¶4³.²S«J�V'

&('*)�',+.-"/10*243b�6¶4³J®u«J�6Ye�"Z._*<>U.2�/=:CBR>I*2�@B<>243F2�01RbZ.RV-:Rw_e3]=DC���2�=�Mw�N-.3w3LKNM�-"����-.}SKN-:ROKP=.0#)GI*2�=.<w/��*YSKP0.� o � r -*- ��/)�� � l � � n�� -103254�67� � r � - l�n - o � � � � - o - � r - � �98 � n ) rVq :� � � - o - � r -1Yz\B'za�-:0e}J26� � &('^7d=:�fCFY^24}SKPR>=.<63�Y@y2�<wQ1-:9 =.0�@B<w243>3�Ye��2�? £B=.<>�^'

Page 27: McGill CIMmgarden/pubs/jaynes-mystery.pdf · s [ · [ a « !"$# % KN3 & ' =.0 $)(* ' $,+ - + .+ 0/ ¸

¦J® ¦J®

&('�)�']+.-"/J0*243��V¶"³.².ºJ�VY(�"¯b2�0*2�<V-"�fK ��24} Z1M�-:R>R>2�<OKP0*Q1��YyKP0 � q �/) ��� � � � npo ��� �tq � � �(q � - l ) q ����- n�� � � l )����� � - o>l -:� o � k -�� l Y:;b'u��'JZ.9�KXRwI �§7 ':)�'S¯�<V-D0e}J/.Y.&]}SKPR>=.<V3�Yu¡i':�G26KN}J26��@�_*�J��KN3OIJKP0*Q�;�=e'PY4¡b=.<6}J<>24M>IJRO���=:�f�N-:0e}��,~*~z'e«J®.®��*«.³.²*'

&(',)�'*+.-"/10*243¢�V¶4³.²S¬J�VY|��@B<>24}SKNM6ROKPU.2�Z.RV-:ROKN3OROKNM�-"�Ba#24MwIe-:0JKNM�3>�*Y�KX0�a�=1=.<w2 ��Z1M6_J���P/d�V¶4³.².¬�� �.~*~z'^«.«"��ºS¬*'��'e+:26�z<>2�/*3b�V¶4³.«�¶:�VY � r ) -�� n ) � r � � � - o - � r -1Y�;x-:9i�*<OKN}JQ.2�T�0JKPU.2�<V3LKPRO/#@B<>243w3�S�`-DR>2�<(24}SKPROKP=.0e3i¶4³.º�®1Y^¶4³J®u«*'��'e+:26�z<>2�/*3b�V¶4³.«S³J�VY�� � - � o � � � � o � kwq1k )� ) n � Y,cG�1Cp=.<V}�T�0JKPU.2�<V3LKPRO/#@B<w243>3�J01_*9�2�<>=._e3��N-:R>2�<b24}SKPROKP=.0e3�'@y'e¥b0JKPQ.IJR��V¶"³.²J®.�VY^�"Z:KP0*Q:�P26��-:R>=S9 a�-.3O2�<V3G-:0e}%R>I*2iµ(_e-:0JR>_*9 �b-:R>_*<>2�=:C]\,KPQ.IJRV�*Ye�b-:R>_*<w2.Y !(��� Ye«.¦S³*'gi'�\�'1\^2�I*0JKP0*Q.2�<��V¶4³.²S¦J�VY � )�� r � - �1) l�npo � ��� � - � � - r � q.o �(q:l ) l � �)� - � � npo � r"n � o - q � � � � r"n )�� �¼YS7t=.<>R>I

@�_*�J�fK`3FI*2�<V3�Y,��0eM:'PY,¸.¸.¸ @B-:<>��g�U.2.'�Z.=._*R>IzYe��2�? £B=.<>���*~z'e«S².«*'¯�',)�'|a�=J=.<>2 � a�'zc�'[Z1M6_J�f�P/.Y¼&]}SKPR>=S<V3��6¶4³.².¬J�6Y o � � n ) - o>l � ��� � � -����()� k�o )�� � � npq.n ) l�n ) r6q (� � �"l ) r�l �*@�<>=.�

M62�24}SKP0*Q13�=:C(R>I*2���g])bc g¤}JU:-:0eM624}�Z.Rw_e}J/t��0e3ORFKXRw_*R>2.Y�Z1-:01R6-#ª*2.Yy+:_*0*2t¶4³.²D¸ �z@y�P2�0J_*9 @B<>243w3�Y¼��2�?£B=S<>�|'

c�'e@y2�0*<>=J3O2i�V¶4³J®:·J�VY5 � � � � q.n )�� � l � � � npq.n ) l�n ) rVq #��- r �1q � ) r�l Y�@y2�<wQ1-:9 =.0�@B<w243>3�Y,cG�1Cp=.<V}���~z'z¶4¬.·*'¯�'*�G2�9�~e2.Y^��'*7�-"�PR>I*2�<4Ye��'e¥��P26KP08�6¶4³.²J®.���1@BIJ/*3�'e�G2�U^'|\�2�R " Ye«.º.«Ze'e�G= ��2�01RV-u�ûY^&]}SKPR>=S<��V¶4³.¬D¸*� ��� ) -� l�� � �Jo ��� ) l ) � - q � ��� � o � q:l�l - -�� k �� ) l o ) - � � l�q � � � � � - q � �(- l Y

+�'*7§K��P2�/�� Z.=.0e3�Y*�L0eM:'PYe��2�? £B=.<>�^'��'^Z.IJKP9iK ��_8�6¶4³J®u³J�6Y.g�}JU|'e��KP=.~*IJ/�3�' � ! Yz¶4³Sº"��¦J®u²�'��'^Z:KP9 =.0 � ��'e�G243wM>I*2�<��V¶4³.¬S¬J� �|�u;x-:_e3O2�-:0e}�;�=._*01Rw2�<OCû-SM6R>_e-"�N�*Y*@BIJKf��'yZ1MwK�' ! ! Y|«.¦S«"��«:¸1·�';�'e@y'^Z:�fKNMwI1R>2�<"Y^�V¶4³.²S·J�VY5� o )�� r ) � - l � � � q � � - n ) r � - l � � q � r -JYeZ.~*<FKX0*QS2�<4Y|��2�? £B=.<w�|'gi' �e26�f�P0*2�<i�V¶4³.²:¸��VY �(q:l ) r � l6l �(- l )��7� r � � � �1- npo ) r�l Y*T(0JKPU^'z;�IJK`M�-DQ.=!@B<w243>3�J~*~z'|«Sº"�e®4¸e'

Ù �:ÓOÅ�¿6Ì �4Ö ÅL¿� ���4É��SÝVà"à ��Ý� � ��