“Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts:...
Transcript of “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts:...
![Page 1: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/1.jpg)
“Year 2020” -Topics inInformation Theory for Further
Studies
![Page 2: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/2.jpg)
Comprestimation
![Page 3: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/3.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 104
Comprestimation
lossy compression of ”non-natural”images (regular lossy compression usesMSE)
compression of images so that thestatistical inferences on thecompressed images remain valid
E.g. compression of microarray images
![Page 4: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/4.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105
Microarray images
![Page 5: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/5.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 106
Comprestimation cont.
also known as ”Multi-terminal datacompression”
T. Han & S.Amari; R. Jörnsten & B. Yu;
![Page 6: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/6.jpg)
Algorithmic Information Theory
![Page 7: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/7.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 108
Algorithmic Information Theory
…as used by Chaitin for ”meta-mathematics”
incompleteness theoremsGödel (logic)Turing (algorithm)The Halting Probability Omega (information,
randomness)
http://www.umcs.maine.edu/~chaitin/
![Page 8: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/8.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 109
Physics, information and games
![Page 9: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/9.jpg)
2020: Quantum Odyssey“On Quantum Computing and information transmission”
![Page 10: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/10.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 111
Motivation Computers as physical systems Technological issues
miniaturization and speedup - Moore’s lawneed for energy efficiency
![Page 11: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/11.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 112
Why would we bother?
Cryptography: QC can break RSA codes Communication of messages that betray
the presence of eavesdropping Teleportation: moving qubits around
without having them ever beingtransmitted over an insecure channel
![Page 12: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/12.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 113
Central concepts Superposition: a “blend” of 0 and 1
simultaneously, i.e., quantum parallelmode
http://www.quantiki.org Reversible computing: logical
irreversibility implies thermodynamicirreversibility (i.e., heat dissipation)
Charles Bennett0
10 0 1
![Page 13: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/13.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 114
Wave/particle duality
![Page 14: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/14.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 115
Mach-Zehnder interferometer
![Page 15: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/15.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 116
The Capabilities of Computers
(Deterministic)Turing Machine
ProbabilisticTuring Machine
QuantumTuring Machine
![Page 16: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/16.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 117
Proving vs. providing proof
QTM can simulate a TM - QTMuniversal
TM provides a proof as the sequence ofsteps performed
QTM can provide an answer without aproof trace (worse: if you try to “peek”QTM that would disrupt the proof!)
![Page 17: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/17.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 118
Bits and Qubits
Each bit is represented by the state ofa simple 2-state quantum system e.g.,spin state)
We need finite dimensional Hilbertspace
ω2
ω1
ω0
“Complex linear vector space”
![Page 18: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/18.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 119
Bra-ket
For a simple two-state system you canwrite the state as a “ket (vector)”
!"
#$%
&'+=
1
01100 |||
(
()()()
Probability interpretation
!"
=
=1
0
2
2
)|statein system(n
i
i
i
iP
#
#$
![Page 19: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/19.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 120
Unitary operators
2-state system has 2 eigenstates called|ψ0> and |ψ1> (basis)
!"
#$%
&=!
"
#$%
&+!"
#$%
&=
!"
#$%
&=!
"
#$%
&=
1
0101
0
0
1|
1
01|,
0
10|
'
'''(
![Page 20: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/20.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 121
Unitary operators continued To change the quantum world one needs
an operator, e.g. NOT
0|0
1
1
0
01
101|NOT
,1|1
0
0
1
01
100|NOT
=!"
#$%
&=!
"
#$%
&!"
#$%
&=
=!"
#$%
&=!
"
#$%
&!"
#$%
&=
One can also have non-classical gatessuch as NOT
![Page 21: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/21.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 122
Universality In classical computation AND and NOT
are enough to build any circuit In quantum computing it is enough to
use a 2-qubit gate (Barenco et al)
!!!!!
"
#
$$$$$
%
&
'
'=
+
'
)cos()sin(00
)sin()cos(00
0010
0001
),,(ˆ
)(
)(
((
((()*
)()
())
ii
ii
eie
ieeA
![Page 22: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/22.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 123
Fundamentals One can have quantum interference
whenever there is more than one way ofobtaining a particular result
measuring a quantum system:if the system is in eigenstate the outcome
is one of the eigenvaluesif the system is in superposition state the
result is given by
0 20 40 60 80 100
0
20
40
60
80
100
50.0
!"
=
=1
0
2
2
)|statein system(n
i
i
i
iP
#
#$
![Page 23: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/23.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 124
“A good quantum calculation”
Create a superposition of registerelements
Calculate in “one shot” all functionvalues F(j)
Do something clever with all the F(j)values(Use interference to increase the amplitudes andthus probabilities of the solution states)
![Page 24: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/24.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 125
Quantum entanglement (EPR)
If two systems (particles) are“Quantum correlated” one talks aboutentanglement
For entangled particles their joint stateis not factorizable as the directproduct of two simpler states
Produced by conservation of someattribute
![Page 25: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/25.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 126
Teleportation
1010010...
•dissociation•information transmission•reconstitution
![Page 26: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/26.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 127
Well, at least a qubit ...
![Page 27: “Year 2020” -Topics in Information Theory for Further Studies · 2006-10-12 · Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 105 Microarray images](https://reader033.fdocuments.us/reader033/viewer/2022042413/5f2d24dc79bda139a77ce53f/html5/thumbnails/27.jpg)
Three Concepts: Information ‘06 © Petri Myllymäki & Henry Tirri 2002-2006 128
Further topics
quantum search quantum cryptography dense coding random number generation breaking unbreakable codes quantum complexity theory ...