Classical Copying versus Quantum Entanglement in Natural...
Transcript of Classical Copying versus Quantum Entanglement in Natural...
![Page 1: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/1.jpg)
Classical Copying versus�antum Entanglement in Natural
Language: the Case of VP-ellipsis
Gijs Jasper Wijnholds1
Mehrnoosh Sadrzadeh1
�een Mary University of London, United Kingdom
SYCO 2
December 17, 2018
![Page 2: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/2.jpg)
DISTRIBUTIONAL SEMANTICS: MEANING IN CONTEXT
G. J. Wijnholds SYCO 2 2 / 41
![Page 3: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/3.jpg)
COMPOSINGWORD EMBEDDINGS: A CHALLENGE
Coordination−−−−−−−−−−−−−−−→dancing and running = ??
�antification−−−−−−−−−−−−−−−−−−−−−−−−→Every student likes some teacher = ??
Anaphora−−−−−−−−−−→shaves himself = ??
⇒ Ellipsis−−−−−−−−−−−−−−−−−−−−−−−−−−−−→Ma� went to Croatia and Max did too = ??
G. J. Wijnholds SYCO 2 3 / 41
![Page 4: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/4.jpg)
VERB PHRASE ELLIPSIS
I Ellipsis is a natural language phenomenon in which part of a phrase is
missing and has to be recovered from context.
I In verb phrase ellipsis, the missing part is… a verb phrase.
I There is o�en a marker that indicates the type of the missing part.
Bob drinks a beer︸ ︷︷ ︸ant VP
and Alice does too︸ ︷︷ ︸marker
G. J. Wijnholds SYCO 2 4 / 41
![Page 5: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/5.jpg)
VERB PHRASE ELLIPSIS
I Ellipsis is a natural language phenomenon in which part of a phrase is
missing and has to be recovered from context.
I In verb phrase ellipsis, the missing part is… a verb phrase.
I There is o�en a marker that indicates the type of the missing part.
Bob drinks a beer︸ ︷︷ ︸ant VP
and Alice does too︸ ︷︷ ︸marker
G. J. Wijnholds SYCO 2 4 / 41
![Page 6: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/6.jpg)
ELLIPSIS NEEDS COPYING AND MOVEMENT
ant VP marker
Bob drinks a beer
drinks a beer drinks a beer
and Alice does too
G. J. Wijnholds SYCO 2 5 / 41
![Page 7: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/7.jpg)
ELLIPSIS NEEDS COPYING AND MOVEMENT
ant VP marker
Bob drinks a beer
drinks a beer drinks a beer
and Alice does too
G. J. Wijnholds SYCO 2 6 / 41
![Page 8: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/8.jpg)
ELLIPSIS NEEDS COPYING AND MOVEMENT
ant VP marker
Bob drinks a beer
drinks a beer drinks a beer
and Alice �����does too
G. J. Wijnholds SYCO 2 7 / 41
![Page 9: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/9.jpg)
THE CHALLENGE: COMPOSE WORD VECTORS TO GET AMEANING REPRESENTATION FOR VP ELLIPSIS
G. J. Wijnholds SYCO 2 8 / 41
![Page 10: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/10.jpg)
THE BIG PICTURE
�antum Entanglement
SOURCE
L♦,FTARGET
FVectFunctor
Classical
SOURCE
L♦,FINTER
λNLTARGET
λFVecFrob
Hder Hlex
G. J. Wijnholds SYCO 2 9 / 41
![Page 11: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/11.jpg)
QUANTUM ENTANGLEMENT
G. J. Wijnholds SYCO 2 10 / 41
![Page 12: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/12.jpg)
LAMBEK VS. LAMBEK
The core of the Lambek calculus: application, co-application
B⊗ B\A→ A A→ B\(B⊗ A)
A/B⊗ B→ A A→ (A⊗ B)/B
(A⊗ B)⊗ C ↔ A⊗ (B⊗ C)
Interpretation: words have types, and type-respecting embeddings
Word Type embedding
john np−−→john ∈ N
sleeps np\s sleep ∈ N ⊗ S (← matrix)
likes (np\s)/np like ∈ N ⊗ S ⊗ N (← cube)
beer np−−→beer ∈ N
(Coecke et al., 2013)
G. J. Wijnholds SYCO 2 11 / 41
![Page 13: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/13.jpg)
IN PICTURES
A⊗ A\B→ B
A A B
B→ A\(A⊗ B)
A AB
B/A⊗ A→ B
A AB
B→ (B⊗ A)/A
A AB
(Coecke et al., 2013)
G. J. Wijnholds SYCO 2 12 / 41
![Page 14: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/14.jpg)
IN PICTURES
A⊗ A\B→ B
A A B
B→ A\(A⊗ B)
A AB
B/A⊗ A→ B
A AB
B→ (B⊗ A)/A
A AB
LINEAR‼
(Coecke et al., 2013)
G. J. Wijnholds SYCO 2 13 / 41
![Page 15: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/15.jpg)
LAMBEKWITH CONTROL OPERATORS: L♦,F
The core of the Lambek calculus: application, co-application
B⊗ B\A→ A A→ B\(B⊗ A)
A/B⊗ B→ A A→ (A⊗ B)/B
(A⊗ B)⊗ C ↔ A⊗ (B⊗ C)
Modalities: application, co-application
♦�A→ A A→ �♦AI Linear logic: controlled duplication/deletion of resources via
! = ♦�. Here: controlled copying, reordering
Controlled contraction, commutativity
A→ ♦A⊗ A (♦A⊗ B)⊗ C → B⊗ (♦A⊗ C)
♦A⊗ (♦B⊗ C)→ ♦B⊗ (♦A⊗ C)
G. J. Wijnholds SYCO 2 14 / 41
![Page 16: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/16.jpg)
ILLUSTRATION
Bob
ant VP
drinks a beer and Alice
marker
does too
np np\s
♦(np\s) np\s
(s\s)/s np ♦(np\s)\(np\s)
G. J. Wijnholds SYCO 2 15 / 41
![Page 17: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/17.jpg)
IN PICTURES
A⊗ A\B→ B
A A B
B→ A\(A⊗ B)
A AB
B/A⊗ A→ B
A AB
B→ (B⊗ A)/A
A AB
A→ ♦A⊗ A
A
◦
A A
(♦A⊗ B)⊗ C → B⊗ (♦A⊗ C)
A B C
B A C
G. J. Wijnholds SYCO 2 16 / 41
![Page 18: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/18.jpg)
QUANTUM ENTANGLEMENT AND ELLIPSIS
Bob
N
· · · · ·
drinks a beer
N ⊗ S
◦ ◦
and
S ⊗ S ⊗ S
· · ·
Alice
N
·
does too
N ⊗ S ⊗ S ⊗ N
· · · ·
G. J. Wijnholds SYCO 2 17 / 41
![Page 19: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/19.jpg)
QUANTUM ENTANGLEMENT AND ELLIPSIS
Bob
N
· · · · ·
drinks a beer
N ⊗ S
◦ ◦
and
S ⊗ S ⊗ S
· · ·
Alice
N
·
does too
N ⊗ S ⊗ S ⊗ N
· · · ·
·◦·
G. J. Wijnholds SYCO 2 18 / 41
![Page 20: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/20.jpg)
QUANTUM ENTANGLEMENT AND ELLIPSIS
Bob
N
· · ·
drinks a beer
N ⊗ S
(−→Bob �
−−→Alice)> ×
−−−−−−−−→drinks a beer
◦
Alice
N
·
G. J. Wijnholds SYCO 2 19 / 41
![Page 21: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/21.jpg)
A MORE COMPLICATED CASE: SLOPPY READING
Bob loves his beer and Alice does too
Bob loves Bob’s beer and Alice loves Bob’s beer
Bob
ant VP
loves
(np\s)/np
his
♦np\(np/n)
beer
n
and Alice
marker
does too
np
♦np np
♦(np\s)
np\s
np\s
(s\s)/s np ♦(np\s)\(np\s)
G. J. Wijnholds SYCO 2 20 / 41
![Page 22: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/22.jpg)
A MORE COMPLICATED CASE: SLOPPY READING
Bob loves his beer and Alice does too
Bob loves Bob’s beer and Alice loves Bob’s beer
Bob
ant VP
loves
(np\s)/np
his
♦np\(np/n)
beer
n
and Alice
marker
does too
np
♦np np
♦(np\s)
np\s
np\s
(s\s)/s np ♦(np\s)\(np\s)
G. J. Wijnholds SYCO 2 21 / 41
![Page 23: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/23.jpg)
A MORE COMPLICATED CASE: STRICT READING
Bob loves his beer and Alice does too
Bob loves Bob’s beer and Alice loves Alice’s beer
Bob
ant VP
loves
(np\s)/np
his
♦np\(np/n)
beer
n
and Alice
marker
does too
np
♦np np
♦(np\s)
np\s
np\s
(s\s)/s np ♦(np\s)\(np\s)
G. J. Wijnholds SYCO 2 22 / 41
![Page 24: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/24.jpg)
A MORE COMPLICATED CASE: STRICT READING
Bob loves his beer and Alice does too
Bob loves Bob’s beer and Alice loves Alice’s beer
Bob
ant VP
loves
(np\s)/np
his
♦np\(np/n)
beer
n
and Alice
marker
does too
np
♦np np
♦((np\s)/s ⊗ ( ♦np\n⊗ n)
)
(s\s)/s np ♦(np\s)\(np\s)
G. J. Wijnholds SYCO 2 23 / 41
![Page 25: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/25.jpg)
A More Complicated Case: Sloppy Reading
Bob
N
◦
· · · · · ·
loves
N ⊗ S ⊗ N
◦ ◦
his
N ⊗ N ⊗ N
·
beer
N
and
S ⊗ S ⊗ S
· · ·
Alice
N
·
does too
N ⊗ S ⊗ S ⊗ N
· · · ·· ·
G. J. Wijnholds SYCO 2 24 / 41
![Page 26: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/26.jpg)
A More Complicated Case: Sloppy Reading
Bob
N
◦
· · · · · ·
loves
N ⊗ S ⊗ N
◦ ◦
his
N ⊗ N ⊗ N
·
beer
N
and
S ⊗ S ⊗ S
· · ·
Alice
N
·
does too
N ⊗ S ⊗ S ⊗ N
· · · ·· ·
·◦··
◦·
G. J. Wijnholds SYCO 2 25 / 41
![Page 27: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/27.jpg)
A More Complicated Case: Sloppy Reading
Bob loves Bob’s beer and Alice loves Bob’s beer
Bob
N
Alice
N
◦
beer
N
· · · ·
loves
N ⊗ S ⊗ N
∆(Bob� Alice� Beer)ik lovesijk
G. J. Wijnholds SYCO 2 26 / 41
![Page 28: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/28.jpg)
A More Complicated Case: Strict Reading
Bob loves Bob’s beer and Alice loves Alice’s beer
Bob
N
Alice
N
◦
beer
N
· · · ·
loves
N ⊗ S ⊗ N
∆(Bob� Alice� Beer)ik lovesijk
G. J. Wijnholds SYCO 2 27 / 41
![Page 29: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/29.jpg)
A More Complicated Case: Strict Reading
Bob loves Bob’s beer and Alice loves Alice’s beer
Bob
N
Alice
N
◦
beer
N
· · · ·
loves
N ⊗ S ⊗ N
∆(Bob� Alice� Beer)ik lovesijk
G. J. Wijnholds SYCO 2 27 / 41
![Page 30: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/30.jpg)
WHAT NOW?
Classical Semantics
G. J. Wijnholds SYCO 2 28 / 41
![Page 31: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/31.jpg)
WHAT NOW?
Classical Semantics
G. J. Wijnholds SYCO 2 28 / 41
![Page 32: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/32.jpg)
General Interpretation
The syntax-semantics homomorphism interprets types and proofs of L♦,F as objects types and maps
terms in a compact closed category non-linear lambda calculus:
Type Level
bA⊗ Bc = bAc × bBc bA/Bc = bAc → bBc bA\Bc = bAc → bBc b♦Ac = b�Ac = bAc
Application, co-application
B× (B→ A)λxM.M x−−−−−−−→ A
λx.λy.〈y, x〉−−−−−−−−−→ B→ (B× A)
(B→ A)× BλMx.Mx−−−−−−→ A
λx.λy.〈x, y〉−−−−−−−−−→ B→ (A× B)
Modalities
♦,� are semantically vacuous, so only the control rules get a non-trivial interpretation:
Aλx.〈x, x〉−−−−−−−→ A× A (A× B)× C
λ〈x, y, z〉.〈y, x, z〉−−−−−−−−−−−−−→ B× (A× C)
G. J. Wijnholds SYCO 2 29 / 41
![Page 33: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/33.jpg)
Lambda term for simple ellipsis
Bob drinks and Alice does too
A proof of
(np ⊗ np\s)⊗ ((s\s)/s ⊗ (np ⊗ (♦(np\s)⊗ ♦(np\s)\(np\s)))) −→ s
gives term
λ〈subj1,verb,coord,subj
2,verb∗,aux〉.(coord ((auxverb∗)subj
2))(verbsubj
1)
The movement and contraction give
λ〈subj1,verb,coord,subj
2,aux〉.(coord ((aux verb) subj
2))(verb subj
1)
Plugging in some constants, we get an abstract term
(and ((dt drinks) bob))(drinks alice) : s
G. J. Wijnholds SYCO 2 30 / 41
![Page 34: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/34.jpg)
Modelling Vectors with Lambdas
Vector: λi.vi I → R (= V )
Matrix: λij.Mij I → I → R
� : λvui.vi · ui V → V → R
Vector � Vector: λv.v � v V → V
Matrix> λmij.mji M→ M
Matrix ×1 Vector λmvi.∑jmij · vj M→ V → V
Cube ×2 Vector λcvij.∑kcijk · vk C → V → M
(Muskens & Sadrzadeh, 2016)
G. J. Wijnholds SYCO 2 31 / 41
![Page 35: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/35.jpg)
Classical Semantics for simple ellipsis
Bob drinks and Alice does too
(λP.λQ.P � Q ((λx.x (λv.drinks×1 v)) bob))((λv.(drinks×1 v)) alice)
→β (λP.λQ.P � Q ((λv.drinks×1 v) bob))((λv.(drinks×1 v)) alice)
→β (λP.λQ.P � Q (drinks×1 bob))(drinks×1 alice)
→β (drinks×1 bob)� (drinks×1 alice)
G. J. Wijnholds SYCO 2 32 / 41
![Page 36: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/36.jpg)
Classical Semantics for Ambiguous Ellipsis
Bob loves Bob’s beer and Alice loves Bob’s beer (sloppy)
(bob×1 loves×2 (bob�beer))� (alice×1 loves×2 (bob�beer))
Bob loves Bob’s beer and Alice loves Alice’s beer (strict)
(bob×1 loves×2 (bob�beer))�(alice×1 loves×2 (alice�beer))
G. J. Wijnholds SYCO 2 33 / 41
![Page 37: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/37.jpg)
Conclusion 1: Classical vs. �antum Entanglement
Developing Frobenius Semantics fits easily in the DisCoCat
framework, but fails to give a proper account for more complex
examples of ellipsis.
Classical Semantics are more involved and are non-linear, but give a
be�er account of derivational ambiguity.
G. J. Wijnholds SYCO 2 34 / 41
![Page 38: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/38.jpg)
LET THE DATA SPEAK
G. J. Wijnholds SYCO 2 35 / 41
![Page 39: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/39.jpg)
EXPERIMENTINGWITH VP ELLIPSIS
I GS2011 verb disambiguation dataset (200 samples):
man draw photograph ∼ man a�ract photograph
man draw photograph ∼ man depict photograph
I KS2013 similarity dataset (108 samples):
man bites dog ∼ student achieve result
I We extended the above datasets to elliptical phrases (now with 400/416 sentence pairs)
man bites dog and woman does too ∼ student achieve result and boy does too
I Run experiments with several models:
Linear
−−→subj ?
−−→verb ?
−→obj ?
−→and ?
−−→subj∗ ?
−−→does ?−→too
Non-Linear
−−→subj ?
−−→verb ?
−→obj ?
−−→subj∗ ?
−−→verb ?
−→obj
Lambda-Based T(−−→subj, verb,
−→obj) ? T(
−−→subj∗, verb,
−→obj)
Picture-Based T(−−→subj ?
−−→subj∗, verb,
−→obj)
where ? is addition or multiplication, and T is some a�ested model for a transitive
sentence.
G. J. Wijnholds SYCO 2 36 / 41
![Page 40: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/40.jpg)
EXPERIMENTINGWITH VP ELLIPSIS: DISAMBIGUATIONRESULTS
CB W2V GloVe FT D2V1 D2V2 ST IS1 IS2 USE
Verb Only Vector .4150 .2260 .4281 .2261
Verb Only Tensor .3039 .4028 .3636 .3548
Add. Linear .4081 .2619 .3025 .1292
Mult. Linear .3205 -.0098 .2047 .2834
Add. Non-Linear .4125 .3130 .3195 .1350
Mult. Non-Linear .4759 .1959 .2445 .0249
Best Lambda .5078 .4263 .3556 .4543
2nd Best Lambda .4949 .4156 .3338 .4278
Best Picture .5080 .4263 .3916 .4572
Sent Encoder .1425 .2369 -.1764 .3382 .3477 .2564
Sent Encoder+Res .2269 .3021 -.1607 .3437 .3129 .2576
Sent Encoder-Log .1840 .2500 -.1252 .3484 .3241 .2252
Table: Spearman ρ scores for the ellipsis disambiguation experiment. CB: count-based,W2V: Word2Vec, FT: FastText, ST: Skip-Thoughts, IS1:InferSent (GloVe), IS2: InferSent (FastText), USE: Universal Sentence Encoder.
G. J. Wijnholds SYCO 2 37 / 41
![Page 41: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/41.jpg)
EXPERIMENTINGWITH VP ELLIPSIS: SIMILARITY RESULTS
CB W2V GloVe FT D2V1 D2V2 ST IS1 IS2 USE
Verb Only Vector .4562 .5833 .4348 .6513
Verb Only Tensor .3946 .5664 .4426 .5337
Add. Linear .7000 .7258 .6964 .7408
Mult. Linear .6330 .1302 .3666 .1995
Add. Non-Linear .6808 .7617 .7103 .7387
Mult. Non-Linear .7237 .3550 .2439 .4500
Best Lambda .7410 .7061 .4907 .6989
2nd Best Lambda .7370 .6713 .4819 .6871
Best Picture .7413 .7105 .4907 .7085
Sent Encoder .5901 .6188 .5851 .7785 .7009 .6463
Sent Encoder+Res .6878 .6875 .6039 .8022 .7486 .6791
Sent Encoder-Log .1840 .6599 .4715 .7815 .7301 .6397
Table: Spearman ρ scores for the ellipsis similarity experiment. CB: count-based,W2V: Word2Vec, FT: FastText, ST: Skip-Thoughts, IS1: InferSent(GloVe), IS2: InferSent (FastText), USE: Universal Sentence Encoder.
G. J. Wijnholds SYCO 2 38 / 41
![Page 42: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/42.jpg)
Conclusion 2: Classical vs. �antum Entanglement
Experimentally, the linear approximation that Frobenius Semantics
gives is equally performant to the classical semantics!
G. J. Wijnholds SYCO 2 39 / 41
![Page 43: Classical Copying versus Quantum Entanglement in Natural ...events.cs.bham.ac.uk/syco/2/slides/wijnholds.pdf · VERB PHRASE ELLIPSIS I Ellipsis is a natural language phenomenon in](https://reader036.fdocuments.us/reader036/viewer/2022071218/604e506766b190475440f4d3/html5/thumbnails/43.jpg)
Future Work
1. Entailment:
Dogs sleep and cats too⇒ cats walk
2. Guess the antecedent (ambiguity!):
Dogs run, cats walk, and foxes …
3. Negation:
Dogs sleep but cats do not.
G. J. Wijnholds SYCO 2 40 / 41