Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2...
Transcript of Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2...
![Page 1: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/1.jpg)
Jointly Extracting Event Triggers and Argumentsby Dependency-Bridge RNN
and Tensor-Based Argument Interaction
Feng Qian⇤, Lei Sha⇤, Baobao Chang, Zhifang Sui
Institute of Computational Linguistics, Peking University
{nickqian, shalei, chbb, szf}@pku.edu.cn
November 29, 2017
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 1 / 27
![Page 2: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/2.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 2 / 27
![Page 3: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/3.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 3 / 27
![Page 4: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/4.jpg)
Introduction
Event extraction is important for knowledge acquisition from largeamounts of news text.
The result of event extraction can be used to construct knowledgebase, which can be applied to question answering, dialogue system,etc.
Its paradigm is ubiquitous in our daily life:Knowledge GraphStructured summary of search engineWikipedia infobox
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 4 / 27
![Page 5: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/5.jpg)
Applications of Event Extraction
The Google search result of September 11 attacks:
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 5 / 27
![Page 6: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/6.jpg)
Applications of Event Extraction
The Wikipedia infobox of September 11 attacks:
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 6 / 27
![Page 7: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/7.jpg)
Applications of Event Extraction
The extracted events can be transferred into triples and store in theknowledge graphs.The knowledge graphs can be leveraged by upper applications.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 7 / 27
![Page 8: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/8.jpg)
Event Extraction
What’s an event?
Event Type: BusinessTrigger Release
ArgumentCompany MicrosoftProduct Surface ProPlace USA
Figure: Microsoft releases surface Pro in USA.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 8 / 27
![Page 9: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/9.jpg)
Event Extraction
What’s an event?
Event Type: AttackTrigger Crash
Argument
Attacker Five hijackers
TargetWorld Trade Center’s
North TowerInstrument American Airlines Flight 11
Time September 11th
Figure: On September 11th, five hijackers crashed American Airlines Flight 11into the World Trade Center’s North Tower.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 9 / 27
![Page 10: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/10.jpg)
Event Extraction from News Text
What should we do?
Extract trigger
Identify arguments
Classify roles
Event Type: DieTrigger Die
ArgumentVictim cameramanPlace Baghdad
Instrument American tank
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 10 / 27
![Page 11: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/11.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 11 / 27
![Page 12: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/12.jpg)
Motivation
Challenges of event extraction by the previous solutionsp
Using syntax information as feature
⇥ Using syntax information as architecturep
Capture two kinds of argument-argument relationship (Pos & Neg)
⇥ Capture large amount of argument-argument relationship
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 12 / 27
![Page 13: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/13.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 13 / 27
![Page 14: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/14.jpg)
Event Extraction from News Text
Motivation 1:
Dependency relation �! Dependency bridge
According to definition of dependency relation, dependency edgesusually contain some information about temporal, consequence,conditional or purpose.
Figure: Example of dependency parse tree.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 14 / 27
![Page 15: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/15.jpg)
Event Extraction from News Text
We add dependency bridges to conventional LSTM-RNN architecture.Bidirectionality:
Forward: Set all dependency bridges as forward.Backward: Set all dependency bridges as backward.
A cameraman died when tank fired on the hotel
LSTM layer
Figure: Dependency bridge on LSTM. Apart from the last LSTM cell, each cellalso receives information from former syntactically related cells.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 15 / 27
![Page 16: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/16.jpg)
Event Extraction from News Text
Details of dependency bridge
We add a new gate dt and change the calculation of hidden state.
ht = ot � tanh(ct) + dt �⇣
1
|Sin|P
(i ,p)2Sin aphi
⌘
"#
$ $ %&'ℎ $
× +
×%&'ℎ×
ℎ#
+# ,# -#~ /#
-#01
ℎ#01
-#
ℎ#
"#
$ $ %&'ℎ $
× +
×%&'ℎ×
ℎ#
+# ,# -#~ /#
-#01
ℎ#01
-#
ℎ#
$
×
234567
2345894
2:;<=>
ℎ?ℎ>ℎ@
A#
+
Figure: The calculation detail of dependency bridge.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 16 / 27
![Page 17: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/17.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 17 / 27
![Page 18: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/18.jpg)
Event Extraction from News Text
Motivation 2:
We represent each arg-arg relationship by a vector
We use a tensor to represent all kinds of arg-arg relationships in asentence
Tensor layerDN
N
Representation of Candidate Arguments
Figure: The calculation detail of tensor layer.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 18 / 27
![Page 19: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/19.jpg)
Event Extraction from News Text
The whole architecture ...
Tensor layer is applied to the hidden layer of the dependency bridgeRNN
Then we apply max-pooling over arguments to find the mostimportant “interactive features” for the arguments
Tensor layer
...
A
cameraman
died
when
tank
fired
on
the
hotel
Candidate trigger
Candidate Arguments
DB
LS
TM
-RN
N
DBRNN layer Pooling layer Output layer
DN
N
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 19 / 27
![Page 20: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/20.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 20 / 27
![Page 21: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/21.jpg)
Weights of each dependency relation
Figure: The visualization of trained weights of each dependency relations.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 21 / 27
![Page 22: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/22.jpg)
Overall performance
Figure: Performances of various approaches on ACE 2005 dataset.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 22 / 27
![Page 23: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/23.jpg)
Ablation tests – dependency bridge
Binary DB: The weight of DB belongs to 0, 1
Typed DB: The weight of DB can be any float numbers
MethodTrigger Argument Argumentid+cl id id+cl
Our model without DB 69.0 62.7 54.6+ binary DB 71.2 63.9 56.8+ typed DB (full) 71.9 64.4 57.2
Table: Comparison after adding dependency bridges (DB). The numbers are F
1
scores. We compare with two baselines: no dependency bridges considered andonly binary dependency bridges.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 23 / 27
![Page 24: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/24.jpg)
Ablation tests – Tensor layer
dbRNN-SMA: only cast SMA away from the whole model
dbRNN-MP: means cast the max-pooling feature matrix away
dbRNN-TL: dbRNN without tensor layer
dbRNN full model
Method 1/1 1/N AlldbRNN-SMA 59.5 67.0 64.1
Argument dbRNN-MP 59.7 64.8 62.0Identification dbRNN-TL 59.6 55.8 58.2
dbRNN 59.9 69.5 67.7dbRNN-SMA 54.6 56.5 56.0
Argument Role dbRNN-MP 54.7 55.8 55.2Classification dbRNN-TL 54.9 52.3 53.1
dbRNN 54.6 60.9 58.7
Table: Comparison between di↵erent models. Here, we report the argumentperformance since the tensor layer is only applied to argument extraction.
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 24 / 27
![Page 25: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/25.jpg)
Table of Contents
1 Introduction
2 Motivations
3 Dependency bridges
4 Tensor for various arg-arg relationships
5 Experiments
6 Conclusion
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 25 / 27
![Page 26: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/26.jpg)
Conclusion
In this paper:
We propose to add dependency bridges to sequential architecture
We propose to add tensor layer for capturing various of argumentrelationships
The weights of dependency bridges after training illuminates theimportance of each dependency type in event extraction task
The full model achieves high performance in all the three evaluationmetrics, trigger classification, argument identification and roleclassification
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 26 / 27
![Page 27: Jointly Extracting Event Triggers and Arguments by ... · Table of Contents 1 Introduction 2 Motivations 3 Dependency bridges 4 Tensor for various arg-arg relationships 5 Experiments](https://reader030.fdocuments.us/reader030/viewer/2022041022/5ed2ad924c315a2dfb309f64/html5/thumbnails/27.jpg)
Thank you. Any questions?
Feng Qian
⇤, Lei Sha
⇤, Baobao Chang, Zhifang Sui (ICL, Peking University)Jointly Extracting Event Triggers and Arguments by Dependency-Bridge RNN and Tensor-Based Argument InteractionNovember 29, 2017 27 / 27