SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model...

22
1 Statistical NLP Spring 2010 Lecture 21: Coreference Resolution Dan Klein – UC Berkeley

Transcript of SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model...

Page 1: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

1

Statistical NLPSpring 2010

Lecture 21: Coreference Resolution

Dan Klein – UC Berkeley

Page 2: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

2

Page 3: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

3

Page 4: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

4

Page 5: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

5

Page 6: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

6

Page 7: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

7

Page 8: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

8

Infinite Mixture Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Enriching the Mention Model

W

Z

Mention Model

P(W | Weir Group):

“Weir Group”=0.4,

“whose”=0.2,

.......

Page 9: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

9

Enriching the Mention Model

Pronoun

W

Z

TGNNumber

Sing, Plural

W

Z

Non-Pronoun

Gender

M,F,N

Type

PERS, LOC,

ORG, MISC

Enriching the Mention Model

W | SING, MALE, PERS

“he”:0.5, “him”: 0.3,...

W | PL, NEUT, ORG

“they”:0.3, “it”: 0.2,...

Entity Parameters

Pronoun Parameters

W

Z

TGN

Pronoun

Page 10: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

10

Enriching the Mention Model

Pronoun

W

Z

TGN

W

Z

Non-Pronoun

Enriching Mention Model

M

Pronoun

Non-pronoun

Mention Type

Proper,

Pronoun,

Nominal

W

Z

TGN

Page 11: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

11

Enriching Mention Model

.....

W

Z

W

Z

..... .....

Enriching Mention Model

.....

M

W

Z

TGN

M

W

Z

TGN

..... .....

Page 12: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

12

Pronoun Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 13: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

13

Page 14: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

14

Page 15: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

15

Page 16: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

16

Salience Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 17: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

17

HDP Model

MUC F1

The Weir Group , whose headquarters is in

the U.S is a large specialized corporation.

This power plant , which , will be situated in

Jiangsu, has a large generation capacity.

Page 18: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

18

Global Entity Resolution

Bush he Rice

Rice Bush she

Experiments

� MUC6 English NWIRE (all mentions)

� 53.6 F1* [Cardie and Wagstaff 99] Unsupervised

� 70.3 F1 [Haghighi & Klein 07] Unsupervised

� 73.4 F1 [McCallum & Wellner 04] Supervised

� 81.3 F1 [Luo et al 04] Supervised+Oracle

• MUC score, not all systems are completely comparable

• Why not: some assume oracle gives boundaries, NER

types, etc.

Page 19: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

19

* Now system mentions!

These are “real numbers”

Page 20: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

20

Page 21: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

21

Page 22: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments

22