Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley...

15
Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014 PL 2014 FHTW 1

Transcript of Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley...

Page 1: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 1

Finding Genealogy Factswith

Linguistic Analysis

Peter Lindes, Deryle W. Lonsdale, David W. EmbleyBrigham Young University

© 2014 Peter Lindes

3/19/2014

Page 2: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 2

Semi-Structured Text

3/19/2014

Page 3: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 3

A Simple Ontology

3/19/2014

Charles Christopher Lathrop

has

18651817

born on died on

Page 4: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 4

Unstructured Text

3/19/2014

Page 5: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 5

A More Complex Ontology

3/19/2014

Myra Harwood

Jonathan Squires

J. Wilbur Squires

Feb. 13, 1874

Page 6: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 6

OntoSoar Architecture

3/19/2014

Page 7: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 7

Two Cases

• Case 1:

3/19/2014

• Case 2:

Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

his widow married JONATHAN SQUIRES, who was born in Ohio, July 25, 1823, by whom she had one son, J. Wilbur, born June 16, 1865, in DeKalb county, Ind.

Page 8: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 8

Linguistic Analysis – Case 1A

3/19/2014

Charles Christopher Lathrop, …, b. 1817, d. 1865,

Page 9: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 9

Linguistic Analysis– Case 1B

3/19/2014

Charles Christopher Lathrop, … , son of Mary Ely and Gerard Lathrop ;

Page 10: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 10

Extracting Meaning – Case 1

3/19/2014

Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

Page 11: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 11

Linguistic Analysis– Case 2

3/19/2014

+--------MXsp--------+ +----MXs----+ +--------Xc--------+ +--------Os-------+--MX*x-+ +----Os---+ +---Xd--+ | +----TY---+ | +--Ds-+---Ss---+ +---G---+ +Xd+-Jr+-Cr+-Ss-+ +-Ds-+ | +--G-+Xca+-Xd-+--IN-+-TM+ +-Xd+Xc+ | | | | | | | | | | | | | | | | | | | | | |his widow.n married.v JONATHAN SQUIRES , by whom she had.v one son.n , J. Wilbur , born.v June 16 , 1865 ,

his widow married JONATHAN SQUIRES, …, by whom she had one son, J. Wilbur, born June 16, 1865, … .

Page 12: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 12

Extracting Meaning – Case 2

3/19/2014

his widow married JONATHAN SQUIRES, who was born in Ohio, July 25, 1823, by whom she had one son, J. Wilbur, born June 16, 1865, in DeKalb county, Ind.

Page 13: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 13

Meaning Structures Compared

3/19/2014

his widow married JONATHAN SQUIRES, who was born in Ohio, July 25, 1823, by whom she had one son, J. Wilbur, born June 16, 1865, … .

Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

Page 14: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 14

Evaluation

3/19/2014

Page 15: Finding Genealogy Facts with Linguistic Analysis Peter Lindes, Deryle W. Lonsdale, David W. Embley Brigham Young University © 2014 Peter Lindes 3/19/2014PL.

PL 2014 FHTW 15

Conclusions

Accomplishments• Preprocessor/Segmenter• Adapted LG Parser for

genealogy text• Built a construction grammar

meaning analyzer• Mapped meaning schemas to

user-defined ontologies• Integrated all into a single

processing pipeline• Partially implemented – works

well so far

Future work• Complete implementation• Evaluate on a broader

corpus• Explore using a named

entity recognizer• Build in much more

linguistic knowledge• Research how to make the

system learn linguistic knowledge

3/19/2014