Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech...

15
Introduction to Part of Speech Tagging Alan Ritter Many slides adapted from Brendan O’Connor Chris Manning

Transcript of Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech...

Page 1: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

IntroductiontoPartofSpeechTagging

AlanRitter

ManyslidesadaptedfromBrendanO’Connor ChrisManning

Page 2: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

Wherearewegoingwiththis?

• Textclassification:bagsofwords

• Sequencetagging• PartsofSpeech• NamedEntityRecognition• Otherareas:bioinformatics(geneprediction),etc…

Page 3: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

What’sapart-of-speech(POS)?

• Syntax=howwordscomposetoformlargermeaningbearingunits• POS=syntacticcategoriesforwords

• Youcouldsubstitutewordswithinaclassandhaveasyntacticallyvalidsentence

• Givesinformationhowwordscombineintolargerphrases

• Isawthedog• Isawthecat• Isawthe___

Page 4: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

PartsofSpeechisanoldidea

• PerhapsstartingwithAristotleintheWest(384–322BCE),therewastheideaofhavingpartsofspeech

• Schoolgrammar:noun,verb,adjective,adverb,preposition,conjunction,pronoun,interjection

• Manymorefinegrainedpossibilities

https://www.youtube.com/watch?v=ODGA7ssL-6g&index=1&list=PL6795522EAD6CE2F7

Page 5: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

Open class (lexical) words

Closed class (functional)

Nouns Verbs

Proper Common

Modals

Main

Adjectives

Adverbs

Prepositions

Particles

Determiners

Conjunctions

Pronouns

… more

… more

IBMItaly

cat / catssnow

seeregistered

canhad

old older oldest

slowly

to with

off up

the some

and or

he its

Numbers

122,312one

Interjections Ow Eh

Page 6: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

Openvs.Closedclasses

• Openvs.Closedclasses• Closed:

• determiners:a,an,the• pronouns:she,he,I• prepositions:on,under,over,near,by,…• Why“closed”?

• Open:• Nouns,Verbs,Adjectives,Adverbs.

Page 7: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

ManyTaggingStandards

• PennTreebank(45tags)…thisisthemostcommonone• Browncorpus(85tags)• Coarsetagsets

• UniversalPOStags(Petrovet.al.https://github.com/slavpetrov/universal-pos-tags)

• Motivation:cross-linguisticregularities

Page 8: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

Whatarepartsofspeechusefulfor?

• Phraseidentification(chunking)• Namedentityrecognition• InformationExtraction• Parsing

Page 9: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

QuickandDirtyNounPhraseIdentification

Page 10: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

POSTagging

• WordsoftenhavemorethanonePOS:back• Theback door =JJ• Onmyback =NN• Winthevotersback =RB• Promisedtoback thebill =VB

• ThePOStaggingproblemistodeterminethePOStagforaparticularinstanceofaword.

Page 11: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

POSTagging

• Input: Playswellwithothers• Ambiguity:NNS/VBZUH/JJ/NN/RBINNNS• Output: Plays/VBZwell/RBwith/INothers/NNS• Uses:

• Text-to-speech(howdowepronounce“lead”?)• Canwriteregexps like(Det)Adj*N+overtheoutputforphrases,etc.• Asinputtoortospeedupafullparser• Ifyouknowthetag,youcanbackofftoitinothertasks

PennTreebankPOStags

Page 12: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

POStaggingperformance

• Howmanytagsarecorrect?(Tagaccuracy)• About97%currently• Butbaselineisalready90%

• Baselineisperformanceofstupidestpossiblemethod• Tageverywordwithitsmostfrequent tag• Tagunknownwordsasnouns

• Partlyeasybecause• Manywordsareunambiguous• Yougetpointsforthem(the,a,etc.)andforpunctuationmarks!

Page 13: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

Decidingonthecorrectpartofspeechcanbedifficultevenforpeople

• Mrs/NNPShaefer/NNPnever/RBgot/VBDaround/RP to/TOjoining/VBG

• All/DTwe/PRPgotta/VBNdo/VBis/VBZgo/VBaround/INthe/DTcorner/NN

• Chateau/NNPPetrus/NNPcosts/VBZaround/RB250/CD

Page 14: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

HowdifficultisPOStagging?

• About11%ofthewordtypesintheBrowncorpusareambiguouswithregardtopartofspeech

• Buttheytendtobeverycommonwords.E.g.,that• Iknowthat heishonest=IN• Yes,that playwasnice=DT• Youcan’tgothat far=RB

• 40%ofthewordtokensareambiguous

Page 15: Introduction to Part of Speech Taggingaritter.github.io/courses/5525_slides/pos1.pdfParts of Speech is an old idea • Perhaps starting with Aristotle in the West (384 –322 BCE),

It’shardforpeopletoo!


Indirect Speech [Reported Speech]

Indirect Speech [Reported Speech]

1 6-Text To Speech (TTS) Speech Synthesis Speech Synthesis Concept Speech Naturalness Phone Sequence To Speech –Articulatory Approaches –Concatenative.

1 6-Text To Speech (TTS) Speech Synthesis Speech Synthesis Concept Speech Naturalness Phone Sequence To Speech –Articulatory Approaches –Concatenative.

Broadband Circularly Polarized Bowtie Dipole Antennaap-s.ei.tuat.ac.jp/isapx/2016/pdf/POS1-55.pdf · 2016. 9. 30. · Broadband Circularly Polarized Bowtie Dipole Antenna Zhi-Ya Zhang,

Broadband Circularly Polarized Bowtie Dipole Antennaap-s.ei.tuat.ac.jp/isapx/2016/pdf/POS1-55.pdf · 2016. 9. 30. · Broadband Circularly Polarized Bowtie Dipole Antenna Zhi-Ya Zhang,

Direct Speech into Indirect Speech

Direct Speech into Indirect Speech

Reported speech / Indirect speech

Reported speech / Indirect speech

Digital Speech ProcessingDigital Speech Processing ... speech... · speech interval Ending of speech interval. Speech Detection Examples case of low background noise => can find beginning

Digital Speech ProcessingDigital Speech Processing ... speech... · speech interval Ending of speech interval. Speech Detection Examples case of low background noise => can find beginning

Program Educational Objectives 2- COs, POs1.pdf · 2020. 12. 29. · Program Educational Objectives To develop students professionally to handle business issues. To develop students

Program Educational Objectives 2- COs, POs1.pdf · 2020. 12. 29. · Program Educational Objectives To develop students professionally to handle business issues. To develop students

CES TS Management Tool Manual - POS1

CES TS Management Tool Manual - POS1

WordPress.com · 2016-03-03 · Maiden Speech means- @ Late Speech @ Early Speech O Final Speech @ First Speech Maiden Speech (First Speech) / eq. The synonym of 'Franchise' is: O

WordPress.com · 2016-03-03 · Maiden Speech means- @ Late Speech @ Early Speech O Final Speech @ First Speech Maiden Speech (First Speech) / eq. The synonym of 'Franchise' is: O

shodhganga.inflibnet.ac.inshodhganga.inflibnet.ac.in/bitstream/10603/20306/10/10...by tho steep price rise at Corllupt politics. rooy EflJo h1Bhl1 , Ol'gan1zod ond .el'e in ,a pos1

shodhganga.inflibnet.ac.inshodhganga.inflibnet.ac.in/bitstream/10603/20306/10/10...by tho steep price rise at Corllupt politics. rooy EflJo h1Bhl1 , Ol'gan1zod ond .el'e in ,a pos1

Language Modeling - GitHub Pagesaritter.github.io/courses/5525_slides/language models.pdf · Probabilistic Language Models •Today’s goal: assign a probability to a sentence •Machine

Language Modeling - GitHub Pagesaritter.github.io/courses/5525_slides/language models.pdf · Probabilistic Language Models •Today’s goal: assign a probability to a sentence •Machine

Hate Speech versus Free Speech

Hate Speech versus Free Speech

Digital Speech ProcessingDigital Speech Processing—— … speech processing... · Digital Speech ProcessingDigital Speech Processing ... Mid-sagittal plane X-ray of human vocal

Digital Speech ProcessingDigital Speech Processing—— … speech processing... · Digital Speech ProcessingDigital Speech Processing ... Mid-sagittal plane X-ray of human vocal

Speech Perception The Speech Chain - UCSB speech...– speech coding – speech recognition • try to understand speech perception by looking at the physiological models of hearing

Speech Perception The Speech Chain - UCSB speech...– speech coding – speech recognition • try to understand speech perception by looking at the physiological models of hearing

Personalising speech to-speech translation

Personalising speech to-speech translation

The Speech Speech

The Speech Speech

Approximate Field Continuity Conditions for Thin ...ap-s.ei.tuat.ac.jp/isapx/2016/pdf/POS1-91.pdfApproximate Field Continuity Conditions for Thin Anisotropic Conductive Layer . A.

Approximate Field Continuity Conditions for Thin ...ap-s.ei.tuat.ac.jp/isapx/2016/pdf/POS1-91.pdfApproximate Field Continuity Conditions for Thin Anisotropic Conductive Layer . A.

2015 annual...• Japan (June 2015) • China (July 2015) • EU – monotherapy (Jan 2016) Phase 3 in epilepsy POS1 – pediatric adj. therapy (2017) • PGTCS2 – adj. therapy (2019)

2015 annual...• Japan (June 2015) • China (July 2015) • EU – monotherapy (Jan 2016) Phase 3 in epilepsy POS1 – pediatric adj. therapy (2017) • PGTCS2 – adj. therapy (2019)

Hate Speech or Free Speech?

Hate Speech or Free Speech?

Information for Speech Recognition Joint Processing of ... Speech Recognition ... speech onset cues with audio-based speech energy Audio-Visual Speech synthesis ... speech recognition.

Information for Speech Recognition Joint Processing of ... Speech Recognition ... speech onset cues with audio-based speech energy Audio-Visual Speech synthesis ... speech recognition.