Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker...
-
date post
21-Dec-2015 -
Category
Documents
-
view
216 -
download
0
Transcript of Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker...
![Page 1: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/1.jpg)
Computational Linguistics: Computers and the Brain
University of MarylandYakov Kronrod
Dan ParkerIrene Eleta
Raul David GuerraJudith Klavans
![Page 2: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/2.jpg)
Different StrokesComputers Human Brain
store representationscombine previously acquired information
retrieve past “knowledge”can “see”, “hear”, “speak”?
digitalprocess specific instruction
programmableinfallible (as far as programming
goes)fast complex computations
very bad at reasoninglargely serial processing
organiccan modify behavior on the fly
can learn wellprone to mistakes
slow at complex computationsvery good at reasoning
largely parallel processing
![Page 3: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/3.jpg)
What’s the connection?
• What do computers have to do with Language?
• Holy Grain: Full Language Understanding• NLP vs. CL
![Page 4: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/4.jpg)
Types of Computational Linguistics and Natural Language Processing
• Speech Recognition/Comprehension• Speech Production• Language Induction• Lexical Analysis• Semantic Analysis• Machine Translation• Language Modeling• Cognitive Processing Modeling
![Page 5: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/5.jpg)
Computational Linguistics: Defined• Computational linguistics is an interdisciplinary field
dealing with the statistical and/or rule-based modeling of natural language from a computational perspective. Computational linguists often work as members of interdisciplinary teams, including linguists (specifically trained in linguistics), language experts (persons with some level of ability in the languages relevant to a given project), and computer scientists. In general, computational linguistics draws upon the involvement of linguists, computer scientists, experts in artificial intelligence, mathematicians, logicians, philosophers, cognitive scientists, cognitive psychologists, psycholinguists, anthropologists and neuroscientists, among others.
![Page 6: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/6.jpg)
Computational Linguistics: Defined• Natural language processing (NLP) is a field of
computer science and linguistics concerned with the interactions between computers and human (natural) languages. In theory, natural-language processing is a very attractive method of human-computer interaction. NLP has significant overlap with the field of computational linguistics, and is often considered a sub-field of artificial intelligence. Research into modern statistical NLP algorithms requires an understanding of a number of disparate fields, including linguistics, computer science, and statistics.
![Page 7: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/7.jpg)
Building Blocks: Words
• Commonly seen as the basic building block of language(Letters? Sounds? Noises?)
• Can express basic thoughts(ie: give, please, that, etc…)
• Used to construct sentences• Used to convey associations and emotions• Placeholders for concepts and images
![Page 8: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/8.jpg)
Words in the Brain
• “Tip of the tongue” phenomena• So many to keep track of• How do we remember a word we want?• Needed to process a sentence
![Page 9: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/9.jpg)
Digitizing the Word
• Words can be used as “tokens” to compute many different things
• Words can be used to keep track of associations and descriptions
• Search and Learning using words in computers
![Page 10: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/10.jpg)
1 picture; 1000 words
![Page 11: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/11.jpg)
But First…
…A few words from our resident Linguist.
![Page 12: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/12.jpg)
![Page 13: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/13.jpg)
Words in the Mind
![Page 14: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/14.jpg)
Where are words stored?
The Mental
LEXICON
![Page 15: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/15.jpg)
The Mental Lexicon:
• Holds all of the words you know.
• How many words are in our lexicon?
~60,000 words!
![Page 16: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/16.jpg)
The lexicon is not just a bag of words…
![Page 17: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/17.jpg)
But it’s also not a dictionary…
![Page 18: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/18.jpg)
Because you know so many words, the brain needs to find words VERY quickly.
![Page 19: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/19.jpg)
How might a word be accessed?
Cane
Cap
Cane
Candle
Dog
Cookie
![Page 20: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/20.jpg)
How might a word be accessed?
Cap
Cane
Candle
Dog
Cookie
C___
![Page 21: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/21.jpg)
How might a word be accessed?
Cap
Cane
Candle
Dog
Cookie
C___
![Page 22: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/22.jpg)
How might a word be accessed?
C___
Cap
Cane
Candle
Dog
Cookie
![Page 23: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/23.jpg)
How might a word be accessed?
CA__
Cap
Cane
Candle
Dog
Cookie
![Page 24: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/24.jpg)
How might a word be accessed?
CA__
Cap
Cane
Candle
Dog
Cookie
![Page 25: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/25.jpg)
How might a word be accessed?
CAN_
Cap
Cane
Candle
Dog
Cookie
![Page 26: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/26.jpg)
How might a word be accessed?
CAN_
Cap
Cane
Candle
Dog
Cookie
![Page 27: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/27.jpg)
How might a word be accessed?
CANE
Cap
Cane
Candle
Dog
Cookie
![Page 28: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/28.jpg)
How might a word be accessed?
CANE
Cap
Cane
Candle
Dog
Cookie
![Page 29: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/29.jpg)
![Page 30: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/30.jpg)
Image from http://www.psych.nyu.edu/pylkkanen/Neural_Bases/07_slides/11_LexAccess_Elect.pdf
![Page 31: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/31.jpg)
Celebrate
Party
birthday
joy
positive
negative
death
Cheer
Sorrow
remorse
Emotion:
![Page 32: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/32.jpg)
![Page 33: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/33.jpg)
Title: Portrait of a Family Playing Music
![Page 34: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/34.jpg)
Title: The Studio
Title: Girl at the Piano: recording sound
Title: Portrait of a Family Playing Music
cello violin
musicians
music
abstractcolorful
piano
geometric
music
![Page 35: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/35.jpg)
An image is worth a thousand words……in all languages
(or how people from different cultures build the many meanings of an image)
![Page 36: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/36.jpg)
Two women
Sewing
Light and shadow
Doves
Crown of thorns
Melancholy
La Virgen
Cosiendo
Cristo
Corona de espinas
Luz y sombra
tranquilidad
US Spain
![Page 37: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/37.jpg)
Cotton pickingtwo girlsAfrican Americanslavery
RacismSouthernThe SouthCivil war
![Page 38: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/38.jpg)
Museum User Museum Expert
Boat Builders, set on the Gloucester, Massachusetts coast relates to a series of prints and drawings devoted to shipbuilding. Homer also used this image of the two boys in an engraving for the October 11, 1873 issue of Harper’s Weekly. ………..
I remember a boat …
![Page 39: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/39.jpg)
<vessel, boat, lake, marine,
ocean, sails, schooner,
ship ,water>
<vessel,china,handle,dynasty,j
ade,stone>
<vessel,boat,ocean,overcast,
paddle,river,sail,ship,water,
vastness >
![Page 40: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/40.jpg)
Looking Forward
• Advances in Bridging the Linguistics – NLP gap• Directions of research for language processing• Better models for human language usage• Cross-pollination of ideas across disciplines
![Page 41: Computational Linguistics: Computers and the Brain University of Maryland Yakov Kronrod Dan Parker Irene Eleta Raul David Guerra Judith Klavans.](https://reader035.fdocuments.us/reader035/viewer/2022062516/56649d5c5503460f94a3b117/html5/thumbnails/41.jpg)
Thank You!
• Questions• Comments• Discussion