Communication and Language

Chapter 22

Chapter 22 1

Outline

♦ Communication

♦ Grammar

♦ Syntactic analysis

♦ Problems

Chapter 22 2

Communication

“Classical” view (pre-1953):language consists of sentences that are true/false (cf. logic)

“Modern” view (post-1953):language is a form of action

Wittgenstein (1953) Philosophical Investigations

Austin (1962) How to Do Things with Words

Searle (1969) Speech Acts

Why utter?

Chapter 22 3

Communication

Why utter?

Chapter 22 4

Communication

Why utter?

Chapter 22 5

Communication

Why utter?

To change the actions of other agents

Chapter 22 6

Speech acts

SITUATION

Speaker Utterance Hearer

Speech acts achieve the speaker’s goals:Inform “There’s a pit in front of you”Query “Can you see the gold?”Command “Pick it up”Promise “I’ll share the gold with you”Acknowledge “OK”

Speech act planning requires knowledge of– Situation– Semantic and syntactic conventions– Hearer’s goals, knowledge base, and rationality

Chapter 22 7

Stages in communication (informing)

Intention S wants to inform H that P

Generation S selects words W to express P in context C

Synthesis S utters words W

Perception H perceives W ′ in context C ′

Analysis H infers possible meanings P1, . . . Pn

Disambiguation H infers intended meaning Pi

Incorporation H incorporates Pi into KB

How could this go wrong?

Chapter 22 8

Stages in communication (informing)

Intention S wants to inform H that P

Generation S selects words W to express P in context C

Synthesis S utters words W

Perception H perceives W ′ in context C ′

Analysis H infers possible meanings P1, . . . Pn

Disambiguation H infers intended meaning Pi

Incorporation H incorporates Pi into KB

How could this go wrong?– Insincerity (S doesn’t believe P )– Speech wreck ignition failure– Ambiguous utterance– Differing understanding of current context (C 6= C ′)

Chapter 22 9

Grammar

Vervet monkeys, antelopes, etc. use isolated symbols for sentences⇒ restricted set of communicable propositions, no generative capacity

(Chomsky (1957): Syntactic Structures)

Grammar specifies the compositional structure of complex messagese.g., speech (linear), text (linear), music (two-dimensional)

A formal language is a set of strings of terminal symbols

Each string in the language can be analyzed/generated by the grammar

The grammar is a set of rewrite rules, e.g.,

S → NP VP

Article → the | a | an | . . .

Here S is the sentence symbol, NP , VP , and Article are nonterminals

Chapter 22 10

Grammar types

Regular: nonterminal → terminal[nonterminal ]

S → aS

S → Λ

Context-free: nonterminal → anything

S → aSb

Context-sensitive: more nonterminals on right-hand side

ASB → AAaBB

Recursively enumerable: no constraints

Natural languages probably context-free, parsable in real time!

Chapter 22 11

Wumpus lexicon

Noun → stench | breeze | glitter | nothing

Adverb → here | there | nearby | ahead

Pronoun → me | you | I | it | . . .

Preposition → to | in | on | near | . . .

Conjunction → and | or | but | . . .

Chapter 22 12

Wumpus lexicon

Digit → 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9

Closed classes are small, bounded, change very slowly

Chapter 22 13

Wumpus lexicon

Pronoun → me | you | I | it | thou | y′all . . .

Digit → 0 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9

Closed classes are small, bounded, change very slowly

Chapter 22 14

Wumpus lexicon

Open classes are large, unbounded, change very fast

Chapter 22 15

Wumpus lexicon

Open classes are large, unbounded, change very fast

Chapter 22 16

Wumpus grammar

S → NP VP I + feel a breeze| S Conjunction S I feel a breeze + and + I smell a wumpus

VP → Verb stinks| VP NP feel + a breeze| VP Adjective is + smelly| VP PP turn + to the east| VP Adverb go + ahead

PP → Preposition NP to + the eastRelClause → that VP that + is smelly

Chapter 22 17

Grammaticality judgements

Formal language L1 may differ from natural language L2

false positives

false negatives

Adjusting L1 to agree with L2 is a learning problem!

* the gold grab the wumpus* I smell the wumpus the gold

I give the wumpus the gold* I donate the wumpus the gold

Intersubjective agreement somewhat reliable, independent of semantics!Real grammars 10–500 pages, insufficient even for “proper” English

Chapter 22 18

Parse trees

Exhibit the grammatical structure of a sentence

I shoot the wumpus

Chapter 22 19

Parse trees

I shoot the wumpus

Pronoun Verb Article Noun

Chapter 22 20

Parse trees

I shoot the wumpus

NP VP NP

Chapter 22 21

Parse trees

I shoot the wumpus

NP VP NP

Chapter 22 22

Parse trees

I shoot the wumpus

NP VP NP

Chapter 22 23

Parse trees

I shoot the wumpus

NP VP NP

Efficient CFG algorithms (e.g., chart parsing, Section 22.3) O(n3)

Chapter 22 24

Syntax in NLP

Most view syntactic structure as an essential step towards meaning;“Mary hit John” 6= “John hit Mary”

Nonetheless, ungrammatical sentence may be understood:

Chapter 22 25

Syntax in NLP

“Georgie give Georgie breakfast dinosaur!! Dinosaur brush teeth!!!”

Chapter 22 26

Syntax in NLP

“Georgie give Georgie breakfast to dinosaur!! Need teeth brush!!!”

Not all grammatical sentences are easy to understand:

“Wouldn’t the sentence ’I want to put a hyphen between the words Fishand And and And and Chips in my Fish-And-Chips sign’ have been clearerif quotation marks had been placed before Fish, and between Fish and and,and and and And, and And and and, and and and And, and And and and,and and and Chips, as well as after Chips?”

Chapter 22 27

Logical grammars

BNF notation for grammars too restrictive:– difficult to add “side conditions” (number agreement, etc.)– difficult to connect syntax to semantics

Idea: express grammar rules as logic

X → YZ becomes Y (s1) ∧ Z(s2) ⇒ X(Append(s1, s2))X → word becomes X([“word”])X → Y | Z becomes Y (s) ⇒ X(s) Z(s) ⇒ X(s)

Here, X(s) means that string s can be interpreted as an X

Chapter 22 28

Logical grammars contd.

Now it’s easy to augment the rulesthe car that I saw

* the car who I sawthe chimp who I saw

* the cockroach who I saw

NP (s1) ∧ EatsBreakfast(Ref(s1)) ∧ V P (s2)

⇒ NP (Append(s1, [“who”], s2))

John eats* John eat

Penguins eat

NP (s1) ∧ Number(s1, n) ∧ V P (s2) ∧ Number(s2, n)

⇒ S(Append(s1, s2))

Chapter 22 29

Parsing is reduced to logical inference:Ask(KB, S([“I” “am” “a” “wumpus”]))

(Can add extra arguments to return the parse structure, semantics)

Generation simply requires a query with uninstantiated variables:Ask(KB, S(x))

If we add arguments to nonterminals to construct sentence semantics, NLPgeneration can be done from a given logical sentence:

Ask(KB, S(x,At(Robot, [1, 1]))

Chapter 22 30

Parsing is reduced to logical inference:Ask(KB, S([“I” “am” “a” “wumpus”]))

(Can add extra arguments to return the parse structure, semantics)

Generation simply requires a query with uninstantiated variables:Ask(KB, S(x))

If we add arguments to nonterminals to construct sentence semantics, NLPgeneration can be done from a given logical sentence:

Ask(KB, S(x,At(Robot, [1, 1]))Y es, {x = “The robot is at [1,1]”}

Chapter 22 31

Real language

Real human languages provide many problems for NLP:

♦ ambiguity

♦ anaphora

♦ indexicality

♦ vagueness

♦ discourse structure

♦ metonymy

♦ metaphor

♦ noncompositionality

Chapter 22 32

Ambiguity

Squad helps dog bite victim

Chapter 22 33

Ambiguity

Squad helps dog bite victimHelicopter powered by human flies

Chapter 22 34

Ambiguity

Squad helps dog bite victimHelicopter powered by human fliesEighth Army push bottles up Germans

Chapter 22 35

Ambiguity

Squad helps dog bite victimHelicopter powered by human fliesEighth Army push bottles up GermansI ate spaghetti with meatballs

Chapter 22 36

Ambiguity

Chapter 22 37

Ambiguity

saladabandon

Chapter 22 38

Ambiguity

saladabandona fork

Chapter 22 39

Ambiguity

saladabandona forka friend

Chapter 22 40

Ambiguity

saladabandona forka friend

Ambiguity can be lexical (polysemy), syntactic, semantic, referential

Chapter 22 41

Anaphora

Using pronouns to refer back to entities already introduced in the text

After Mary proposed to John, they found a preacher and got married.

Chapter 22 42

Anaphora

For the honeymoon, they went to Hawaii

Chapter 22 43

Anaphora

Mary saw a ring through the window and asked John for it

Chapter 22 44

Anaphora

Mary saw a ring through the window and asked John for it

Mary threw a rock at the window and broke it

Chapter 22 45

Indexicality

Indexical sentences refer to utterance situation (place, time, S/H, etc.)

I am over here

Why did you do that?

Chapter 22 46

Metonymy

Using one noun phrase to stand for another

I’ve read Shakespeare

Chrysler announced record profits

The ham sandwich on Table 4 wants another beer

Chapter 22 47

Metaphor

“Non-literal” usage of words and phrases, often systematic:

I’ve tried killing the process but it won’t die. Its parent keeps it alive.

Chapter 22 48

Noncompositionality

Meaning of Word1 Word2 composed from meanings of Word1, Word2 ?

basketball shoes

Chapter 22 49

Noncompositionality

basketball shoesbaby shoes

Chapter 22 50

Noncompositionality

basketball shoesbaby shoesalligator shoes

Chapter 22 51

Noncompositionality

basketball shoesbaby shoesalligator shoesdesigner shoes

Chapter 22 52

Noncompositionality

basketball shoesbaby shoesalligator shoesdesigner shoesbrake shoes

Chapter 22 53

Noncompositionality

red book

Chapter 22 54

Noncompositionality

red bookred pen

Chapter 22 55

Noncompositionality

red bookred penred hair

Chapter 22 56

Noncompositionality

red bookred penred hairred herring

Chapter 22 57

Noncompositionality

small moon

Chapter 22 58

Noncompositionality

small moonlarge molecule

Chapter 22 59

Noncompositionality

small moonlarge moleculemere child

Chapter 22 60

Noncompositionality

small moonlarge moleculemere childalleged murderer

Chapter 22 61

Noncompositionality

small moonlarge moleculemere childalleged murderer

Chapter 22 62

Noncompositionality

small moonlarge moleculemere childalleged murdererartificial grass

Chapter 22 63

Communication and Language › ~russell › classes › cs188 › ... · 2005-12-01 ·...

Documents

Transcript of Communication and Language › ~russell › classes › cs188 › ... · 2005-12-01 ·...

FA11 cs188 lecture 2 -- uninformed search (2PP)cs188/fa11/slides/FA11 cs188... · Uninformed Search Methods (part review for some) Depth-First Search ... Search Tiers Strategy: expand

Language and Communication

Announcements CS 188: Artificial Intelligencegamescrafters.berkeley.edu/~cs188/sp11/slides/SP11 cs188 lecture 24... · CS 188: Artificial Intelligence Spring 2011 Advanced Applications:

Speech, language and communication needs – Self …dera.ioe.ac.uk/13774/1/task10.pdf · Speech, language and communication needs ... Introducing speech, language and communication

Communication & Language

CS188 Guest Lecture: Statistical Natural Language Processing

Information about speech, language and communication needs · Information about speech, language and communication needs 7 Speech, language and communication needs Speech, language

SP14 CS188 Lecture 10 -- Reinforcement Learning I

Speech, Language and Communication Needs in …ucl.reportlab.com/media/g/speech-language-communication-needs... · presentation. Degree structure ... Language and Communication Needs

cs188 lecture 17 -- HMMs, DBNs, Particle Filters, Viterbiinst.eecs.berkeley.edu/~cs188/sp12/slides/cs188... · Title: cs188 lecture 17 -- HMMs, DBNs, Particle Filters, Viterbi.ppt

NONHUMAN PRIMATE COMMUNICATION Call systems Sign Language Origin of Language NONVERBAL COMMUNICATION STRUCTURE OF LANGUAGE Speech Sounds LANGUAGE, THOUGHT,

Communication body language

Communication & Body Language

english language communication

Sp14 Cs188 Lecture 9 -- Mdps II

Communication and Language. Introduction to language and communication What is communication? –transmission of information –evoking understanding, meaning.

Language and Communication Language and Communication.

Chapter7 Symbolic Communication and Language. Chapter Outline Language and Verbal Communication Nonverbal Communication Social Structure and Communications.

SP14 CS188 Lecture 3 -- Informed Search