Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf ·...
Transcript of Lydia Chilton StanfordIndustrial Affiliatesforum.stanford.edu/events/2016/slides/hci/Lydia.pdf ·...
1
Decomposing Creativity: The Case of Writing Humor
Lydia ChiltonUniversity of Washington, Stanford University
E = mc2
2
mc2
3
E
E = mc2
4
What type of creative artifact should we decompose first?
What type of creative artifact should we decompose first?
Humor
5
Properties of Humor
6
• Creative– Novel ‐ something you’ve never seen before– Hard ‐ not something you’d obviously think of
• Suited for Experimentation– Short ‐ can iterate on it quickly– Expert examples to learn from
Approach To Decomposing Humor
7
Examples + TheoryExamples + Theory
Model + System + StudyModel + System + Study
8
“I can’t believe people would just walk into an Apple store and start breaking things like it’s a Best Buy.”
American VoicesExamplesExamples
People Bending iPhones At Apple StoresFriday September 30, 2014
Input
Output
9
1. Associations2. Expectation Violation
Books on humor by philosophers, linguists, comedians
TheoryTheory
Satisfy a Constraintby searching a space of associations
10
Headline
Joke
ExpectationViolation SarcasmSarcasmUnexpected
AngleUnexpected
AngleBait‐and‐Switch
Bait‐and‐Switch
Apple
Broken DisplaysBest Buy
Best Buy
AlternativeAlternative InsultInsultAssociations
ModelModel
Sure, I guess UConn’s course is fine if you couldn’t get into Yale’s football clinic.
UConn Holding Football 101 Clinic for Female Fans
Association: Alternative Thing
11
Alright, how many ‘Summer Savannah’ Backyard Garden Lion Pedestals do I have to order to turn this thing around?
Report: ‘SkyMall’ Magazine May End Print Edition
Association: Details
12
Just tell me what to do and where to go to guarantee happiness forever.
Poll: Elite Colleges Don’t Produce HappierGraduates
Association: Personality Flaw
13
Satisfying a Constraintby searching a space of associations
14
Headline
Joke
ExpectationViolation SarcasmSarcasmUnexpected
AngleUnexpected
AngleBait‐and‐Switch
Bait‐and‐Switch
Apple
Broken DisplaysBest Buy
Best Buy
AlternativeAlternative InsultInsultAssociations
ModelModel
People Bending iPhones At Apple Stores
I can’t believe people would just walk into an Apple store and start breaking things like it’s a Best Buy.
Bait‐and‐SwitchBait‐and‐SwitchBait: Expectation: This is bad.Switch: Insult: Best Buy sucks.
15
Expectation Violation #1
UnexpectedAngle
UnexpectedAngle
“So did he think Transcendencewas good, or what?”
Stephen Hawking: AI Could Spell the End for MankindInspired by the film Transcendence, Stephen Hawking wrote that is a mistake to dismiss the threat of AI.
Expected Focus: End for Mankind
Unexpected Focus: Transcendence
16
Expectation Violation #2
SarcasmSarcasm
“There is absolutely no other explanation.”
Mick Jagger Blamed for Brazil’s World Cup Defeat
17
Expectation Violation #3
HumorToolsAdaptive Workflow
• Apply microtasks to the headline• Until you can find a way of violating an expectation
• Follow your train of thought, until you get stuck, then backtrack
• Not yet crowdsourced• But it is decomposed into microtasks
18
AspectsAspects
Violation Mechanism
HeadlineHeadline
Prototype & Test
Prototype & Test
JokeJoke
Expected ReactionsExpected Reactions
AssociationsAssociations
HumorTools Interface
19
Justin Bieber was baptized this weekend in an attempt to wash away his sins following a scandal in which the singer appears in videos uses racial slurs
Justin Bieber Baptized In NYC BathtubHeadline
Joke20
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
21
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bad.His music sucks.
Expected Reactions
22
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bad.His music sucks.
Expected Reactions
Violation Mechanism
23
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bad.His music sucks.
24
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR peopleAssociations
Bad.His music sucks.
25
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR peopleAssociations
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Violation Mechanism
26
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR peopleAssociations
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Violation Mechanism
Prototype
Test
Joke
…
……
…
Never let it be said that Bieber’s PR people aren’t bringing new ideas to the table. 27
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR peopleAssociations
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Violation Mechanism
Prototype
Test
Joke
…
……
…
Never let it be said that Bieber’s PR people aren’t bringing new ideas to the table. 28
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR people
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Joke
…
……
…
29
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR people
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Joke
Expected Reactions
Bad.Dirty, Gross
…
……
…
30
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR people
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Joke
Expected Reactions
Bad.Dirty, Gross
Violation Mechanism
Unexpected Angle:A Bieber fan who’d worship his dirty bathtub
…
……
…
31
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR people
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Joke
Expected Reactions
Bad.Dirty, Gross
Violation Mechanism
Unexpected Angle:A Bieber fan who’d worship his dirty bathtub
Prototype
Test……
……
……
…
32
Justin Bieber Baptized In NYC BathtubHeadline
Joke
Justin Bieber Baptized BathtubHeadline Aspects
Bieber’s PR people
Bad.His music sucks.
Unexpected Angle:Expected Reaction: BadAngle: PR people are cleverAngle Reaction: Good.
Joke
Expected Reactions
Bad.Dirty, Gross
Violation Mechanism
Unexpected Angle:A Bieber fan who’d worship his dirty bathtub
Prototype
Test……
……
……
…
Oh my God! Can I lick the tub?33
HumorTools Study
• 20 users: Stanford undergraduates• Humor novices• 60‐80 minutes:
– Tutorial on 20 microtasks– Humor Writing
• Write jokes for 3 headlines• Rate jokes against The Onion (21 people)
34
HumorTools Study Headlines
35
PETA Seeks Copyright for Primate A lawsuit filed by PETA claims that “monkey selfies” snapped by a macaque who stole a photographer’s camera should be considered the legal property of the macaque himself.
Liquid Water Found on MarsNASA revealed Monday that they have found evidence of liquid water on the Mars, pointing to the possibility of life on the red planet.
Can users synthesize humor?Can users synthesize humor?
HumorTools Study Headlines
36
PETA Seeks Copyright for Primate A lawsuit filed by PETA claims that “monkey selfies” snapped by a macaque who stole a photographer’s camera should be considered the legal property of the macaque himself.
Liquid Water Found on MarsNASA revealed Monday that they have found evidence of liquid water on the Mars, pointing to the possibility of life on the red planet.
HumorTools Evaluation
• 75% of participants were able to synthesize humor
• 25% of the HumorTools jokes were rated funny
37
38
PETA Seeks Copyright for Primate
This is great news for animal rights. Now my neighbor can take my dog to court instead of me the next time he deposits some of his “legal property” in their front lawn.
This is why you always get the macaque to sign a release.
39
PETA Seeks Copyright for Primate
This is great news for animal rights. Now my neighbor can take my dog to court instead of me the next time he deposits some of his “legal property” in their front lawn.
This is why you always get the macaque to sign a release.
HumorTools
47% Funny
62% Funny
40
Liquid Water Found on Mars
I think it’s more convenient for me to get it from the tap.
In other news, Pluto has been calledeven less of a planet now.
Sounds refreshing!
41
Liquid Water Found on Mars
HumorTools
HumorToolsI think it’s more convenient for me to get it from the tap.
In other news, Pluto has been calledeven less of a planet now.
Sounds refreshing!15% Funny
45% Funny
45% Funny
User Comments
42
“[Associations] helped me think of jokes in a wider conceptual space than I previously had.” (p9)
Before this, I never really knew where to start with joke writing I just kind of sat and thought until I came up with something. (p5)
43
Theory + ExamplesTheory + Examples
Model + System + StudyModel + System + Study
Future: Continuous Improvement
Grant: Be funnier than the Onion
44
Future Work
45
Crowdsource HumorTools
46
Headline
Joke
ExpectationViolation
Associations
Automate Some Microtasks
Train ML system with user collected data
47
• Entity extraction• Sentiment analysis• Semantic parsing
Extend HumorTools Approach to Other Creative, Open‐Ended Domains
Step 1 Synthesize theories
Step 2 Analyze examples for concrete mechanisms
Step 3 Identify microtasks that define the search space
Step 4 Define Constraints Violation Mechanism
Apple Stores
Best Buy
Alternative Thing
Alternative Thing
48
New Domain: Persuasive Argumentation
49
New Domain: Persuasive Argumentation
50
Step 1 Synthesize theories Rhetoric
Step 2 Analyze Op‐Eds for mechanismsMetaphor
Step 3 Identify microtasks that define the search spaceFind facts to support arguments
Step 4 Define constraintsThesis Statement
51
Decomposing Creativity: The Case of Writing Humor