1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper...
-
date post
22-Dec-2015 -
Category
Documents
-
view
213 -
download
0
Transcript of 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper...
![Page 1: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/1.jpg)
1
Class Wrap-up
Written HW 3 returned on Wednesday, my office. Or can be picked up in final.
Paper returned in final exam
Grades will be posted before Christmas
Office hours this week and next:Kathy: Wed 3:30-4:30 (12/12), Mon 1-2 (12/17), Tues 2-3
(12/18)TAs will post a notice if there is any change. Otherwise
assume as usual.
FILL OUT CLASS EVALUATION FORM. MAKE COMMENTS.
![Page 2: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/2.jpg)
Life After AI
![Page 4: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/4.jpg)
4
Research Projects
Natural Language Processing Kathy McKeown Julia Hirschberg Owen Rambow (CCLS) Becky Passonneau (CCLS) Mona Diab (CCLS) Nizar Habash (CCLS)
Text Classification Given a question, is a sentence in a relevant
document an answer? Given a translated/transcribed sentence,
which English sentence is it closest in meaning to?
NL/UI/Medical collaboration
![Page 5: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/5.jpg)
5
Research Projects
Vision Shree Nayar Peter Belhumeur John Kender
Data mining Sal Stolfo, but on sabbatical this year
Machine Learning Tony Jebara Rocco Serveddio (theoretical)
![Page 6: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/6.jpg)
6
Stop by and visit
CS Advising
Recommendation letters
Research project
Advice on applying to graduate school
![Page 7: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/7.jpg)
7
Final Exam
Wednesday, December 19th, 833 Mudd Cumulative exam
Slightly more focus on second half of class Knowledge Representation Logic and inference First order logic Probabilistic Reasoning and Bayes Nets Machine learning Vision Natural Language processing
But can expect search, game playing, constraint satisfaction to be covered
![Page 8: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/8.jpg)
8
Exam Format
Multiple Choice
Short answer
Problem solving
Essay
![Page 9: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/9.jpg)
9
Problems
Proof by Refutation FOL Bayesian Nets Machine learning Vision/NLP Essay
![Page 10: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/10.jpg)
10
Refutation/Resolution
Introduce negated sentence Convert to a CNF (disjunction of terms, or
“literals”) Apply resolution search to determine
satisfiability (SAT) or unsatsifiability (UNSAT)
SAT, then not entailed Semi-decidability implies there may be a
SAT solution we can never find UNSAT, then entailed
![Page 11: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/11.jpg)
11
Inference Properties
Inference method A is sound (or truth-preserving) if it only derives entailed sentences
Inference method A is complete if it can derive any sentence that is entailed
A proof is a record of the progress of a sound inference algorithm.
![Page 12: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/12.jpg)
12
Resolution
Prove: (DVE) KB: (A-> CVD)
(AVDVE) (A-> ⌐C)
![Page 13: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/13.jpg)
13
Negate Goal
![Page 14: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/14.jpg)
14
Negate goal
⌐(DVE) ⌐DΛ⌐E
![Page 15: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/15.jpg)
15
Convert to Conjunctive Normal Form
![Page 16: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/16.jpg)
16
![Page 17: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/17.jpg)
17
Convert to Conjunctive Normal Form
Equivalence: A->B = ⌐AVB
1. (⌐AVCVD) Λ2. (AVDVE) Λ3. (⌐AV⌐C) Λ4. ⌐D Λ5. ⌐E
![Page 18: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/18.jpg)
18
Apply resolution rule
![Page 19: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/19.jpg)
19
Apply resolution rule
1. (⌐AVCVD)2. (AVDVE)
(CVDVE)
2. (AVDVE)3. (⌐AV⌐C) (DVEV⌐C)
R1: (CVDVE)R2: (DVEV⌐C) (DVE)
R3: (DVE)4. ⌐D E
R4: E5. ⌐E contradiction
![Page 20: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/20.jpg)
20
FOL
[4 points] Using First Order Logic, write axioms describing the predicates Grandmother, Cousin. Use only the predicates Mother, Father, sibling in your definitions.
![Page 21: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/21.jpg)
21
x y w z grandmother(x,y) ↔ mother (x,z) ((father(z,y) V mother z(y))
x y w z cousin (x,y) ↔ (mother(z,x) sibling(z,w) V father(z,x) sibling(z,w)) (mother(w,y) V father (w,y))
![Page 22: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/22.jpg)
22
[4 points] Translate each of the following English sentences into the language of standard first-order logic, including quantifiers. Use the predicates French(x), Australian(x), Wine(x), , and the functions Price(x) and Quality(x)
All French wines cost more than all Australian wines. The best Australian wine is better than some French
wines.
![Page 23: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/23.jpg)
23
wy French (w) Australian (y) Price (w) Price (y)
z w y Australian (z) Australian (w) French (y) (quality (w) quality (y)) ( quality(w) quality (z))
![Page 24: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/24.jpg)
24
Bayesian Networks:What do you need to know?
Why are independence and conditional independence important?
What is Bayes’ Rule used for? How? How to construct a Bayesian net for a
given problem What are the independence assumptions? How to do inference using a Bayesian net
(i.e, what does it predict?)
![Page 25: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/25.jpg)
25
An Example
Smoking causes cancer Graph? Conditional Probability Tables?
![Page 26: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/26.jpg)
26
![Page 27: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/27.jpg)
27
How do we compute inferences?
What is the probability that a person has a malignant tumor and is not a smoker?
What is the probability that a person has a benign tumor given that she is a light smoker?
![Page 28: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/28.jpg)
28
![Page 29: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/29.jpg)
31
a
b
c
a
b
c
b
a c
Linear
Converging
Diverging
![Page 30: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/30.jpg)
32
D-separation (opposite of d-connecting)
A path from q to r is d-connecting with respect to the evidence nodes E if every interior node n in the path has the property that either
It is linear or diverging and is not a member of E It is converging and either n or one of its
decendants is in E
If a path is not d-connecting (is d-separated), the nodes are conditionally independent given E
![Page 31: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/31.jpg)
33
![Page 32: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/32.jpg)
34
Are age and gender independent?
Is cancer independent of age and gender given smoking?
Is serum calcium independent of lung tumor?
Is serum calcium independent of lung tumor given cancer?
![Page 33: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/33.jpg)
35
![Page 34: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/34.jpg)
36
![Page 35: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/35.jpg)
37
![Page 36: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/36.jpg)
38
Advanced approachesNLP and vision
How much do you need to know? Some idea of the applications Some idea of the approaches
Reduction to simpler problems: e.g. edge detection
NLP: syntax, semantics, pragmatics, statistics
How do these applications fit into our view of artificial intelligence?
![Page 37: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/37.jpg)
39
[2 points] Answer this question for either the natural language problem or the vision problem (not both):
Vision: You are writing a supervised learning program to identify the handwritten digits 1-9. What would your training material be? What features might your program use?
Natural language: You are writing a supervised learning program to translate from French to English. What would your training material be? What features might your program use?
![Page 38: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/38.jpg)
40
3. Learning from Observations (10 points)
Ms Apple I. Podd is a Columbia University Computer Science major who listens to music almost everywhere she goes. She often has homework due and many of them involve programming. We’ve sampled her choice of music genre over several points in time.
Naive Bayes is another machine learning method, but is based on probabilities. The formula below can be used to compute the most probable target category given a new instance. Suppose a friend of yours observes Ms. Podd in the morning. She has homework due and it does not involve programming. Use the formula to show what type of music Naïve Bayes will predict she is listening to.
VNB = argmax P(vj)iP(ai|vj) vjV
![Page 39: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/39.jpg)
41
TimeOfDay HomeworkDue? Programming? MusicType Morning Yes No Classical Morning No No Pop Morning No Yes Classical Morning Yes No Classical Afternoon Yes Yes Pop Afternoon No No Pop Evening No Yes Pop Evening Yes Yes Classical
VNB = argmax P(vj)iP(ai|vj) vjV
![Page 40: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/40.jpg)
42
Knowledge Representation
Given an entry in WordNet, show the pieces of the ontology that are implied
Given a machine learning problem, show how the ontology might be used to improve accuracy of learning
Given a statement in English, show how to represent it in semantic network
![Page 41: 1 Class Wrap-up Written HW 3 returned on Wednesday, my office. Or can be picked up in final. Paper returned in final exam Grades will be posted before.](https://reader030.fdocuments.us/reader030/viewer/2022032704/56649d805503460f94a639f6/html5/thumbnails/41.jpg)
43
Thank you, good luck on the final exam, and have a great winter break!
See you on the 19th!