Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.
-
Upload
britney-covin -
Category
Documents
-
view
214 -
download
0
Transcript of Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.
![Page 1: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/1.jpg)
Agents that reason logically
Tuomas SandholmCarnegie Mellon University
Computer Science Department
![Page 2: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/2.jpg)
Agents that reason logicallyLogic: - formal language in which knowledge can be expressed
- means of carrying out reasoning in such a language
Knowledge base (KB) consisting of sentences- Background knowledge- TELL’ed
function KB-AGENT(percept) returns an action static: KB, a knowledge base
t, a counter, initially 0, indicating timeTELL(KB,MAKE-PERCEPT-SENTENCE(percept, t))action ASK(KB,MAKE-ACTION-QUERY(t))TELL(KB,MAKE-ACTION-SENTENCE(action,t))t t+1return action
![Page 3: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/3.jpg)
Syntax semantics
Sentences SentencesEntails
Facts FactsFollows
Semantics
Semantics
Representation
World
“KB entails ” KB sentence
“ is derived from KB by i” KB i An inference procedure that generate only entailed sentences is called sound (truth-preserving)Proof = record of operation of sound inference procedureProof theory specifies the sound inference steps for a logic.An inference procedure is complete if it can find a proof for any entailed sentence.
![Page 4: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/4.jpg)
Inference
“The pope is in Denver”Pope = microfilmDenver = pumpkin on the porch
A sentence is true under a particular interpretation if the state of affairs it represents is the case
A sentence is valid (tautology, necessarily true) if it is true under all possible worlds, i.e. regardless of what it is supposed to mean and regardless of the state of affairs in the universe being described. E.g. A ¬A
A sentence is satisfiable if there is some interpretation of some world for which it is true. E.g. A B (satisfiable by setting A= True, B=True)
Unsatisfiable: E.g. A ¬A
![Page 5: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/5.jpg)
Language Ontological commitment(what exists in the world)
Epistemological commitment (what an agent believes about facts)
Propositional logic
First-order logic
Temporal logic
Probability theoryFuzzy logic
Facts
Facts, objects, relations
Facts, objects, relations,timesFactsDegree of truth
True/false/unknown
True/false/unknown
True/false/unknown
Degree of belief 0…1Degree of belief 0…1
![Page 6: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/6.jpg)
Propositional Logic (PL): Syntax Sentence AtomicSentence | ComplexSentence
AtomicSentence True | False | P | Q | R | … ComplexSentence ( Sentence )
| Sentence Connective Sentence | ¬Sentence
Connective | | |
Logic constantsPropositional symbols
Conjunction (and’ed together)Disjunction (or’ed together)Precedence: ¬
E.g. ¬ P Q R Sis equivalent to((¬ P) (Q R)) S
![Page 7: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/7.jpg)
Propositional Logic: Semantics
Truth table defines the semantics
![Page 8: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/8.jpg)
Validity and inference
Truth tables can be used for inference
If the sentence is true in every row, then the sentence is valid.This can be used for machine inference by building a truth table for
Premises Conclusionsand checking all rows.
((PH)¬H) P
Slow, so need more powerful inference rules…
![Page 9: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/9.jpg)
Inference rules in propositional logic
E.g. to prove that P follows from (PH) and H,we require only one application of the resolution rule with as P, as H, and empty.
![Page 10: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/10.jpg)
Proving soundness of inference rules for propositional logic …
The truth-table demonstrating soundness of the resolution inference rule for propositional logic.
An inference rule is sound if the conclusion is true in all cases where the premises are true.
![Page 11: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/11.jpg)
Complexity of propositional inference
• Truth table method needs to check 2n rows for any proof involving n propositional symbols• NP-Complete [Cook 1971] 3SAT: ? s.t. (x1x5x6) (x2x5x6) … Most instances may be easy
Monotonicity: When we add new sentences to KB, all the sentences entailed by the original KB are still entailed.
Propositional logic (and first-order-logic) are monotonic.Monotonicity allows local inference rules.Probability theory is not monotonic.
x
![Page 12: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/12.jpg)
Complexity of propositional inference: a tractable special case
A class of sentences that allow polynomial time inference in propositional logic:
Horn sentence:P1 P2 … Pn Q
where Pi’s and Q are non-negated
Inference procedure: apply Modus Ponens whenever possible until no more inferences possible.
,
![Page 13: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/13.jpg)
Models (= dark regions in the Venn diagrams below)
= those parts of the world where sentence is true. I.e. those assignments of {True,False} to propositions.
A sentence is entailed by a KB if the models of KB are all models of .
![Page 14: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/14.jpg)
Another method for inference in propositional logic:
Model finding
Postulate
(Premises Conclusions)
and try to find a model
![Page 15: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/15.jpg)
Applications of model finding
• Logic, theorem proving (e.g. Robbins algebra)
• Planning (e.g. SATPLAN)
• Boolean circuits
• Satisfiability checking
• Constraint satisfaction
• Vision interpretation [e.g. Reiter & Mackworth 89]
![Page 16: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/16.jpg)
Model finding algorithms
![Page 17: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/17.jpg)
Davis-Putnam procedure [1960]
E.g. for 3SAT? s.t. (p1p3p4) (p1p2p3) …
Backtrack when some clause becomes empty
Unit propagation (for variable & value ordering): if some clause only has one literal left, assign that variable the value that satisfies the clause (never need to check the other branch)
p p1
p3
p2
p4
F
F
T
T
Complete
clause
![Page 18: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/18.jpg)
A helpful observation for the Davis-Putnam procedure
P1 P2 … Pn Q (Horn)is equivalent to(P1 P2 … Pn) Q (Horn)is equivalent toP1 P2 … Pn Q (Horn clause)
Thrm. If a propositional theory consists only of Horn clauses (i.e., clauses that have at most one non-negated variable) and unit propagation does not result in an explicit contradiction (i.e., Pi and Pi for some Pi), then the theory is satisfiable.
Proof. On the next page.
…so, Davis-Putnam algorithm does not need to branch on variables which only occur in Horn clauses
![Page 19: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/19.jpg)
Proof of the thrm
Assume the theory is Horn, and that unit propagation has completed (without contradiction). We can remove all the clauses that were satisfied by the assignments that unit propagation made. From the unsatisfied clauses, we remove the variables that were assigned values by unit propagation. The remaining theory has the following two types of clauses that contain unassigned variables only:P1 P2 … Pn Q andP1 P2 … Pn
Each remaining clause has at least two variables (otherwise unit propagation would have applied to the clause). Therefore, each remaining clause has at least one negated variable. Therefore, we can satisfy all remaining clauses by assigning each remaining variable to False.
![Page 20: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/20.jpg)
Variable ordering heuristic for the Davis-Putnam procedure [Crawford & Auton AAAI-93]
Heuristic: Pick a non-negated variable that occurs in a non-Horn (more than 1 non-negated variable) clause with a minimal number of non-negated variables.
Motivation: This is effectively a “most constrained first” heuristic if we view each non-Horn clause as a “variable” that has to be satisfied by setting one of its non-negated variables to True. In that view, the branching factor is the number of non-negated variables the clause contains.
Q: Why is branching constrained to non-negated variables?A: We can ignore any negated variables in the non-Horn clauses because
– whenever any one of the non-negated variables is set to True the clause becomes redundant (satisfied), and
– whenever all but one of the non-negated variables is set to False the clause becomes Horn.
Variable ordering heuristics can make several orders of magnitude difference in speed.
![Page 21: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/21.jpg)
“Order parameter” for 3SAT [Mitchell, Selman, Levesque AAAI-92]
• = #clauses / # variables
• This predicts– satisfiability – hardness of finding a model
![Page 22: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/22.jpg)
![Page 23: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/23.jpg)
Generality of the order parameter
• The results seem quite general across model finding algorithms
• Other constraint satisfaction problems have order parameters as well
![Page 24: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/24.jpg)
…but the complexity peak does not occur under all ways of
generating the 3SAT instances
![Page 25: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/25.jpg)
GSAT [Selman, Levesque, Mitchell AAAI-92] (= a local search algorithm for model finding)
Incomplete (unless restart a lot)
200016001200800400
Avg. total flips
100 200
50 variables, 215 3SAT clauses
max-climbs
Greediness is not essential as long as climbs and sideways moves are preferred over downward moves.
![Page 26: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/26.jpg)
Restarting
vs.
Escaping
![Page 27: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/27.jpg)
BREAKOUT algorithm [Morris AAAI-93]
Initialize all variables Pi randomlyUNTIL currently state is a solution
IF current state is not a local minimumTHEN make any local change that reduces the total cost (i.e. flip one Pi)
ELSE increase weights of all unsatisfied clause by one
Incomplete, but very efficient on large (easy) satisfiable problems.
Reason for incompleteness: the cost increase of the current local optimum spills to other solutions because they share unsatisfied clauses.
![Page 28: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/28.jpg)
Summary of the algorithms we covered for inference in propositional logic
• Truth table method• Inference rules• Model finding algorithms
– Davis-Putnam (Systematic backtracking)• Early backtracking when a clause is empty• Unit propagation• Variable (& value?) ordering heuristics
– GSAT– BREAKOUT
![Page 29: Agents that reason logically Tuomas Sandholm Carnegie Mellon University Computer Science Department.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c6f5503460f949217df/html5/thumbnails/29.jpg)
Propositional logic is too weak a representational language
- Too many propositions to handle, and truth table has 2n rows. E.g. in the wumpus world, the simple rule “don’t go forward if the wumpus is in front of you” requires 64 rules ( 16 squares x 4 orientations for agent)
- Hard to deal with change. Propositions might be true at times but not at others. Need a proposition Pi
t for each time step because one should not always forget what held in the past (e.g. where the agent came from)
- don’t know # time steps- need time-dependent versions of rules
- Hard to identify “individuals”, e.g. Mary, 3
- Cannot directly talk about properties of individuals or relations between individuals, e.g. Tall(bill)
- Generalizations, patterns cannot easily be represented “all triangles have 3 sides.”