Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 ·...
Transcript of Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 ·...
![Page 1: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/1.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Epistemic Reasoning in AI
Tristan Charrier François Schwarzentruber
École Normale Supérieure Rennes
August 12th, 2019
1 / 61
![Page 2: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/2.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Automation of complex tasks
Autonomous cars Intelligent farming
Nuclear decommissioning
cars, robots, humans
Several agents that interact with the environment and with each other.
2 / 61
![Page 3: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/3.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Imperfect information
Agents have local view ofthe environmentAgents communicateAgents act
Decisions are taken with respect to knowledge.
3 / 61
![Page 4: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/4.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Interaction relies on knowledgeif I know it is safe then
I go
if I know you are at the market place thenI join you
if (I know it is safe) and (I know you do not know it is safe) thenI tell you it is safe
if I know you know it is safe thenI do not tell you it is safe
if I know you know I know it is safe or not thenI do not wait for a message from you
4 / 61
![Page 5: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/5.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Need to build understandable multi-agent systems
MotivationRobots interacting with humansLegal issues in case of failure
5 / 61
![Page 6: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/6.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Need to build understandable multi-agent systems
MotivationRobots interacting with humansLegal issues in case of failure
?
I turned left because x = 0 andy > 5.
6 / 61
![Page 7: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/7.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Need to build understandable multi-agent systems
MotivationRobots interacting with humansLegal issues in case of failure
?
I turned left because my neuron53 was activated.
7 / 61
![Page 8: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/8.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Need to build understandable multi-agent systems
MotivationRobots interacting with humansLegal issues in case of failure
I turned left because I knew thisarea was not explored.
8 / 61
![Page 9: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/9.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Solution: reasoning about knowledge
Given:what agents sense;the actions andcommunications thatoccurred
What does each agent know?
9 / 61
![Page 10: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/10.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Content of this tutorial1 Introduction to epistemic logic
[ van Ditmarsch, Joseph Y. Halpern, van der Hoek, Kooi, Chap. 1. of Handbookof epistemic logic, 2015]
2 Knowing and seeing[Balbiani, et al. Agents that see each other IGPL 2012]
3 Knowledge and time[Dixon, Nalon, Ramanujam, Chap. 5. of Handbook of epistemic logic, 2015]
4 Dynamic epistemic logic[Moss, Chap. 6. of Handbook of epistemic logic, 2015]
5 Knowledge-based programs[Joseph Y. Halpern, Moshe Vardi, Ronald Fagin et Yoram Moses. Reasoningabout knowledge 1995][Saffidine, Zanuttini, et al., AAAI 2018]
10 / 61
![Page 11: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/11.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
References
[Jaakko Hintikka. Knowledge and Belief: An Introduction to the Logic of the TwoNotions (1962)]
[J-J Ch. Meyer, van der Hoek, Epistemic logic in AI and computer science, 1995]
[Joseph Y. Halpern, Moshe Vardi, Ronald Fagin et Yoram Moses. Reasoning aboutknowledge 1995]
[ van Ditmarsch, van der Hoek, Kooi, Dynamic epistemic logic, 2007]
[ van Ditmarsch, Joseph Y. Halpern, van der Hoek, Kooi, Handbook of epistemiclogic, 2015]
11 / 61
![Page 12: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/12.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Acknowledgment
Tristan Charrier, former PhD student in Rennes, for many resultsthat will be presented
Sébastien Gamblin and Alexandre Niveau, for the implementation ofsuccinct/symbolic models in Hintikka’s World
Sophie Pinchinat, head of the LogicA group in Rennes
Many other colleagues: Valentin Goranko, Andreas Herzig, EmilianoLorini, Arthur Queffelec, Abdallah Saffidine, Bruno Zanuttini, etc.
12 / 61
![Page 13: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/13.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language properties
13 / 61
![Page 14: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/14.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Outline
1 The Hintikka’s World projectMotivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language properties
14 / 61
![Page 15: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/15.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Outline
1 The Hintikka’s World projectMotivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language properties
15 / 61
![Page 16: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/16.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Once upon a time... In 2011-2012...
I explained epistemic logic to other researchers in logic/AI/verification...
p = false
p = true
... but nobody understood me...
16 / 61
![Page 17: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/17.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Possible worlds
... but, since 2017, everybody understood me with comics...
http://hintikkasworld.irisa.fr/[demo IJCAI-ECAI 2018] [IJCAI 2019]
17 / 61
![Page 18: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/18.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Semantics of knowing something
Agent a knows that b is dirty.
18 / 61
![Page 19: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/19.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Epistemic states = pointed Kripke structures
Comics = unraveling of a pointed Kripke structure.
19 / 61
![Page 20: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/20.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Outline
1 The Hintikka’s World projectMotivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language properties
20 / 61
![Page 21: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/21.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Explaining these models in many communities
Logic Verification
AIRobotics
Psychology
Distributed systems
Cryptography
Games
Philosophy
21 / 61
![Page 22: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/22.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Explaining these models in many communities
Logic Verification
AIRobotics
Psychology
Distributed systems
Cryptography
Games
Philosophy
22 / 61
![Page 23: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/23.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Sally and Ann example
Example in Hintikka’s World:
From psychology to robotics:[Devin, Alami. An implemented theory of mind to improve human-robot sharedplans execution. 2016]
Recent implementation, by Thomas Bolander et al. (video)
23 / 61
![Page 24: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/24.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Outline
1 The Hintikka’s World projectMotivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language properties
24 / 61
![Page 25: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/25.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Motivation 1: face the difficulties in explaining possible worldsMotivation 2: disseminating in many communitiesOpen software
Open-source project
http://hintikkasworld.irisa.fr/
https://gitlab.inria.fr/fschwarz/hintikkasworld
[demo IJCAI-ECAI 2018][IJCAI 2019]
Web appModular source codein TypescriptEasy to add newexamplesSeveral contributors
Please contributeCodingPropose ideas andimprovements
25 / 61
![Page 26: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/26.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Outline
1 The Hintikka’s World project
2 Epistemic logicModelsSyntax
3 Model checking
4 Theorem proving
5 Language properties
26 / 61
![Page 27: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/27.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Outline
1 The Hintikka’s World project
2 Epistemic logicModelsSyntax
3 Model checking
4 Theorem proving
5 Language properties
27 / 61
![Page 28: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/28.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Epistemic states
Let AP = {p, p1, . . .} be a countable set of atomic propositions.Let AGT = {a, b, c, . . .} be a finite set of agents.
Definition
An epistemic modelM = (W , (Ra)a∈AGT,V ) is a tuple where:W = {w , u, . . .} is a non-empty set of possible worlds;
Ra ⊆W ×W is an accessibility relation for agent a;
V : W → 2AP is a valuation function.
A pair (M,w) is called a epistemic state, where w represents the actualworld.
28 / 61
![Page 29: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/29.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Example of an epistemic state
In Hintikka’s World: Muddy children
W = {w , u, v , s};Ra = {(w , w), (w , u), (u, w), (u, u), (v , v), (v , s), (s, v), (s, s)};Rb = {(w , w), (w , v), (v , w), (v , v), (u, u), (u, s), (s, u), (s, s)};V (w) = {ma, mb}; V (u) = {mb}; V (v) = {ma}; V (s) = ∅.
29 / 61
![Page 30: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/30.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Outline
1 The Hintikka’s World project
2 Epistemic logicModelsSyntax
3 Model checking
4 Theorem proving
5 Language properties
30 / 61
![Page 31: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/31.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Syntax of LELDefinitionThe syntax of LEL is given by the following grammar:
ϕ,ψ, . . . ::= p | ¬ϕ | (ϕ ∨ ψ) | Kaϕ
where p ranges over AP and a ranges over AGT.
The size of ϕ is the number of symbols needed to write ϕ.
Notation(ϕ ∧ ψ) for ¬(¬ϕ ∨ ¬ψ);K̂aϕ for ¬Ka¬ϕ(ϕ→ ψ) for (¬ϕ ∨ ψ)
Kaϕ is read ‘agent a knows/believes that ϕ is true’;K̂aϕ is read ‘agent a considers ϕ as possible’.
31 / 61
![Page 32: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/32.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Semantics of LEL
DefinitionThe semantics of LEL is defined as follows:
M,w |= p if p ∈ V (w);
M,w |= ¬ϕ if it is not the case thatM,w |= ϕ;
M,w |= (ϕ ∨ ψ) ifM,w |= ϕ orM,w |= ψ;
M,w |= Kaϕ if for all u s.t. wRau,M, u |= ϕ
32 / 61
![Page 33: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/33.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Dual operatorsM,w |= Kaϕ if for all u s.t. wRau,M, u |= ϕ
M,w |= K̂aϕ if there exists u s.t. wRau andM, u |= ϕ.
M,w |= Kamb M,w |= K̂ama
33 / 61
![Page 34: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/34.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Practical sessionIn Hintikka’s World: check formulas on the example you like
Syntax of formulas in Hintikka’s worldp(not phi)(phi or psi)(phi or phi or chi or ...)(phi and psi and chi or...)(K a phi) agent a knows/believes ϕ(Kpos a phi) agent a considers ϕ as possible
Example( (K a (p or q)) and (Kpos a r) )
34 / 61
![Page 35: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/35.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ModelsSyntax
Common knowledge
Common knowledge of ϕ among agents in group G
DefinitionThe syntax of LELCK is given by the following grammar:
ϕ ::= p | ¬ϕ | (ϕ ∨ ϕ) | Kaϕ | CGϕ
where p ranges over AP, a ranges over AGT, and G ranges over 2AGT.
DefinitionThe semantics of LELCK extended by the following clause:
M,w |= CGϕ if for all u ∈W ,wRGu impliesM, u |= ϕwhere RG is the reflexive transitive closure of
⋃a∈G Ra.
35 / 61
![Page 36: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/36.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checkingModel checking problemState explosion problem
4 Theorem proving
5 Language properties
36 / 61
![Page 37: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/37.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checkingModel checking problemState explosion problem
4 Theorem proving
5 Language properties
37 / 61
![Page 38: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/38.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Model checking problem
Definition (model checking problem)Input:
An epistemic stateA formula, e.g. Kap;
Output: yes if satisfies Kap; no otherwise.
38 / 61
![Page 39: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/39.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Model checking problem
DefinitionThe model checking problem is defined as follows.
Input:An epistemic state M, w ;A formula ϕ;
Output: yes ifM,w |= ϕ; no otherwise.
TheoremModel checking problem is P-complete.
39 / 61
![Page 40: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/40.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Model checking algorithm
input: a Kripke modelM, a formula ϕoutput: the set of worlds inM in which ϕ holdsfunction mc(M, ϕ)
match ϕ docase p :
return {w | p holds inM,w}case ¬ψ :
return mc(M, ψ)case (ψ1 ∨ ψ2) :
return mc(M, ψ1) ∪ mc(M, ψ2)case Kaψ :
return {w | Ra(w) ⊆ mc(M, ψ)}
40 / 61
![Page 41: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/41.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checkingModel checking problemState explosion problem
4 Theorem proving
5 Language properties
41 / 61
![Page 42: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/42.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
State explosion problem
ExampleMinesweeper easy 8× 8 with 10 bombs: > 1012 possible worlds.
42 / 61
![Page 43: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/43.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
State explosion problem
ExampleMinesweeper 10× 12 with 20 bombs: > 1025 possible worlds.
43 / 61
![Page 44: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/44.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Model checking problemState explosion problem
Solution to the state explosion problem
[van Benthem; et al. 2015], [van Benthem et al. 2018]
[Charrier _ AAMAS 2017], [Charrier _ AiML 2018]Succinct representations of epistemic states; and actions;Easy to specify by means of accessibility programs;Succinct model checking Pspace-complete.
44 / 61
![Page 45: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/45.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem provingSatisfiability and validityAxiomatizationClasses of modelsComplexity
5 Language properties
45 / 61
![Page 46: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/46.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem provingSatisfiability and validityAxiomatizationClasses of modelsComplexity
5 Language properties
46 / 61
![Page 47: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/47.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Satisfiability and validity
DefinitionA formula ϕ is satisfiable if there is an epistemic stateM,w suchthatM,w |= ϕ.A formula ϕ is valid/a theorem if for all epistemic statesM,w , wehaveM,w |= ϕ.
ExampleKap is satisfiable, but not valid.(Kap ∧ Ka(p → q)) → Kaq is valid.
Dual propertiesϕ is a theorem iff ¬ϕ is not satisfiable.
47 / 61
![Page 48: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/48.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem provingSatisfiability and validityAxiomatizationClasses of modelsComplexity
5 Language properties
48 / 61
![Page 49: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/49.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Axiomatizationall classical tautologies
Axiom K: Ka(ϕ→ ψ)→ (Kaϕ→ Kaψ)Modus ponens rule: From ϕ and ϕ→ ψ, infer ψNecessitation rule: From ϕ infer Kaϕ
TheoremA formula is a theorem iff it is provable in the axiomatization above.
[Blackburn et al. Modal logic, 2001]
ExampleKa(ϕ ∧ ψ)→ Kaϕ is theorem:
1 (ϕ ∧ ψ)→ ϕ classical tautology2 Ka((ϕ ∧ ψ)→ ϕ) by necessitation rule on 13 Ka((ϕ ∧ ψ)→ ϕ)→ (Ka(ϕ ∧ ψ)→ Kaϕ) Axiom K4 Ka(ϕ ∧ ψ)→ Kaϕ by modus ponens on 2, 3
49 / 61
![Page 50: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/50.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Motivation of axiomatization
the computation of knowledge is modeled;
enables to explain why an agent knows sth;(link with justification logic)
axiomatization helps to understand the principle of the logics
we do not have to design a specific epistemic state, as in modelchecking
50 / 61
![Page 51: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/51.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem provingSatisfiability and validityAxiomatizationClasses of modelsComplexity
5 Language properties
51 / 61
![Page 52: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/52.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Classes of epistemic statesProperties Related axioms
K allT reflexive Kaϕ→ ϕ
D seriality K̂a>
4 transitivity Kaϕ→ KaKaϕ
5 Euclideanity ¬Kaϕ→ Ka¬Kaϕ
In Hintikka’s World: Classes of models
DefinitionA formula ϕ is a KD45-theorem if for all epistemic statesM,w in whichrelations are serial, transitive and Euclidean, we haveM,w |= ϕ.
TheoremA formula ϕ is a KD45-theorem iff it is provable in the axiomatisationabove plus axioms D, 4, 5. [Sahlqvist, 1975]
52 / 61
![Page 53: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/53.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Important classes: KD45 and S5 = KT45
Example (KD45, i.e. beliefs)A formula ϕ is a KD45-theorem if for all epistemic statesM,w in whichrelations are serial, transitive and Euclidean, we haveM,w |= ϕ.
Example (S5 = KT45, i.e. knowledge)A formula ϕ is a S5-theorem if for all epistemic statesM,w in whichrelations are equivalence relations, we haveM,w |= ϕ.
53 / 61
![Page 54: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/54.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem provingSatisfiability and validityAxiomatizationClasses of modelsComplexity
5 Language properties
54 / 61
![Page 55: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/55.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
Satisfiability and validityAxiomatizationClasses of modelsComplexity
Complexity of theorem proving
TheoremWithout common knowledge:
one single agent several agentsK Pspace-complete Pspace-completeKD45, S5 NP-complete Pspace-complete
With common knowledge (several agents): Exptime-complete.
[Halpern, Moses, A guide to completeness and complexity for modal logics ofknowledge and belief. 1996]
Model checking more practical than theorem proving [Halpern, Vardi, 1991]
55 / 61
![Page 56: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/56.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language propertiesExpressivitySuccinctness
56 / 61
![Page 57: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/57.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language propertiesExpressivitySuccinctness
57 / 61
![Page 58: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/58.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Strictly more expressiveDefinitionTwo formulas ϕ and ψ are equivalent if for all pointed modelsM,w ,
(M,w |= ϕ) iff (M,w |= ψ)
TheoremLELCK is strictly more expressive than LEL: no formula in LEL isequivalent to C{a,b}p.
By contradiction, suppose that ϕ in LEL is equivalent to C{a,b}p;Let d be the modal depth of ϕ, e.g. d = 3;Let us consider the two models ofIn Hintikka’s World: Language with Common knowledge is more expressive
ϕ has the same value in both while C{a,b}p not.
58 / 61
![Page 59: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/59.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Equally expressive
We may add in the language operators EGϕ read as ‘agents in G know ϕ’:M,w |= EGϕ if for all agents a ∈ G ,M,w |= Kaϕ.
TheoremThe language LEL augmented with the EG ’s is equally expressive thanLEL:
EGϕ ≡∧a∈G
Kaϕ
59 / 61
![Page 60: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/60.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Outline
1 The Hintikka’s World project
2 Epistemic logic
3 Model checking
4 Theorem proving
5 Language propertiesExpressivitySuccinctness
60 / 61
![Page 61: Epistemic Reasoning in AIpeople.irisa.fr/Francois.Schwarzentruber/ijcai2019... · 2019-08-11 · TheHintikka’sWorldproject Epistemiclogic Modelchecking Theoremproving Languageproperties](https://reader033.fdocuments.us/reader033/viewer/2022042308/5ed4744364cb9d0fda746f73/html5/thumbnails/61.jpg)
The Hintikka’s World projectEpistemic logicModel checking
Theorem provingLanguage properties
ExpressivitySuccinctness
Succinctness
TheoremThe language LEL augmented with the EG ’s is exponentially moresuccinct than LEL.
E{a,b}E{a,b}E{a,b}ϕ ≡ KaKaKaϕ ∧ KaKaKbϕ ∧ KaKbKaϕ ∧KaKbKbϕ ∧ KbKaKaϕ ∧ KbKaKbϕ ∧ KbKbKaϕ ∧ KbKbKbϕ
E{a,b} . . .E{a,b}ϕ ≡ ...
Proof is involved: see [French, van der Hoek, Illiev, Kooi, AIJ 2013]
61 / 61