Second Seminar Presentation
-
Upload
abdelrahman-al-ogail -
Category
Documents
-
view
1.039 -
download
0
description
Transcript of Second Seminar Presentation
![Page 1: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/1.jpg)
![Page 2: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/2.jpg)
Agenda
• Refreshment : Problems and Goals• Answering the why–Why we’ve used Case-Based Reasoning.–Why we’ve used Reinforcement
Learning.
• System Architecture.• Project Testing Strategy– Turing Test.– NPC (Static AI).
![Page 3: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/3.jpg)
Problems and Goals
![Page 4: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/4.jpg)
Problems and Goals
Adaptive
![Page 5: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/5.jpg)
Problems and Goals
AdaptiveIntelligent
![Page 6: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/6.jpg)
Problems and Goals
AdaptiveIntelligent Agent
Machines rely on static scripting techniques.
![Page 7: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/7.jpg)
Problems and Goals
![Page 8: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/8.jpg)
Problems and Goals
Mobile
![Page 9: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/9.jpg)
Problems and Goals
Mobile Experience
The Absence of sharing experience costs a lot.
![Page 10: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/10.jpg)
Case Based Reasoning- a Brief
![Page 11: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/11.jpg)
Why Case-Based Reasoning
![Page 12: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/12.jpg)
Why Case-Based Reasoning
Plan Learning
![Page 13: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/13.jpg)
Why Case-Based Reasoning
Plan Learning
FailureLearning
![Page 14: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/14.jpg)
Why Case-Based Reasoning
Plan Learning
CriticLearning
FailureLearning
![Page 15: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/15.jpg)
Why Case-Based Reasoning
Plan Learning
CriticLearning
FailureLearning
Prediction
![Page 16: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/16.jpg)
Reinforcement Learning – A Brief
![Page 17: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/17.jpg)
Why Reinforcement Learning
Requires No Model
Used in the Revising Phase Sub-optimal policies
Balance Exploration- Exploitation
Applies Bootstrapping
![Page 18: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/18.jpg)
Why Reinforcement Learning
Used in the Revising Phase
![Page 19: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/19.jpg)
Why Reinforcement Learning
Requires No Model
![Page 20: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/20.jpg)
Why Reinforcement Learning
Applies Bootstrapping
![Page 21: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/21.jpg)
Why Reinforcement Learning
Learn Sub-Optimal Policies
![Page 22: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/22.jpg)
Why Reinforcement Learning
Balance Exploration-Exploitation
![Page 23: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/23.jpg)
System ArchitectureI-Strategizer AI Engine : Online Case Based Planner I-StrategizerToWargus
Wargus (G
ame)
Expansion Module
Execution Module
Case Based Reasoner EE Module
Plan Retriever
Case (Plan) Base
Plan Adaptor
Plan Reviser(RL Techniques)
Plan Retainer
Perception Module
Actions Executor
Game State
Actions
Goal
Plan to be adapted
Retained Plan
Revised Plan
Retrieved Plan
Plan
Adapted Plan
Plan to be adapted
Game State
Game State
Executed Plan
Game State
Game Specific Actions
FeedbackGame Specific Feedback
![Page 24: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/24.jpg)
Case Representation : An Example
![Page 25: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/25.jpg)
Interleaved Expansion and Execution
![Page 26: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/26.jpg)
Testing Strategy – Turing Test
![Page 27: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/27.jpg)
Testing Strategy –Playing Static AI
![Page 28: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/28.jpg)
References
• Santiago Ontanon, Ashwin Ram - On-Line Case based Planning – 2010
• Kristian J.Hammond - Case-Based Planning - A Framework for planning from Experience - 1994
• Book: Reinforcement Learning An Introduction – 1998
• Matthew Molineaux, David W. Aha, & Philip Moore - Learning continuous action models in a real-time strategy environment - 2008
• Book: AI Game Engine Programming - 2009
![Page 29: Second Seminar Presentation](https://reader034.fdocuments.us/reader034/viewer/2022051609/5480bf64b4af9ffe1d8b458a/html5/thumbnails/29.jpg)
Thanks