Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...
Transcript of Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...
![Page 1: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/1.jpg)
CS B351: INTRO TO ARTIFICIAL INTELLIGENCE AND COMPUTER SIMULATIONInstructor: Kris Hauser
http://cs.indiana.edu/~hauserk
1
![Page 2: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/2.jpg)
BASICS
Class web site http://cs.indiana.edu/courses/b351
Textbook S. Russell and P. Norvig Artificial Intelligence: a Modern Approach 2nd edition or 3rd edition
2
![Page 4: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/4.jpg)
OFFICE HOURS
Kris Hauser M,Th 11-12 in Info W 300
TAs W 1-3 in Lindley 406
4
![Page 5: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/5.jpg)
AGENDA
Intro to AI Overview of class policies
5
![Page 6: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/6.jpg)
INTRO TO AI6
![Page 7: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/7.jpg)
WHAT IS AI?
AI is the reproduction of human reasoning and intelligent behavior by computational methods
7
![Page 8: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/8.jpg)
WHAT IS AI?
AI is an attempt of reproduction of human reasoning and intelligent behavior by computational methods
8
![Page 9: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/9.jpg)
WHAT IS AI?
Discipline that systematizes and automates reasoning processes to create machines that:
9
Think like humans Think rationally
Act like humans Act rationally
![Page 10: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/10.jpg)
The goal of AI is: to build machines that operate in the same way that humans thinkHow do humans think?Build machines according to theory, test how
behavior matches mind’s behaviorCognitive Science
Manipulation of symbolic knowledge How does hardware affect reasoning?
Discrete machines, analog minds10
Think like humans Think rationally
Act like humans Act rationally
![Page 11: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/11.jpg)
The goal of AI is: to build machines that perform tasks that seem to require intelligence when performed by humans
Take a task at which people are better, e.g.: Prove a theorem Play chess Plan a surgical operation Diagnose a disease Navigate in a building
and build a computer system that does it automatically
But do we want to duplicate human imperfections?
11
Think like humans Think rationally
Act like humans Act rationally
![Page 12: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/12.jpg)
The goal of AI is: to build machines that make the “best” decisions given current knowledge and resources
“Best” depending on some utility function Influences from economics, control theory
How do self-consciousness, hopes, fears, compulsions, etc. impact intelligence?
Where do utilities come from?
12
Think like humans Think rationally
Act like humans Act rationally
![Page 13: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/13.jpg)
WHAT IS INTELLIGENCE?
“If there were machines which bore a resemblance to our bodies and imitated our actions as closely as possible for all practical purposes, we should still have two very certain means of recognizing that they were not real men. The first is that they could never use words, or put together signs, as we do in order to declare our thoughts to others… Secondly, even though some machines might do some things as well as we do them, or perhaps even better, they would inevitably fail in others, which would reveal that they are acting not from understanding, …”Discourse on the Method, by Descartes (1598-1650)
13
![Page 14: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/14.jpg)
WHAT IS INTELLIGENCE?
Turing Test (c. 1950)
14
![Page 15: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/15.jpg)
AN APPLICATION OF THE TURING TEST CAPTCHA: Completely Automatic Public
Turing tests to tell Computers and Humans Apart
15
![Page 16: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/16.jpg)
CHINESE ROOM (JOHN SEARLE)
16
![Page 17: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/17.jpg)
CAN MACHINES ACT/THINK INTELLIGENTLY? Yes, if intelligence is narrowly defined as
information processing
AI has made impressive achievements showing that tasks initially assumed to require intelligence can be automatedEach success of AI seems to push further the limits of what we consider “intelligence”
17
![Page 18: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/18.jpg)
SOME ACHIEVEMENTS
Computers have won over world champions in several games, including Checkers, Othello, and Chess, but still do not do well in Go
AI techniques are used in many systems: formal calculus, video games, route planning, logistics planning, pharmaceutical drug design, medical diagnosis, hardware and software trouble-shooting, speech recognition, traffic monitoring, facial recognition, medical image analysis, part inspection, etc...
DARPA Grand Challenge: robotic car autonomously traversed 132 miles of desert
IBM’s Watson competes with Jeopardy champs
Some industries (automobile, electronics) are highly robotized, while other robots perform brain and heart surgery, are rolling on Mars, fly autonomously, …, but home robots still remain a thing of the future
18
18
![Page 19: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/19.jpg)
CAN MACHINES ACT/THINK INTELLIGENTLY? Yes, if intelligence is narrowly defined as
information processing
AI has made impressive achievements showing that tasks initially assumed to require intelligence can be automated
Maybe yes, maybe not, if intelligence cannot be separated from consciousness Is the machine experiencing thought? Strong vs. Weak AI
19
![Page 20: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/20.jpg)
20
![Page 21: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/21.jpg)
BIG OPEN QUESTIONS Is intelligent behavior just information
processing?(Physical symbol system hypothesis)
If so, can the human brain solve problems that are inherently intractable for computers? Will a general theory of intelligence emerge from neuroscience?
In a human being, where is the interface between “intelligence” and the rest of “human nature”Self-consciousness, emotions, compulsions
What is the role of the body?(Mind-body problem)
21
![Page 22: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/22.jpg)
22
AI contributes to building an information processing model of human beings, just as Biochemistry contributes to building a model of human beings based on bio-molecular interactions
Both try to explain how a human being operates
Both also explore ways to avoid human imperfections (in Biochemistry, by engineering new proteins and drug molecules; in AI, by designing rational reasoning methods)
Both try to produce new useful technologies
Neither explains (yet?) the true meaning of being human
![Page 23: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/23.jpg)
MAIN AREAS OF AI Knowledge representation
(including formal logic) Search, especially
heuristic search (puzzles, games)
Planning Reasoning under
uncertainty, including probabilistic reasoning
Learning Robotics and perception Natural language
processing23
Search
Knowledgerep.Planning
Reasoning
Learning
Agent
RoboticsPerception
Naturallanguage
... ExpertSystems
Constraintsatisfaction
![Page 24: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/24.jpg)
BITS OF HISTORY 1956: The name “Artificial Intelligence” is
coined 60’s: Search and games, formal logic and
theorem proving 70’s: Robotics, perception, knowledge
representation, expert systems 80’s: More expert systems, AI becomes an
industry 90’s: Rational agents, probabilistic reasoning,
machine learning 00’s: Systems integrating many AI methods,
machine learning, natural language processing, reasoning under uncertainty, robotics again
24
![Page 25: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/25.jpg)
SYLLABUS Introduction to AI
Philosophy, history, agent frameworks Search
Uninformed search, heuristic search, heuristics Search applications (and variants)
Constraint satisfaction, planning, game playing, motion planning
Reasoning under uncertainty Probability, planning under uncertainty, Bayesian
networks, probabilistic inference, dynamic modeling
Intro to machine learning Neural nets, decision tree learning, support vector
machines, etc.25
![Page 26: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/26.jpg)
26
B335
Robotics
I400
B552
B553
Knowledge representation and learning
B657
Computer Vision
Biologically-inspired computing
B659
I486
Q360B651
Natural Language Processing
E626
Game theory
Q570
Topics in AI
B551 S626 S675
B351
![Page 27: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/27.jpg)
CAREERS IN AI
‘Pure’ AI Academia, industry labs
Applied AI Almost any area of CS! NLP, vision, robotics Economics
Cognitive Science
27
![Page 28: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/28.jpg)
AI REFERENCES Conferences
IJCAI, ECAI, AAAI, NIPS Journals
AI, Comp. I, IEEE Trans. Pattern Anal. Mach. Intel., IEEE Int. Sys., Journal of AIR
Societies AAAI, SIGART, AISB
AI Magazine (Editor: IU’s David Leake)
28
![Page 29: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/29.jpg)
CLASS POLICIES29
![Page 30: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/30.jpg)
PREREQUISITES
C211 I recommend:
Two semesters programming Basic knowledge of data structures Basic knowledge of algorithmic complexity
30
![Page 31: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/31.jpg)
PROGRAMMING ASSIGNMENTS
Projects will be written in Python Great for scripting
Peter Norvig, Director of Research at Google, and textbook author
Easy to learn 2 weeks for each assignment
31
![Page 32: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/32.jpg)
GRADING
50% Homework 6 assignments - lowest score will be dropped
30% Final 20% Midterm
32
![Page 33: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/33.jpg)
HOMEWORK POLICY
Due at end of class on due date Typically Tuesdays
Extensions only granted in rare cases Require advance notice except emergencies
33
![Page 34: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/34.jpg)
ENROLLMENT
Add/drop deadline No penalty: Sept 3 Late drop/add: Oct 27
Waitlist deadline: Sept 4
34
![Page 35: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/35.jpg)
TAKEAWAYS
AI has many interpretations Act vs. think, human-like vs. rational Concept has evolved
‘I’ has many interpretations Turing test Chinese room
AI success stories from each perspective
35
![Page 36: Class overview, intro to AI - Belief-optimal Reasoning for Cyber ...](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592d7fa1a28abe5668b46a5/html5/thumbnails/36.jpg)
HOMEWORK
Register Textbook Survey http://cs.indiana.edu/classes/b351 Readings: R&N Ch. 1, 2, 26
36