15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation...
Transcript of 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation...
![Page 1: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/1.jpg)
15-780 – Graduate AI:Lecture 1: Introduction and Logistics
J. Zico Kolter (this lecture), Nihar ShahCarnegie Mellon University
Spring 2020
1
![Page 2: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/2.jpg)
OutlineWhat is Artificial Intelligence?
A brief history of AI
Course logistics
2
![Page 3: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/3.jpg)
OutlineWhat is Artificial Intelligence?
A brief history of AI
Course logistics
3
![Page 4: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/4.jpg)
What is “AI”?
4
![Page 5: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/5.jpg)
Some classic definitionsBuilding computers that
5
Think like a human- Cognitive science / neuroscience- Can’t there be intelligence without humans?
Think rationally- Logic and automated reasoning- But, not all problems can be solved just be
reasoning
Act like a human- Turing test- ELIZA, Loebner prize- “What is 1228 x 5873?” … “I don’t know, I’m
just a human”
Act rationally- Basis for intelligence agents framework- Unclear if this captures the current scope of
AI research
![Page 6: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/6.jpg)
The pragmatist’s view
“AI is that which appears in academic conferences on AI”
(Let’s ignore the possibility of “AI is that which marketing departments call AI”)
6
![Page 7: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/7.jpg)
Paper titles in AAAI
7
1980s
![Page 8: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/8.jpg)
Paper titles in AAAI
8
1990s
![Page 9: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/9.jpg)
Paper titles in AAAI
92000s
![Page 10: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/10.jpg)
Paper titles in AAAI
102010s
![Page 11: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/11.jpg)
A broader definition
We won’t worry too much about definitions, but I personally like this one:
Artificial intelligence is the development and study of computer systems to address problems typically associated with some form of intelligence
11
![Page 12: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/12.jpg)
OutlineWhat is Artificial Intelligence?
A brief history of AI
Course logistics
12
![Page 13: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/13.jpg)
(Some) history of AI
13
![Page 14: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/14.jpg)
Prehistory (400 B.C – ) Philosophy: mind/body dualism, materialism
Mathematics: logic, probability, decision theory, game theory
Cognitive psychology
Computer engineering
14
![Page 15: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/15.jpg)
Birth of AI (1943 – 1956)1943 – McCulloch and Pitts: simple neural networks
1950 – Turing test
1955-56 – Newell and Simon: Logic Theorist
1956 – Dartmouth workshop, organized by John McCarthy, Marvin Minsky, Nathaniel Rochester, Claude Shannon
“The study is to proceed on the basis of the conjecture that every aspect of learning or any other feature of intelligence can in principle be so precisely described that a machine can be made to simulate it. … We think that a significant advance can be made in one or more of these problems if a carefully selected group of scientists work on it together for a summer.”
15
![Page 16: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/16.jpg)
Early successes (1950s – 1960s)1952 – Arthur Samuel develops checkers program, learns via self-play
1958 – McCarthy LISP, advice taker, time sharing
1958 – Rosenblatt’s Perceptron algorithm learns to recognize letters
1968-72 – Shakey the robot
1971-74 – Blocksworld planning and reasoning domain
16
![Page 17: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/17.jpg)
First “AI Winter” (Later 1970s)Many early promises of AI fall short
1969 – Minky and Pappert’s “Perceptrons” books shows that single-layer neural network cannot represent XOR function
1973 – Lighthill report effectively ends AI funding in U.K.
1970s – DARPA cuts funding for several AI projects
17
![Page 18: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/18.jpg)
Expert systems and business (1970s – 1980s)Move towards encoding domain expert knowledge as logical rules
1971-74 – Feigenbaum’s DENRAL (molecular structure prediction) and MYCIN (medical diagnoses)
1981 – Japan’s “fifth generation” computer project, intelligence computers running Prolog
1982 – R1, expert system for configuring computer orders, deployed at DEC
18
![Page 19: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/19.jpg)
Second “AI Winter” (Late 1980s – Early 1990s)As with past AI methods, expert systems fail to deliver on promises
Complexity of expert systems made them difficult to develop/maintain
1987 – DARPA cuts AI funding for expert systems
1991 – Japan’s 5th generation project fails to meet goals
19
![Page 20: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/20.jpg)
Splintering of AI (1980s – 2000s)Much of AI focus shifts to subfields: machine learning, multiagent systems, computer vision, natural language processing, robotics, etc
1982 – Backpropagation for training neural networks popularized by Rumelhart, Hopfield, Hinton (amongst many others)
1988 – Judea Pearl’s work on Bayesian networks
1995 – NavLab5 automobile drives across country steering itself 98% of the time
20
Input
Hidden
Output
![Page 21: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/21.jpg)
Focus on applications (1990s – Early 2010s)Meanwhile, AI (sometimes under a subfield), achieves some notable milestones
1997 – Deep Blue beats Gary Kasparov
2005, 2007 – Stanford and CMU respectively win DARPA grand challenge in autonomous driving
2000s – Ad placement and prediction for internet companies becomes largely AI-based
2011 – IBM’s Watson defeats human Jeopardy opponents
21
![Page 22: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/22.jpg)
“AI” Renaissance (2010s – ??)“AI” is a buzzword again; Google, Facebook, Apple, Amazon, Microsoft, etc, all have large “AI labs”
2012 – Deep neural network wins image classification contest
2013 – Superhuman performance on most Atari games via a single RL algorithm
2016 – DeepMind’s AlphaGo beats one of the top human Go players
2017 – CMU’s Libratus defeats top pro players at No-limit Texas Hold’em
22
![Page 23: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/23.jpg)
AI is all around us
23
Face detection Personal assistants
Machine translation Logistics planning
![Page 24: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/24.jpg)
OutlineWhat is Artificial Intelligence?
A brief history of AI
Course logistics
24
![Page 25: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/25.jpg)
Organization of courseAI at CMU is covered in two courses (plus many subtopic courses):• 15-381: Undergrad AI, broad introduction to a wide range of topics• 15-780: Grad AI, more focused on a few topics, leaving out others
The goal of this course is to introduce you to some of the topics and techniques that are at the forefront of modern AI research:• Search and continuous optimization • Integer programming• Machine learning and deep learning• Probabilistic modeling• Game theory• Social choice
25
![Page 26: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/26.jpg)
Course materialsMain resource for lectures, slides, etc, is the class website (updated):
http://www.cs.cmu.edu/~15780
Class discussion forums and homeworks will all be done on Diderot (setup instructions to be send out to the class this week):
https://www.diderot.one
26
![Page 27: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/27.jpg)
GradingGrading breakdown for the course:
40% homeworks (10% each)30% project20% exams (10% each, midterm and final)10% class participation
Final grades will be assigned on a curve (for which we don’t know the thresholds), but they are guaranteed to be lower than the standard A = 90-100, B=80-90, etc
27
![Page 28: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/28.jpg)
HomeworksThere will be four homeworks throughout the course
Homeworks each contain ~2 theory/derivation questions and ~2 programming questions
All submission done via Diderot (including writeups of written portions), programming portions are auto-graded
http://www.diderot.one
5 late days to use throughout semester, max of 2 late days for each assignment
28
![Page 29: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/29.jpg)
Class projectA chance to explore an applied, theoretical, or algorithm aspect of AI in more detail
To be done in groups of 2-3
Project will require a short proposal (300 words), and a final report (<=5 pages)
Video session presenting projects during final exam time
Full details to be posted to class webpage
29
![Page 30: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/30.jpg)
Midterm and finalIn-class midterm to be held on 3/4 (last day before spring break), and in-class final exam on 4/29 (last day of class)
Midterm will cover topics in course up to and including the lecture right before the midterm
Final will cover topics after midterm
Midterm and final will be closed book, closed notes (mainly for space reasons)
30
![Page 31: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/31.jpg)
Class participation
31
Your participation grade comes through your participation in in-class polls posted to Diderot during lecture
Homework for today: register for the class on Diderot, find the poll below, and fill out the answer
Poll: which letter is the best letter?A.B.C.D.
![Page 32: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/32.jpg)
Instructors and TAs
32
Zico Kolter Nihar Shah
Filipe Belbute-Peres Ziqiang Feng
(May be adding one additional TA depending on registration numbers)
![Page 33: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/33.jpg)
Recommended backgroundStudents taking this course should have experience with: mathematical proofs, linear algebra, calculus, probability, Python programming
We aren’t listing specific pre-req courses (because people get this experience from different sources), but these are required prerequisites
Please come see the instructors if you have questions about your background
33
![Page 34: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/34.jpg)
Academic integrityHomework policy: • You may discuss homework problems with other students, but you need to
specify all students you discuss with in your writeup• Your writeup and code must be written entirely on your own, without
reference to notes that you took during any group discussion
All code and written material that you submit must be entirely your own unless specifically cited (in quotes for text, or within a comment block for code) from third party sources
See the CMU policy on academic integrity for general information
https://www.cmu.edu/academic-integrity/34
![Page 35: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/35.jpg)
Student well-beingCMU and courses like this one are stressful environments
In our experience, most academic integrity violations are the product of these environments and decisions made out of desperation
Please don’t let it get to this point (or potentially much worse)
Don’t sacrifice quality of life for this course: still make time to sleep, eat well, exercise
35
![Page 36: 15-780 –Graduate AI: Lecture 1: Introduction and …./15780/slides/intro.pdfMachine translation Logistics planning Outline What is Artificial Intelligence? A brief history of AI](https://reader034.fdocuments.us/reader034/viewer/2022042404/5f18622a381aa129a04d9f86/html5/thumbnails/36.jpg)
Some parting thoughts“Computers in the future may have only 1,000
vacuum tubes and weigh only 1.5 tons.” – Popular Mechanics, 1949
“Machines will be capable, within twenty years, of doing any work a man can do.”
– Herbert Simon, 1965
36