HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE...
Transcript of HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE...
![Page 1: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/1.jpg)
HUMAN-LEVEL ARTIFICIAL INTELIGENCE
& COGNITIVE SCIENCE
Nils J. Nilsson Stanford AI Lab
http://ai.stanford.edu/~nilsson
Symbolic Systems 100, April 15, 2008 1
![Page 2: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/2.jpg)
OUTLINE
Computation and Intelligence
Approaches Toward HLAI
The Current Situation
2
![Page 3: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/3.jpg)
THE COMPUTER: A UNIVERSAL MACHINE
“It can be shown that a single special machine of that type [a Turing machine] can be made to do the work of all. It could in fact be made to work as a model of any other machine. The special machine may be called the universal machine.” —Alan Turing
“The importance of the universal machine is clear. We do not need to have an infinity of different machines doing different jobs. A single one will suffice. The engineering problem of producing various machines for various jobs is replaced by the office work of ‘programming’ the universal machine to do these jobs.” —Alan Turing
“[Turing] decided the scope of the computable encompassed far more than could be captured by explicit instruction notes, and quite enough to include all that human brains did, however creative or original.” —Andrew Hodges, a Turing Biographer
3
![Page 4: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/4.jpg)
THE PHYSICAL SYMBOL SYSTEM HYPOTHESIS (PSSH)
“A physical symbol system [i.e., a computer] has the necessary and sufficient means for intelligent action.” —Allen Newell and Herbert Simon
Relevance to Cognitive Science: Computational processes can explain (be a theory of) human intelligence.
Relevance to AI: Computational processes can implement human intelligence.
But, it’s just a hypothesis! 4
![Page 5: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/5.jpg)
THE NAYSAYERS CLAIM (Among Other Things)
“THE BRAIN IS NOT A COMPUTER!” Computation: mainly serial 109 ops/sec 109 transistors digital/discrete (even binary!) disembodied silicon subject to crashes . . .
The Brain: highly parallel 103 ops/sec 1014 neurons; 1017 synapses analog/continuous embodied protein fault-tolerant . . .
5
![Page 6: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/6.jpg)
WHAT IS A COMPUTER? WHAT IS A BRAIN?
Programs
Registers, Machine Ops
Logic Gates (AND’s, OR’s, )
0’s and 1’s
…
Transistor Currents, Magnetizations
Quantum Mechanics
Cell Assemblies/Modules?
Neurons, Axons, Dendrites
Models of Neo-Cortex
Perceptual/Motor Apparatus
Human Intelligence
Desires, Beliefs, Intentions?
Mentalese?
???
Goals, Plans, Reactions?
???
CS
EE
Cog. Sci.
Phys.
Plans, Goals, Inference, Logic
Human-Level AI ? ? ?
AI
Depolarizations
Neurotransmitters
Genomic Activity
Chemical Reactions
Neur. Sci.
Bio. Chem.
Symbol Processing Data Structures (Lists, etc.)
Graphical Models, “Blackboards”, Semantic Networks Neural Networks
6
![Page 7: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/7.jpg)
CAN COMPUTATIONAL SYSTEMS BE INTELLIGENT?
HOW WOULD WE KNOW?
The Turing Test
The “Employment” Test
7
![Page 8: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/8.jpg)
Meeting and Convention Planner Maid and Housekeeping Cleaner Receptionist Financial Examiner Computer Programmer Roofer’s Helper Library Assistant Procurement and Sales Engineer Farm, Greenhouse, Nursery Worker Dishwasher Home Health Aide
Small Engine Repairer Paralegal Lodging Manager Proofreader Tour Guide and Escort Geographer Engine and Other Machine Assembler Security Guard Retail Salesperson Marriage and Family Counselor Hand Packer and Packager
*From “America’s Job Bank,” a list of more than 1,500 jobs. Available at www.jobsearch.org/help/employer/SSONetJobCodeListbyCategory2.html
SOME JOBS THAT HUMANS PERFORM*
CAN THEY BE AUTOMATED?
8
![Page 9: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/9.jpg)
9
![Page 10: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/10.jpg)
HOW TO PROCEED?
LET’S LOOK AT SOME THINGS AI HAS TRIED
10
![Page 11: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/11.jpg)
• Try to program some fundamental processes thought to be involved in intelligence
• Try to imitate the brain
• Try to simulate the performance of ever more complex biological organisms
• Try to simulate biological evolution
• Try to “educate” simple (child-like) programs to make them more intelligent and capable
• Try to program some activities thought to require intelligence
11
THINGS AI HAS TRIED
![Page 12: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/12.jpg)
1. Programming Activities That Require Intelligence
Game playing Theorem proving Pattern recognition (images, speech, . . .) Natural language understanding Autonomous activity (robots that can perceive, plan and act) Expert judgment . . .
12
![Page 13: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/13.jpg)
Game-Playing
13
![Page 14: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/14.jpg)
Speech Recognition
14
![Page 15: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/15.jpg)
Autonomous Activity
15
![Page 16: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/16.jpg)
Autonomous Activity
16
![Page 17: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/17.jpg)
Expert Judgment
Part of a Large Bayesian Network Used for the Diagnosis of Hepatobiliary Diseases
17
![Page 18: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/18.jpg)
WOULD SOME COMBINATION OF ALL OF THESE SKILLS
ADD UP TO HLAI?
18
![Page 19: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/19.jpg)
2. Programming Processes Thought to be Involved in Intelligence
Logical reasoning Probabilistic reasoning Search Image processing Knowledge representation Learning Syntactic analysis Planning . . .
19
![Page 20: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/20.jpg)
Logical Reasoning
Resolution Theorem Proving
Propositional Satisfiability (SAT) 20
![Page 21: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/21.jpg)
Probabilistic Reasoning
Bayesian Belief Networks
“Why won’t the car start?”
21
![Page 22: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/22.jpg)
Search
A*, Hill-Climbing Recursive Back-Tracking
22
![Page 23: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/23.jpg)
Image Processing
E. g., Edge Extraction 23
![Page 24: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/24.jpg)
Representing Knowledge
Semantic Networks, Cyc, WordNet 24
![Page 25: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/25.jpg)
100
-100 90
90
Learning
E. g., Reinforcement Learning 25
80 80
![Page 26: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/26.jpg)
WOULD SOME COMBINATION OF PROCESSES LIKE THESE
PRODUCE HLAI?
26
![Page 27: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/27.jpg)
3. Trying to Imitate the Brain
Neural Networks
Models of the Neo-Cortex
27
![Page 28: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/28.jpg)
Neural Networks
Sejnowski, T. J. and Rosenberg, C. R., Parallel networks that learn to pronounce English text, Complex Systems 1, 145-168 (1987).
Input: Text Versions of English Words
Output: Sound
Training: Change Weights to Make Sound More Correct
28
![Page 29: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/29.jpg)
Models of Neo-Cortex
Jeff Hawkins, Tom Dean, David Mumford, Geoff Hinton, . . .
Large Graphical Models
29
![Page 30: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/30.jpg)
Rod Brooks’s Creepy-Crawly Things
4. Simulating Simple Biological Organisms
30
![Page 31: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/31.jpg)
Genetic Algorithms, Genetic Programming
5. Simulating Biological Evolution
http://www.cs.northwestern.edu/~fjs750/netlogo/final/gpdemo.html
Target-Seeking Demo
http://www.handshake.de/user/blickle/Truck/index.html
Truck-Backing Demo
31
![Page 32: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/32.jpg)
Turing’s “Child Programme”
Cassimatis’s “Cognitive Substrate”
Lenat’s “CYC Bootstrapping”
6. “Educating” Educable Programs
32
![Page 33: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/33.jpg)
WHICH OF THESE APPROACHES WILL BE SUCCESSFUL?
WE’LL HAVE TO WAIT AND SEE!
33
![Page 34: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/34.jpg)
THESE EFFORTS HAVE PRODUCED A
GROWING ARMAMENTARIUM OF
TECHNICAL TOOLS
IN THE MEANTIME:
34
![Page 35: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/35.jpg)
Here is a Partial List: Bayesian Belief Networks Hidden Markov Models Kalman Filtering POMDP’s A* Global Search Hill-Climbing Local Search GA/GP Resolution Theorem Prvg. SAT Encodings/Solvers Semantic Networks Reinforcement Learning
Neural Networks Backpropagation Support Vector Machines Blackboard Architectures Monte Carlo Methods Statistical Grammars Expectation Maximization Inductive Logic Programming Teleo-Reactive Programs Particle Filtering Model-Based Vision
Will They Help Us Achieve HLAI? Are More Tools Needed? 35
![Page 36: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/36.jpg)
THE CURRENT SITUATION The Tools Are Being Used to Solve Problems in Several Fields:
Biology Genomics Chemistry Medicine Aeronautics Geology Data Mining Business . . .
But Little Work is Being Done Toward HLAI. Why? 36
![Page 37: HUMAN-LEVEL ARTIFICIAL INTELIGENCE COGNITIVE SCIENCEweb.stanford.edu/~davies/Symbsys100-Spring0708/Nilsson-lecture... · HUMAN-LEVEL ARTIFICIAL INTELIGENCE & COGNITIVE SCIENCE Nils](https://reader033.fdocuments.us/reader033/viewer/2022042800/5a7762367f8b9a93088dcaef/html5/thumbnails/37.jpg)
PETER HART’S QUESTION (AI’s Progress)
Age
Date ?? 1970
40
diagnostician
20
2005
hot-rod driver
10
10-year-old human
37