Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data...
-
Upload
roxanne-sherman -
Category
Documents
-
view
223 -
download
0
Transcript of Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data...
![Page 1: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/1.jpg)
The Master AlgorithmHow the Quest for the Ultimate Learning Machine Will Remake Our World
Pedro DomingosUniversity of Washington
![Page 2: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/2.jpg)
Machine Learning
![Page 3: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/3.jpg)
Traditional Programming
Machine Learning
ComputerData
AlgorithmOutput
ComputerData
OutputAlgorithm
![Page 4: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/4.jpg)
Traditional Programming
Machine Learning
ComputerData
AlgorithmOutput
MasterAlgorithm
Data
OutputAlgorithm
![Page 5: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/5.jpg)
The Five Tribes of Machine Learning
Tribe Origins Master Algorithm
Symbolists Logic, philosophy Inverse deduction
Connectionists Neuroscience Backpropagation
Evolutionaries Evolutionary biology Genetic programming
Bayesians Statistics Probabilistic inference
Analogizers Psychology Kernel machines
![Page 6: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/6.jpg)
Symbolists
Tom Mitchell Steve Muggleton Ross Quinlan
![Page 7: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/7.jpg)
Inverse Deduction
Addition Subtraction
2 + 2――― = ?――
2 + ?――― = 4――
![Page 8: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/8.jpg)
Inverse Deduction
Deduction
Socrates is human + Humans are mortal .――――――――――― = ?
Induction
Socrates is human + ?――――――――――― = Socrates is mortal
―――――――――― ――――――――――
![Page 9: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/9.jpg)
Spot the Biologist in this Picture
![Page 10: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/10.jpg)
Connectionists
Yann LeCun Geoff Hinton Yoshua Bengio
![Page 11: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/11.jpg)
A Neuron
![Page 12: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/12.jpg)
An Artificial Neuron
![Page 13: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/13.jpg)
Backpropagation
![Page 14: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/14.jpg)
The Google Cat Network
![Page 15: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/15.jpg)
Evolutionaries
John Koza John Holland Hod Lipson
![Page 16: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/16.jpg)
Genetic Algorithms
![Page 17: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/17.jpg)
Genetic Programming
![Page 18: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/18.jpg)
Evolving Robots
![Page 19: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/19.jpg)
Bayesians
David Heckerman Judea Pearl Michael Jordan
![Page 20: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/20.jpg)
Probabilistic Inference
![Page 21: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/21.jpg)
Probabilistic Inference
![Page 22: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/22.jpg)
Spam Filters
![Page 23: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/23.jpg)
Analogizers
Peter Hart Vladimir Vapnik Douglas Hofstadter
![Page 24: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/24.jpg)
Nearest Neighbor
![Page 25: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/25.jpg)
Kernel Machines
![Page 26: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/26.jpg)
Recommender Systems
![Page 27: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/27.jpg)
The Big Picture
Tribe Problem Solution
Symbolists Knowledge composition Inverse deduction
Connectionists Credit assignment Backpropagation
Evolutionaries Structure discovery Genetic programming
Bayesians Uncertainty Probabilistic inference
Analogizers Similarity Kernel machines
![Page 28: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/28.jpg)
The Big Picture
Tribe Problem Solution
Symbolists Knowledge composition Inverse deduction
Connectionists Credit assignment Backpropagation
Evolutionaries Structure discovery Genetic programming
Bayesians Uncertainty Probabilistic inference
Analogizers Similarity Kernel machines
But what we really need isa single algorithm that solves all five!
![Page 29: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/29.jpg)
Putting the Pieces Together
RepresentationProbabilistic logic (e.g., Markov logic networks)Weighted formulas → Distribution over states
EvaluationPosterior probabilityUser-defined objective function
OptimizationFormula discovery: Genetic programming Weight learning: Backpropagation
![Page 30: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/30.jpg)
Toward a Universal Learner
Much remains to be done . . .We need your ideas
![Page 31: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/31.jpg)
What a Universal Learner Will EnableHome Robots
Cancer Cures 360o Recommenders
World Wide Brains
![Page 32: Pedro Domingos University of Washington. Traditional Programming Machine Learning Computer Data Algorithm Output Computer Data Output Algorithm.](https://reader036.fdocuments.us/reader036/viewer/2022062423/5697bfdd1a28abf838cb1609/html5/thumbnails/32.jpg)