Introduction to Machine Learning - Brown...
Transcript of Introduction to Machine Learning - Brown...
![Page 1: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/1.jpg)
Introduction to Machine Learning
Brown University CSCI 1950-F, Spring 2011
Instructor: Erik Sudderth Graduate TAs: Soumya Ghosh & Jason Pacheco
Head Undergraduate TA: Max Barrows
Undergraduate TAs: William Allen & Siddhartha Jain
![Page 2: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/2.jpg)
Visual Object Recognition
trees
skyscraper sky
bell
dome
temple buildings
sky
![Page 3: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/3.jpg)
Spam Filtering •! Binary classification
problem: is this e-mail useful or spam?
•! Noisy training data: messages previously marked as spam
•! Wrinkle: spammers evolve to counter filter innovations
Spam Filter Express http://www.spam-filter-express.com/
![Page 4: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/4.jpg)
Collaborative Filtering
![Page 5: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/5.jpg)
Social Network Analysis
Chang, Boyd-Graber, & Blei, KDD 2009
•! Unsupervised discovery and visualization of relationships among people, companies, etc.
•! Example: infer relationships among named entities directly from Wikipedia entries
![Page 6: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/6.jpg)
Climate Modeling •! Satellites measure sea-
surface temperature at sparse locations !! Partial coverage of
ocean surface !! Sometimes obscured by
clouds, weather •! Would like to infer a
dense temperature field, and track its evolution
NASA Seasonal to Interannual Prediction Project http://ct.gsfc.nasa.gov/annual.reports/ess98/nsipp.html
![Page 7: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/7.jpg)
Speech Recognition •! Given an audio
waveform, robustly extract & recognize any spoken words
•! Statistical models can be used to !! Provide greater
robustness to noise !! Adapt to accent of
different speakers !! Learn from training
S. Roweis, 2004
![Page 8: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/8.jpg)
Target Tracking
Radar-based tracking of multiple targets
Visual tracking of articulated objects
(L. Sigal et. al., 2006)
•! Estimate motion of targets in 3D world from indirect, potentially noisy measurements
![Page 9: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/9.jpg)
Robot Navigation: SLAM Simultaneous Localization and Mapping
CAD Map
Estimated Map
Landmark SLAM
•! As robot moves, estimate its pose & world geometry
(S. Thrun, San Jose Tech Museum)
(E. Nebot, Victoria Park)
![Page 10: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/10.jpg)
Human Tumor Microarray Data
![Page 11: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/11.jpg)
Financial Forecasting
•! Predict future market behavior from historical data, news reports, expert opinions, …
http://www.steadfastinvestor.com/
![Page 12: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/12.jpg)
What is “machine learning”? "! Given a collection of examples (“training
data”), predict something about novel examples "! The novel examples are usually incomplete
"! Example (via Mark Johnson): sorting fish "! Fish come off a conveyor belt in a fish factory "! Your job: figure out what kind each fish is
![Page 13: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/13.jpg)
Automatically sorting fish
![Page 14: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/14.jpg)
Sorting fish as a machine learning problem
"! Training data D = ((x1,y1), ..., (xn,yn)) "! A vector of measurements (features) xi
(e.g., weight, length, color) of each fish
"! A label yi for each fish
"! At run-time: "! given a novel feature vector x "! predict the corresponding label y
![Page 15: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/15.jpg)
Length as a feature for classifying fish
"! Need to pick a decision boundary "! Minimize expected loss
![Page 16: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/16.jpg)
Lightness as a feature for classifying fish
![Page 17: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/17.jpg)
Length and lightness together as features
"! Not unusual to have millions of features
![Page 18: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/18.jpg)
More complex decision boundaries
![Page 19: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/19.jpg)
Training set error ! test set error
"! Occam's razor "! Bias-variance dilemma
"! More data!
![Page 20: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/20.jpg)
Recap: designing a fish classifier "! Choose the features
"! Can be the most important step! "! Collect training data "! Choose the model (e.g., shape of decision
boundary) "! Estimate the model from training data "! Use the model to classify new examples
"! Machine learning is about last 3 steps
![Page 21: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/21.jpg)
Supervised versus unsupervised learning
•! Supervised learning !! Training data includes labels we must predict:
labels are visible variables in training data •! Unsupervised learning
!! Training data does not include labels: labels are hidden variables in training data
•! For classification models, unsupervised learning usually becomes a kind of clustering
![Page 22: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/22.jpg)
Unsupervised learning for classifying fish
Salmon versus Sea Bass? Adults versus juveniles?
![Page 23: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/23.jpg)
Machine Learning Problems
Supervised Learning Unsupervised Learning
Dis
cret
e C
ontin
uous
classification or categorization
regression
clustering
dimensionality reduction
![Page 24: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/24.jpg)
Course Prerequisites •! Prerequisites: comfort with basic
!! Programming: Matlab for assignments !! Calculus: simple integrals, partial derivatives !! Linear algebra: matrix factorization, eigenvalues !! Probability: discrete and continuous
•! Probably sufficient: You did well in (and still remember!) at least one course in each area
•! We will do some review, but it will go quickly! !! Graduate TAs will lead weekly recitations to
review prereqs, work example problems, etc.
![Page 25: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/25.jpg)
Course Evaluation •! 50% homework assignments
!! Mathematical derivations for statistical models !! Computer implementation of learning algorithms !! Experimentation with real datasets
•! 20% midterm exam: March 15 !! Pencil and paper, focus on mathematical analysis
•! 25% final exam: May 19, 2:00pm •! 5% class participation:
!! Lectures will contain material not directly from text !! Lots of regular office hours to get help
![Page 26: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/26.jpg)
CS Graduate Credit •! CS Master’s and Ph.D. students who want
2000-level credit must complete a project •! Flexible: Any application of material from (or
closely related to) the course to a problem or dataset you care about
•! Evaluation: !! Late March: Very brief (few paragraph) proposal !! Early May: Short oral presentation of results !! Mid May: Written project report (4-8 pages)
•! A poor or incomplete project won’t hurt your grade, but will mean you don’t get grad credit
![Page 27: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/27.jpg)
Course Readings
http://www.cs.ubc.ca/~murphyk/MLbook/index.html
![Page 28: Introduction to Machine Learning - Brown Universitycs.brown.edu/courses/csci1950-f/spring2011/lectures/2011-01-27... · 27/01/2011 · •!Model selection, cross-validation, overfitting](https://reader034.fdocuments.us/reader034/viewer/2022051805/5ff60fa441af172aeb185605/html5/thumbnails/28.jpg)
Machine Learning Buzzwords •! Bayesian and frequentist estimation: MAP and ML •! Model selection, cross-validation, overfitting •! Linear least squares regression, logistic regression •! Robust statistics, sparsity, L1 vs. L2 regularization •! Features and kernel methods: support vector
machines (SVMs), Gaussian processes •! Graphical models: hidden Markov models, Markov
random fields, efficient inference algorithms •! Expectation-Maximization (EM) algorithm •! Markov chain Monte Carlo (MCMC) methods •! Mixture models, PCA & factor analysis, manifolds