Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 ·...
78
1 Lagrangian Duality in SVM Srikumar Ramalingam Computer Vision Reading Group Oxford University 11 Jan 2008 Slides taken from http://www.stanford.edu/~boyd/cvxbook/ http://www.rpi.edu/~bennek/
Transcript of Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 ·...
![Page 1: Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 · Operations that preserve convexity pract.cal methods for establishing convex.ty of a](https://reader033.fdocuments.us/reader033/viewer/2022042119/5e98e9f3c73be4090543756a/html5/thumbnails/1.jpg)
1
Lagrangian Duality in SVMSrikumar RamalingamComputer Vision Reading Group
Oxford University11 Jan 2008
Slides taken fromhttp://www.stanford.edu/~boyd/cvxbook/
http://www.rpi.edu/~bennek/
![Page 2: Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 · Operations that preserve convexity pract.cal methods for establishing convex.ty of a](https://reader033.fdocuments.us/reader033/viewer/2022042119/5e98e9f3c73be4090543756a/html5/thumbnails/2.jpg)
2
Overview
Introduction• Convex Sets and functions
Lagrangian Duality
Duality in SVM
![Page 3: Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 · Operations that preserve convexity pract.cal methods for establishing convex.ty of a](https://reader033.fdocuments.us/reader033/viewer/2022042119/5e98e9f3c73be4090543756a/html5/thumbnails/3.jpg)
3
Affine sets, Convex Sets, Convex Hulls,Hyperplane, Halfspaces, AffineFunctions…
![Page 12: Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 · Operations that preserve convexity pract.cal methods for establishing convex.ty of a](https://reader033.fdocuments.us/reader033/viewer/2022042119/5e98e9f3c73be4090543756a/html5/thumbnails/12.jpg)
12
Convex functions, First order andsecond order conditions, preservingoperations…
![Page 63: Lagrangian Duality in SVM - University of Oxfordcvrg/Lagrangian_Duality.pdf · 2008-01-15 · Operations that preserve convexity pract.cal methods for establishing convex.ty of a](https://reader033.fdocuments.us/reader033/viewer/2022042119/5e98e9f3c73be4090543756a/html5/thumbnails/63.jpg)
63
Support Vector Machines (SVM)
Key Ideas:• “Maximize Margins”• “Do the Dual”• “Construct Kernels”
A methodology for inference based on Vapnik’sStatistical Learning Theory.