Support Vector Machine
-
Upload
binh-duong-tran -
Category
Documents
-
view
9 -
download
1
description
Transcript of Support Vector Machine
![Page 1: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/1.jpg)
04/18/2023
Support Vector Machine
(Classification)DuongTB2
![Page 2: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/2.jpg)
04/18/2023
Application
• Spam email filtering
![Page 3: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/3.jpg)
04/18/2023
Application•optical character recognition
![Page 4: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/4.jpg)
04/18/2023
Human Detection
![Page 5: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/5.jpg)
04/18/2023
Basic IdeaDefine the margin of a linear classifier as the width that the boundary could be increased by before hitting a datapoint.
![Page 6: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/6.jpg)
04/18/2023
Basic IdeaMaximizing the margin is good according to intuition.
f(x,w,b) = sign(w x + b)
![Page 7: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/7.jpg)
04/18/2023
Non-linear SVM
BoostingKernel method
![Page 8: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/8.jpg)
04/18/2023
Boosting
![Page 9: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/9.jpg)
04/18/2023
Boosting
![Page 10: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/10.jpg)
04/18/2023
Boosting
![Page 11: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/11.jpg)
04/18/2023
Kernel Method
Φ (𝑥)
![Page 12: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/12.jpg)
04/18/2023
The “Kernel trick”
• The Linear classifier relies on dot product between vectors
• => the dot product in high dimensional space becomes:
![Page 13: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/13.jpg)
04/18/2023
Dual Problem
• )• Subject to (
• Apply dual theorem, we have:• • Subject to
![Page 14: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/14.jpg)
04/18/2023
Solve quadratic programming problem• Gradient Descent
![Page 15: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/15.jpg)
04/18/2023
References
• Christopher J.C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, pages 121–167, 1998.• John C.Platt. Fast training of support vector machine using sequential minimal
optimization. Advances in Kernel Method-Support Vector Learning, pages 185–208. MIT Press, 1999.• Yoav Freund and Robert E. Schapire. A Decision-Theoretic Generalization of On-Line
Learning and an Application to Boosting. Journal of computer and system sciences, pages 119-139 , 1997.
![Page 16: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/16.jpg)
04/18/2023
THANK YOU
![Page 17: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/17.jpg)
04/18/2023
![Page 18: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/18.jpg)
04/18/2023
![Page 19: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/19.jpg)
04/18/2023
![Page 20: Support Vector Machine](https://reader035.fdocuments.us/reader035/viewer/2022081516/563db97f550346aa9a9de5ca/html5/thumbnails/20.jpg)
04/18/2023
Sequential Minimal Optimization