Bayesian networks. Weather data What is the Bayesian Network corresponding to Naïve Bayes?
Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting...
-
Upload
abigail-lane -
Category
Documents
-
view
227 -
download
0
description
Transcript of Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting...
![Page 1: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/1.jpg)
Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to
Boosting Decision Trees
Zijian Zheng, Geoffrey I. Webb, Kai Ming TingDeakin UniversityVictoria Australia
Appeared in ICML ‘99
![Page 2: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/2.jpg)
Paper Overview
• Description of LBR, Adaboost and Bagging• Experimental Comparison of algorithms
![Page 3: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/3.jpg)
Naïve Bayesian Tree
• Each tree node is a naïve bayes classifier
![Page 4: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/4.jpg)
Lazy Bayesian Rules
• Build a special purpose bayesian classifier based on the example to classify
• greedily choose which attributes to remain constant and which should vary
![Page 5: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/5.jpg)
![Page 6: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/6.jpg)
Boosting / Bagging
• Adaboost– train on examples– evaluate performance– re-train new classifier with weighted examples– repeat– when classifying, vote according to weights
• Bagging– train many times on samples drawn with replacement– when classifying, vote equally
![Page 7: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/7.jpg)
![Page 8: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/8.jpg)
![Page 9: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/9.jpg)
![Page 10: Lazy Bayesian Rules: A Lazy Semi-Naïve Bayesian Learning Technique Competitive to Boosting Decision…](https://reader035.fdocuments.us/reader035/viewer/2022062414/5a4d1bf17f8b9ab0599e637c/html5/thumbnails/10.jpg)