Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier...
-
Upload
bryan-lang -
Category
Documents
-
view
215 -
download
0
Transcript of Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier...
![Page 1: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/1.jpg)
Introducing the Separability Matrix for ECOC codingMiguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol
1
![Page 2: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/2.jpg)
Outline
• Classification problems and the ECOC framework.• Motivation.• The Separability Matrix.• The Confusion-Separability Extension Coding.• Experiments and Results.• Conclusions and Future Work.
2
![Page 3: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/3.jpg)
Introduction to the ECOC framework
• This framework is composed of two different steps :• Coding : Decompose a given N-class problem into a set of
n binary problems.• Decoding : Given a test sample s, determine its category.
3
• In classification tasks, the goal is to classify and object among a certain number of possible categories.
++
++
![Page 4: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/4.jpg)
Introduction to the ECOC framework
• At the decoding step a new sample s is classified by comparing the binary responses to the rows of M by means of a decoding measure .• Different types of decoding based on the distance used (i.e.
Hamming, Euclidean, etc.)
4
![Page 5: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/5.jpg)
Motivation
• Standard predefined strategies may not be suitable for a given problem.• Literature often suggested the use of equidistant codes.• In [1] we show how reduced codes can perform as well
as standard designs with far less number of dichotomizers.• Those reduced codes can be extended in a problem-
dependent way to benefit from error-correcting principles.• How can we identify those codes?
[1] Compact Evolutionary Design of Error Correcting Output Codes, M. Bautista, S. Escalera, X. Baró, O. Pujol, J. Vitrià and P. Radeva
5
![Page 6: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/6.jpg)
The Separability Matrix• The Separability matrix S contains the pairwise distance
between the codewords in M.• With this matrix we can analyze the correction capability of
M since,
• Standard ECOC designs shown constant Separability matrices.• Identify those classes that need an increment of distance in
order to benefit from error-correcting principles.
6
![Page 7: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/7.jpg)
①Find the most confused classes : ②Compute and Extension matrix E which increments③Fill the empty Extension codes taking into account the
confusion of with the rest of the classes.④Update Confusion and Separability matrices.
The CSE Coding Algorithm
7
![Page 8: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/8.jpg)
Experiments: Data
• We tested the novel methodology on several public datasets from the UCI Machine Learning Repository.
• In addition we perform experiments with 3 public Computer Vision problems.• The ARFace dataset with 20 classes.• The Traffic Sign dataset with 36 classes.• The MPEG dataset with 70 classes. 8
![Page 9: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/9.jpg)
Experiments and Results
• Results for UCI and Computer Vision experiments with SVM as the base classifier.
9
![Page 10: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/10.jpg)
Conclusions and Future Work
• The Separability Matrix is introduced as a novel tool to analyze and enhance ECOC coding designs.
• The Extension Algorithm proposed can be applied to any existing ECOC scheme.
• A new coding design based on the Separability matrix is introduced obtaining significant performance improvements over state-of-the-art ECOC designs.
• The proposed methodology reduces the number of base classifiers needed in comparison with state-of-the-art designs.
10
![Page 11: Introducing the Separability Matrix for ECOC coding Miguel Angel Bautista, Sergio Escalera, Xavier Baró & Oriol Pujol 1.](https://reader035.fdocuments.us/reader035/viewer/2022062721/56649f205503460f94c38873/html5/thumbnails/11.jpg)
Thank you!
11