Identificationofanimalspecies
Transcript of Identificationofanimalspecies
![Page 1: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/1.jpg)
Identification of animal images based on DNA
Lior Wolf and Yoni Donner The School of Computer Science
Tel-Aviv University
![Page 2: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/2.jpg)
Visual appearance is largely determined by genetics …
![Page 3: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/3.jpg)
…and appearance affecting genes have been identified
• Eye colorSturm & Frudakis (2004).
• Skeletel structureChase, et al. (2002).
• Dog heightSutterm, (2007).
![Page 4: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/4.jpg)
Our work is unique in the following ways:
High Dimensionalworking directly with images
Using very short 500bp sequences
Correlative linksNot causal ones
![Page 5: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/5.jpg)
We employ mtDNA
• Has no causal link to appearance
• Easy to collect
• Good marker for evolutionary history
![Page 6: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/6.jpg)
Tasks
1. Image synthesis given DNA (!)
2. Identification of the correct image given DNA
![Page 7: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/7.jpg)
Image synthesisExtracted contour
Recovered contour
Originalimage
The algorithm predicts the contour of an unseen species based on its mtDNA
![Page 8: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/8.jpg)
Identification
AcanthopagrusButcheri
Epinephelusongus
?
Given mtDNA, the algorithm identifies the correct unseen image
![Page 9: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/9.jpg)
Data sets
Fishes of Australia Birds of North America
Ants of Madagascar
Dorsal view Head view Profile view
![Page 10: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/10.jpg)
MethodsThree technical questions:
1. How do we represent the genetic sequences?
2. How do we represent the images?
3. How do we learn the connections?
Simple intuitive vector representation
Well known techniques: Bag of SIFT or C1
Regularized CCA
![Page 11: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/11.jpg)
Results• 93 fish species, 82 for training, 11 for testing
• Significantly better than chance or NN
![Page 12: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/12.jpg)
Results
Fish: 90% correct Birds: 72% correct
Dorsal: 59% correct
Head: 56% correct
Profile: 64% correct
![Page 13: Identificationofanimalspecies](https://reader035.fdocuments.us/reader035/viewer/2022062513/5554720ab4c905aa798b5764/html5/thumbnails/13.jpg)
Conclusions• Visual identification and image synthesis based on
DNA sequences is a reality
• Employing the power of correlation rather than causality
• Future applications?
✓ Virtual line-ups
✓ Personalized medication
✓ Prediction of appearance of extinct animals