1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.
-
Upload
caren-sibyl-cameron -
Category
Documents
-
view
213 -
download
0
Transcript of 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.
![Page 1: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/1.jpg)
1Challenge the future
Coastal Image ClassificationBas Hoonhout, Max Radermacher, Fedor Baart
![Page 2: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/2.jpg)
2Challenge the future
Coastal Image Classification
![Page 3: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/3.jpg)
3Challenge the future
Why is it useful?
![Page 4: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/4.jpg)
4Challenge the future
How does it work?
1. Segmentation (superpixels)Create clusters of pixels with similar intrinsic properties
2. Feature extractionExtract as much information as possible from superpixels
3. Model construction and trainingTrain a model to discriminate between classes using features
4. Model predictionPredict classification of an unseen image
![Page 5: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/5.jpg)
5Challenge the future
Step 1: segmentation (superpixels)
Intensity: R, G, B, C, Y, M, K, …Position: N, M… and gradients and filters
Intensity, position and gradientsShape, texture, …Variance, frequency, …
![Page 6: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/6.jpg)
6Challenge the future
Step 2: feature extraction
![Page 7: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/7.jpg)
7Challenge the future
Step 2: feature extraction16 channels and1727 featuresper superpixel
![Page 8: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/8.jpg)
8Challenge the future
Step 3: model construction and training
![Page 9: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/9.jpg)
9Challenge the future
Step 3: model construction and training
C00
f1 … fK
…
f1 … fK
C0M
f1 … fK
…
f1 … fK
…
f1 … fK
…
f1 … fK
CN0
f1 … fK
…
f1 … fK
CNM
f1 … fK
C00
f1 … fK
…
f1 … fK
C0M
f1 … fK
…
f1 … fK
…
f1 … fK
…
f1 … fK
CN0
f1 … fK
…
f1 … fK
CNM
f1 … fK
Ψ01 Ψ0M
… …
ΨN1 ΨNM
Ψ10 … Ψ1M
ΨN0 ... ΨNM
![Page 10: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/10.jpg)
10Challenge the future
Step 3: model construction and training
pixel intensity
sea beach
![Page 11: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/11.jpg)
11Challenge the future
Step 3: model construction and training
hue
satu
rati
on
![Page 12: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/12.jpg)
12Challenge the future
Step 3: model construction and training
et cetera, until we have a 1727-dimensional feature space
![Page 13: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/13.jpg)
13Challenge the future
Step 4: model prediction
hue
satu
rati
on
sea
beach
![Page 14: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/14.jpg)
14Challenge the future
Performance
• Ongoing research!
• 192 manually annotated Argus imagesdoi:10.4121/uuid:08400507-4731-4cb2-a7ec-9ed2937db119
• Training set 75%, test set 25%
• Last benchmark test: >90% correct
• Target benchmark test: >95% correct
![Page 15: 1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart.](https://reader031.fdocuments.us/reader031/viewer/2022032805/56649ef55503460f94c08f5a/html5/thumbnails/15.jpg)
15Challenge the future
Take home messages
Classify coastal images?Spend your creativity on features!
Classify large datasets?Go for full automation!
What would you do with 95%accurate, automated classificationof coastal images?
flamingo.tudelft.nl
openearth.nl