Goal
description
Transcript of Goal
![Page 1: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/1.jpg)
Visual Attention Accelerated Vehicle Detection in Low-Altitude Airborne Video of Urban
Environment
Xianbin Cao, Senior Member, IEEE, Renjun Lin, Pingkun Yan, Senior Member, IEEE,and Xuelong Li, Senior Member, IEEE
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY MARCH 2012
![Page 2: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/2.jpg)
Goal
![Page 3: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/3.jpg)
Outline
• Introduction• Salient region extraction• Obtain regions from saliency map• Classify vehicles• Experiments
![Page 4: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/4.jpg)
Introduction
• For improving road safety and reducing urban traffic congestions caused by the increasing number of vehicles.
• Most of the AVDSs adopt expensive devices suchas infrared cameras , GPS, and high resolution satellite cameras for sensing more information
• Use single optical camera is more efficient.
![Page 5: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/5.jpg)
Introduction
![Page 6: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/6.jpg)
Salient region extraction
![Page 7: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/7.jpg)
Salient region extraction
• For color features• r, g,b,R,G,B,Y seven features• R=r-(g+b)/2 ,G=g-(r+b)/2 B=b-(r+g)/2 , Y=(r+g+b)/3
![Page 8: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/8.jpg)
Salient region extraction
• For orientation features• Use Gabor filters to generate local orientation
feature maps from intensity image I• G(σ, θ, f ) , σ = 2, f = 1 θ as {0°, 45°, 90°, 135°} four features
![Page 9: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/9.jpg)
Salient region extraction
• For motion features• the temporal differences between the current
frame and the three previous frames were computed with intervals of {1, 2, 3}
• Three features
![Page 10: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/10.jpg)
Salient region extraction
• 14 feature maps are computed for salient region extraction
![Page 11: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/11.jpg)
Salient region extraction
• i {0, 1, 2} represents ∈• j {0, 1, 2 ,…} represents the serial numbers∈• operator N(*) normalize
![Page 12: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/12.jpg)
Salient region extraction
![Page 13: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/13.jpg)
Difference without N
![Page 14: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/14.jpg)
Obtain regions from
saliency m
ap
![Page 15: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/15.jpg)
Obtain regions from saliency map
• To effectively obtain the salient regions from the final saliency map, we designed an iterative strategy using inhibition map (IM) and enhancement map (EM).
• IM:avoid picking same area again• EM:enhance regions around the detected
vehicle.
![Page 16: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/16.jpg)
Obtain regions from saliency map
![Page 17: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/17.jpg)
Obtain regions from saliency map
• Filter by size
![Page 18: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/18.jpg)
Classify vehicles
• Use cascaded classifier• 4000 vehicle (positive) samples ,2000 for train
and 2000 for test.• 6000 non-vehicle (negative) samples• All samples scaled to 32*16
![Page 19: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/19.jpg)
Experiments
• Xeon x5660 2.8 GHz computer • 4 GB DDR3-1066• 3 h of video in both the urban and highway
environments• The testing videos of traffic were captured
with the height around 90 m.• size of the video frames is 511×286
![Page 20: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/20.jpg)
Experiments
![Page 21: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/21.jpg)
Experiments
![Page 22: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/22.jpg)
Experiments
• ratio of recall rate (RR) and salient region percentage (SRP), which represents the efficiency of the salient regions extraction, is used as the evaluation criterion.
• High RR/SRP indicates that more vehicles can be covered by less extracted salient regions.
![Page 23: Goal](https://reader035.fdocuments.us/reader035/viewer/2022070421/56816185550346895dd11b7a/html5/thumbnails/23.jpg)
Experiments