Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade...
Transcript of Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade...
![Page 1: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/1.jpg)
Detection
![Page 2: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/2.jpg)
Challenges: robustness
Illumination Object pose Clutter
Viewpoint Intra-class
appearance Occlusions
![Page 3: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/3.jpg)
Challenges: robustness
Realistic scenes are crowded, cluttered,
have overlapping objects.
![Page 4: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/4.jpg)
Challenges: importance of context
![Page 5: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/5.jpg)
Challenges: importance of context
![Page 6: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/6.jpg)
Challenges: complexity
• Thousands to millions of pixels in an image
• 3,000-30,000 human recognizable object categories
• 30+ degrees of freedom in the pose of articulated objects (humans)
• Billions of images indexed by Google Image Search
• 18 billion+ prints produced from digital camera images in 2004
• 295.5 million camera phones sold in 2005
• About half of the cerebral cortex in primates is devoted to processing visual information [Felleman and van Essen 1991]
![Page 7: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/7.jpg)
Challenges: learning with
minimal supervision More Less
![Page 8: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/8.jpg)
What works most reliably today
• Reading license plates, zip codes, checks
![Page 9: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/9.jpg)
What works most reliably today
• Reading license plates, zip codes, checks
• Fingerprint recognition
![Page 10: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/10.jpg)
What works most reliably today
• Reading license plates, zip codes, checks
• Fingerprint recognition
• Face detection
![Page 11: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/11.jpg)
What works most reliably today
• Reading license plates, zip codes, checks
• Fingerprint recognition
• Face detection
• Recognition of flat textured objects (CD covers,
book covers, etc.)
![Page 12: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/12.jpg)
What works most reliably today
• Reading license plates, zip codes, checks
• Fingerprint recognition
• Face detection
• Recognition of flat textured objects (CD covers,
book covers, etc.)
• Recognition of objects is starting to work
![Page 13: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/13.jpg)
Generic category recognition:
basic framework
• Build/train object model
– Choose a representation
– Learn or fit parameters of model / classifier
• Generate candidates in new image
• Score the candidates
![Page 14: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/14.jpg)
Generic category recognition:
representation choice
Window-based Part-based
![Page 15: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/15.jpg)
Supervised classification
• Given a collection of labeled examples, come up with a
function that will predict the labels of new examples.
“four”
“nine”
? Training examples Novel input
![Page 16: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/16.jpg)
Learning skin colors
![Page 17: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/17.jpg)
Simple holistic descriptions of image content
grayscale / color histogram
vector of pixel intensities
Window-based models
Building an object model
![Page 18: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/18.jpg)
Window-based models
Building an object model
• Pixel-based representations sensitive to small shifts
• Color or grayscale-based appearance description can be
sensitive to illumination and intra-class appearance
variation
![Page 19: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/19.jpg)
Window-based models
Building an object model
• Consider edges, contours, and (oriented) intensity
gradients
![Page 20: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/20.jpg)
Window-based models
Building an object model
• Consider edges, contours, and (oriented) intensity
gradients
• Summarize local distribution of gradients with histogram
Locally orderless: offers invariance to small shifts and rotations
Contrast-normalization: try to correct for variable illumination
![Page 21: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/21.jpg)
Window-based models
Building an object model
Car/non-car
Classifier
Yes, car.
No, not a car.
Given the representation, train a binary classifier
![Page 22: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/22.jpg)
Discriminative classifier construction
106 examples
Nearest neighbor
Shakhnarovich, Viola, Darrell 2003
Berg, Berg, Malik 2005...
Neural networks
LeCun, Bottou, Bengio, Haffner 1998
Rowley, Baluja, Kanade 1998
…
Support Vector Machines Conditional Random Fields
McCallum, Freitag, Pereira
2000; Kumar, Hebert 2003
…
Guyon, Vapnik
Heisele, Serre, Poggio, 2001,…
Boosting
Viola, Jones 2001,
Torralba et al. 2004,
Opelt et al. 2006,…
![Page 23: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/23.jpg)
Window-based models
Generating and scoring candidates
Car/non-car
Classifier
![Page 24: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/24.jpg)
Window-based object detection: recap
Car/non-car
Classifier
Feature
extraction
Training examples
Training:
1. Obtain training data
2. Define features
3. Define classifier
Given new image:
1. Slide window
2. Score by classifier
![Page 25: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/25.jpg)
Viola-Jones face detector
![Page 26: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/26.jpg)
Main idea:
– Represent local texture with efficiently computable
“rectangular” features within window of interest
– Select discriminative features to be weak classifiers
– Use boosted combination of them as final classifier
– Form a cascade of such classifiers, rejecting clear
negatives quickly
Viola-Jones face detector
![Page 27: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/27.jpg)
Viola-Jones detector: features
Feature output is difference between
adjacent regions
Efficiently computable
with integral image: any
sum can be computed in
constant time.
“Rectangular” filters
Value at (x,y) is
sum of pixels
above and to the
left of (x,y)
Integral image
![Page 28: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/28.jpg)
Computing sum within a rectangle • Let A,B,C,D be the
values of the integral image at the corners of a rectangle
• Then the sum of original image values within the rectangle can be computed as: sum = A – B – C + D
• Only 3 additions are required for any size of rectangle!
D B
C A
![Page 29: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/29.jpg)
Viola-Jones detector: features
Feature output is difference between
adjacent regions
Efficiently computable
with integral image: any
sum can be computed in
constant time
Avoid scaling images
scale features directly
for same cost
“Rectangular” filters
Value at (x,y) is
sum of pixels
above and to the
left of (x,y)
Integral image
![Page 30: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/30.jpg)
Considering all
possible filter
parameters: position,
scale, and type:
180,000+ possible
features associated
with each 24 x 24
window
Which subset of these features should we
use to determine if a window has a face?
Use AdaBoost both to select the informative
features and to form the classifier
Viola-Jones detector: features
![Page 31: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/31.jpg)
Viola-Jones detector: AdaBoost
• Want to select the single rectangle feature and threshold
that best separates positive (faces) and negative (non-
faces) training examples, in terms of weighted error.
Outputs of a possible
rectangle feature on
faces and non-faces.
…
Resulting weak classifier:
For next round, reweight the
examples according to errors,
choose another filter/threshold
combo.
![Page 32: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/32.jpg)
AdaBoost Algorithm Start with
uniform weights
on training
examples
Evaluate
weighted error
for each feature,
pick best.
Re-weight the examples:
Incorrectly classified -> more weight
Correctly classified -> less weight
Final classifier is combination of the
weak ones, weighted according to
error they had.
{x1,…xn} For T rounds
![Page 33: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/33.jpg)
First two features
selected
Viola-Jones Face Detector: Results
![Page 34: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/34.jpg)
Lots of windows to search !
• Even if the filters are fast to compute, each new
image has a lot of possible windows to search.
• How to make the detection more efficient?
![Page 35: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/35.jpg)
Cascading classifiers for detection
• Form a cascade with low false negative rates early on
• Apply less accurate but faster classifiers first to immediately
discard windows that clearly appear to be negative
![Page 36: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/36.jpg)
Viola-Jones detector: summary
Train with 5K positives, 350M negatives
Real-time detector using 38 layer cascade
6061 features in all layers
[Implementation available in OpenCV:
http://www.intel.com/technology/computing/opencv/]
Faces
Non-faces
Train cascade of
classifiers with
AdaBoost
Selected features,
thresholds, and weights
New image
![Page 37: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/37.jpg)
Viola-Jones detector: summary
• A seminal approach to real-time object detection
• Training is slow, but detection is very fast
• Key ideas
Integral images for fast feature evaluation
Boosting for feature selection
Cascade of classifiers for fast rejection of non-face
windows
P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features.
CVPR 2001.
P. Viola and M. Jones. Robust real-time face detection. IJCV 57(2), 2004.
![Page 38: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/38.jpg)
Viola-Jones Face Detector: Results
![Page 39: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/39.jpg)
Viola-Jones Face Detector: Results
![Page 40: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/40.jpg)
Viola-Jones Face Detector: Results
![Page 41: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/41.jpg)
Detecting profile faces? Can we use the same detector?
![Page 42: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/42.jpg)
Paul Viola, ICCV tutorial
Viola-Jones Face Detector: Results
![Page 43: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/43.jpg)
Everingham, M., Sivic, J. and Zisserman, A.
"Hello! My name is... Buffy" - Automatic naming of characters in TV video,
BMVC 2006. http://www.robots.ox.ac.uk/~vgg/research/nface/index.html
Example using Viola-Jones
detector
Frontal faces detected and then tracked, character
names inferred with alignment of script and subtitles.
![Page 44: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/44.jpg)
![Page 45: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/45.jpg)
• What other categories are amenable to
window-based representation?
![Page 46: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/46.jpg)
Pedestrian detection • Detecting upright, walking humans also possible using sliding
window’s appearance/texture; e.g.,
SVM with Haar wavelets
[Papageorgiou & Poggio, IJCV
2000]
Space-time rectangle
features [Viola, Jones &
Snow, ICCV 2003]
SVM with HoGs [Dalal &
Triggs, CVPR 2005]
![Page 47: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/47.jpg)
Window-based detection:
strengths
• Sliding window detection and global
appearance descriptors:
– Simple detection protocol to implement
– Good feature choices critical
– Past successes for certain classes
![Page 48: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/48.jpg)
Window-based detection:
Limitations
• High computational complexity
– For example: 250,000 locations x 30 orientations
x 4 scales = 30,000,000 evaluations!
– If training binary detectors independently, means
cost increases linearly with number of classes
• With so many windows, false positive rate
better be low
![Page 49: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/49.jpg)
Limitations (continued)
• Not all objects are “box” shaped
![Page 50: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/50.jpg)
Limitations (continued)
• Non-rigid, deformable objects not captured
well with representations assuming a fixed
2d structure; or must assume fixed
viewpoint
• Objects with less-regular textures not
captured well with holistic appearance-
based descriptions
![Page 51: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/51.jpg)
Limitations (continued)
• If considering windows in isolation, context
is lost
Sliding window Detector’s view
![Page 52: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/52.jpg)
Limitations (continued)
• In practice, often entails large, cropped
training set (expensive)
• Requiring good match to a global
appearance description can lead to
sensitivity to partial occlusions
![Page 53: Detection - moodlearn.ariel.ac.il · Faces Non ... Rapid object detection using a boosted cascade of simple ... ICCV tutorial Viola-Jones Face ...](https://reader031.fdocuments.us/reader031/viewer/2022022604/5b5e29a17f8b9af90c8b4da2/html5/thumbnails/53.jpg)
Summary
• Basic pipeline for window-based detection
– Model/representation/classifier choice
– Sliding window and classifier scoring
• Viola-Jones face detector
– Exemplar of basic paradigm
– Plus key ideas: rectangular features, Adaboost for feature selection, cascade
• Pros and cons of window-based detection