Poselets: Body part detectors trained using 3D human pose annotations

12
Poselets Poselets capture part of the pose from a given viewpoint [Bourdev & Malik, ICCV09]

TAGS:

Transcript of Poselets: Body part detectors trained using 3D human pose annotations

Page 1: Poselets: Body part detectors trained using 3D human pose annotations

Poselets

Poselets capture part of the pose from a given viewpoint [Bourdev & Malik,

ICCV09]

Page 2: Poselets: Body part detectors trained using 3D human pose annotations

Poselets

Examples may differ visually but have common semantics [Bourdev & Malik,

ICCV09]

Page 3: Poselets: Body part detectors trained using 3D human pose annotations

Poselets

But how are we going to create training examples of poselets?

Page 4: Poselets: Body part detectors trained using 3D human pose annotations

How do we train a poselet for a given pose configuration?

Page 5: Poselets: Body part detectors trained using 3D human pose annotations

Finding correspondences at training time

Given part of a human pose

How do we find a similar pose configuration in the training set?

Page 6: Poselets: Body part detectors trained using 3D human pose annotations

We use keypoints to annotate the joints, eyes, nose, etc. of people

Left Hip

Left Shoulder

Finding correspondences at training time

Page 7: Poselets: Body part detectors trained using 3D human pose annotations

Residual Error

Finding correspondences at training time

Page 8: Poselets: Body part detectors trained using 3D human pose annotations

Training poselet classifiers

Residual Error:

0.15

0.20

0.10

0.35

0.15

0.85

1. Given a seed patch2. Find the closest patch for every

other person3. Sort them by residual error4. Threshold them

Page 9: Poselets: Body part detectors trained using 3D human pose annotations

Training poselet classifiers

1. Given a seed patch2. Find the closest patch for every

other person3. Sort them by residual error4. Threshold them5. Use them as positive training

examples to train a linear SVM with HOG features

Page 10: Poselets: Body part detectors trained using 3D human pose annotations

Which poselets should we train?

• Choose thousands of random windows, generate poselet candidates, train linear SVMs

• Select a small set of poselets that are:• Individually effective• Complementary

Page 11: Poselets: Body part detectors trained using 3D human pose annotations

Selecting a small set of complementary

poselets

Page 12: Poselets: Body part detectors trained using 3D human pose annotations

Poselets website

http://eecs.berkeley.edu/~lbourdev/poselets

The set of published poselet papers H3D data set + Matlab tools Java3D annotation tool + video

tutorial Matlab code to detect people using

poselets Our latest trained poselets

http://eecs.berkeley.edu/~lbourdev/poselets
http://eecs.berkeley.edu/~lbourdev/poselets

Hand Pose Estimation for Pediatric Bone Age …...Hand Pose Estimation for Pediatric Bone Age Assessment 3 Fig.1. Di erent examples of our keypoint and bounding box annotations. We

Hand Pose Estimation for Pediatric Bone Age …...Hand Pose Estimation for Pediatric Bone Age Assessment 3 Fig.1. Di erent examples of our keypoint and bounding box annotations. We

Poselets Body Part Detectors Trained Using 3D Human Pose Annotations - Bourdev, Malik - Proceedings of International Conference on Computer Vision - 2009

Poselets Body Part Detectors Trained Using 3D Human Pose Annotations - Bourdev, Malik - Proceedings of International Conference on Computer Vision - 2009

@:annotations · Annotations Java, Scala, Kotlin, Groovy Attributes C#, F#, Swift Decorators Python, Javascript. Related Work - Annotations Annotations in Java can be applied to declarations

@:annotations · Annotations Java, Scala, Kotlin, Groovy Attributes C#, F#, Swift Decorators Python, Javascript. Related Work - Annotations Annotations in Java can be applied to declarations

CONTENTS INCLUDE: Spring Annotations · CONTENTS INCLUDE: n Core Spring Annotations n Spring MVC Annotations n AspectJ Annotations n JSR-250 Annotations n Testing Annotations ...

CONTENTS INCLUDE: Spring Annotations · CONTENTS INCLUDE: n Core Spring Annotations n Spring MVC Annotations n AspectJ Annotations n JSR-250 Annotations n Testing Annotations ...

Learning Temporal Pose Estimation from Sparsely Labeled Videos · annotations is costly and time consuming. •Idea: Leverage sparsely annotated videos, i.e., pose annotations are

Learning Temporal Pose Estimation from Sparsely Labeled Videos · annotations is costly and time consuming. •Idea: Leverage sparsely annotated videos, i.e., pose annotations are

SAP - ABAP Programming Model for SAP Fiori · EnterpriseSearch Annotations Hierarchy Annotations ObjectModel Annotations OData Annotations Search Annotations Semantics Annotations

SAP - ABAP Programming Model for SAP Fiori · EnterpriseSearch Annotations Hierarchy Annotations ObjectModel Annotations OData Annotations Search Annotations Semantics Annotations

Using k-Poselets for Detecting People and Localizing Their … › openaccess › content_cvpr... · 2014-05-18 · Using k-poselets for detecting people and localizing their keypoints

Using k-Poselets for Detecting People and Localizing Their … › openaccess › content_cvpr... · 2014-05-18 · Using k-poselets for detecting people and localizing their keypoints

First-Person Hand Action Benchmark with RGB-D … · First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose ... of hand pose annotations on real ... pose-based action

First-Person Hand Action Benchmark with RGB-D … · First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose ... of hand pose annotations on real ... pose-based action

availablpublicly dataset The e. is · 2015. 5. 24. · [1]Lubomir Bourdev and Jitendra Malik. Poselets: Body part detectors trained using 3D human pose annotations. In ICCV, 2009.

availablpublicly dataset The e. is · 2015. 5. 24. · [1]Lubomir Bourdev and Jitendra Malik. Poselets: Body part detectors trained using 3D human pose annotations. In ICCV, 2009.

Annotations · Table of Contents 1. Annotations ...

Annotations · Table of Contents 1. Annotations ...

john-russell.orgjohn-russell.org/Texts/7op.pdf · ocean pose. ocean pose. cxean pose. ocean pose _ ocean pose. ocean pose. ocean pose. ocean pose. ocean pose starting in the south

john-russell.orgjohn-russell.org/Texts/7op.pdf · ocean pose. ocean pose. cxean pose. ocean pose _ ocean pose. ocean pose. ocean pose. ocean pose. ocean pose starting in the south

Tool Support for Annotations - Java · JSR 305: Annotations for Software Defect Detection New tool-oriented annotations for JDK “This JSR will work to develop standard annotations

Tool Support for Annotations - Java · JSR 305: Annotations for Software Defect Detection New tool-oriented annotations for JDK “This JSR will work to develop standard annotations

Book Annotations

Book Annotations

An MRF-Poselets Model for Detecting Highly Articulated Humans › openaccess › content_iccv... · 2015-10-24 · An MRF-Poselets Model for Detecting Highly Articulated Humans Duc

An MRF-Poselets Model for Detecting Highly Articulated Humans › openaccess › content_iccv... · 2015-10-24 · An MRF-Poselets Model for Detecting Highly Articulated Humans Duc

Newspaper annotations

Newspaper annotations

Annotations bertRETE

Annotations bertRETE

Java Annotations Tutorial - IT Collegeenos.itcollege.ee/~jpoial/java/naited/Java-Annotations-Tutorial.pdf · Java Annotations Tutorial 6 / 27 Chapter 6 Where can be used Annotations

Java Annotations Tutorial - IT Collegeenos.itcollege.ee/~jpoial/java/naited/Java-Annotations-Tutorial.pdf · Java Annotations Tutorial 6 / 27 Chapter 6 Where can be used Annotations

Poselets: Body Part Detectors trained Using 3D Human Pose Annotations Lubomir Bourdev & Jitendra Malik ICCV 2009.

Poselets: Body Part Detectors trained Using 3D Human Pose Annotations Lubomir Bourdev & Jitendra Malik ICCV 2009.

MoCap-guided Data Augmentation for 3D Pose Estimation in ...papers.nips.cc/paper/6563-mocap-guided-data-augmentation-for-3d-… · annotations and a library of 3D Motion Capture (MoCap)

MoCap-guided Data Augmentation for 3D Pose Estimation in ...papers.nips.cc/paper/6563-mocap-guided-data-augmentation-for-3d-… · annotations and a library of 3D Motion Capture (MoCap)

Slim DensePose: Thrifty Learning From Sparse Annotations ...openaccess.thecvf.com/content_CVPR_2019/papers/... · we thus seek methods to significantly slim down the Dense-Pose annotations,

Slim DensePose: Thrifty Learning From Sparse Annotations ...openaccess.thecvf.com/content_CVPR_2019/papers/... · we thus seek methods to significantly slim down the Dense-Pose annotations,