Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid...

20
#icdl/epirob 2012 autonomous learning of robust visual object detection & identification on a humanoid S. Harding, P. Chandrashekhariah M. Frank, G. Spina, A. Förster, J. Triesch, J. Schmidhuber idsia / usi / supsi, machine intelligence, fias Jürgen ’Juxi’ Leitner

description

n this work we introduce a technique for a hu- manoid robot to autonomously learn the representations of objects in its visual environment. Our approach involves feature- based segmentation of the images followed by learning to identify the object using Cartesian Genetic Programming. The learned identification is able to provide robust and fast segmentation of the objects, without using features. To allow for autonomous learning an attention mechanism is coupled with the training process. We showcase our system on a humanoid robot.

Transcript of Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid...

Page 1: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

#icdl/epirob 2012

autonomous learning of robust visual object

detection & identificationon a humanoid

S. Harding, P. ChandrashekhariahM. Frank, G. Spina,

A. Förster, J. Triesch, J. Schmidhuber

idsia / usi / supsi, machine intelligence, fias

Jürgen ’Juxi’ Leitner

Page 2: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

manipulation

our iCubsetup is for

Page 3: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

perceptionvisual

thanks to G. Metta and IIT for this picture

Page 4: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

challengethe

Page 5: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

IDSIA’s three

Harding et al., GPTP 2012,Leitner et al., ICDL 2012 Leitner et al., BICA 2012Leitner et al., IROS 2012

parts

Page 6: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

cv approachescurrent

Page 7: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

objectsdetecting

Harding et al., GPTP 2012

Page 8: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

approachlearningour

Page 9: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

cartesian genetic

programming

+ min dilate avg INP INP INP

Page 10: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

+ min dilate avg INP INP INP

3""#2""#1"4.3"""""

Func,on"Connec,on"1"Connec,on"2"A"real"number" cartesian

genetic programming

Page 11: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

detection

icImage GreenTeaBoxDetector::runFilter() { ! icImage node0 = InputImages[6];! icImage node1 = InputImages[1];! icImage node2 = node0.absdiff(node1);! icImage node5 = node2.SmoothBilateral(11);! icImage node12 = InputImages[0];! icImage node16 = node12.Sqrt();! icImage node33 = node16.erode(6);! icImage node34 = node33.log();! icImage node36 = node34.min(node5);! icImage node49 = node36.Normalize();

//cleanup ... icImage out = node49.threshold(230.7218f);! return out; }

Page 12: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

detect

Page 13: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

detect

Page 14: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

approachsupervised learning

BUT:

Page 15: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

segmentationfeature

saliencymap

collaborationFIAS

Page 16: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

segmentationpre

Page 17: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

approachcombined

Page 18: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

MoBeEframework Frank et al., ICINCO, 2012.

Page 19: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

salient object detection

conclusion

rough feature-based segmentationautomatic training set generation

+

=

cgp-based, robust filter-learningfor

Page 20: Autonomous Learning of Robust Visual Object Detection & Identification on a Humanoid #icdl/epirob2012

for listeningthanks

[email protected] http://Juxi.net/projects http://robotics.idsia.ch

video at http://robotics.idsia.ch/im-clever/