Download - Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

Transcript
Page 1: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

#robotdoc 2012

towardsspatial perception

learning to locate objects from vision

S. Harding, M. Frank, A. Förster, J. Schmidhuber

istituto dalle molle di studi sull’intelligenza artificialeuniversità della svizzera italiana

idsia / usi / supsi

Jürgen ’Juxi’ Leitner

Monday, September 10, 2012

Page 2: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

iCub

thanks to G. Metta, IIT and U.Plymouth for their pictures

Monday, September 10, 2012

Page 3: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

manipulation

our iCubsetup is for

Monday, September 10, 2012

Page 4: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

perceptionvisual

thanks to G. Metta and IIT for this picture

Monday, September 10, 2012

Page 5: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

three parts

Monday, September 10, 2012

Page 6: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

objectsdetecting

Harding et al., GPTP 2012, Leitner et al., ICDL 2012

Monday, September 10, 2012

Page 7: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

Image credit: NASA

on Marsdetecting rocks

Leitner et al., iSAIRAS 2012

also works for

Monday, September 10, 2012

Page 8: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

objectsdetecting

Harding et al., GPTP 2012, Leitner et al., ICDL 2012

Monday, September 10, 2012

Page 9: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

frameworkicVision

Leitner et al., BICA 2012

Monday, September 10, 2012

Page 10: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

three partsGPTP2012, ICDL2012(?) BICA 2012

Monday, September 10, 2012

Page 11: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

locateobjects

Monday, September 10, 2012

Page 12: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

localisation approachescurrent

Monday, September 10, 2012

Page 13: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

approachlearning

+

Monday, September 10, 2012

Page 14: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

setuplearning

Monday, September 10, 2012

Page 15: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

spatial perception neural network

Monday, September 10, 2012

Page 16: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

genetic programmingspatial perception

Monday, September 10, 2012

Page 17: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

genetic programmingspatial perception

x = 17.81 − 0.01906 v1 + 0.1527 v4 + 0.1378 v7 + 0.01108 v10 − 0.0296 v11 − 0.1207 v12

y = 1.124224045 + 0.1295920897 v10 + 0.1156011386 v8 + 0.01695234993 v0

Monday, September 10, 2012

Page 18: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

errorsrelative

Monday, September 10, 2012

Page 19: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

transferringspatial perception

Monday, September 10, 2012

Page 20: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

automate the learning (IROS 2012)different spatial representations

workfuture

eye-hand coordination

“intrinsic motivation” learningonline, continuous learning

Monday, September 10, 2012

Page 21: Towards Spatial Perception: Learning to Locate Objects from Vision #robotDoC

for listeningthanks

[email protected] http://Juxi.net/projects

Monday, September 10, 2012