IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

12
IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Transcript of IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Page 1: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

IEEE Robot Team

Vision System ProjectMichael Slutskiy & Paul NguyenECE 533 Presentation

Page 2: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Mission Navigate 150lb Robot Through Obstacle Course

Page 3: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Vision System Objectives

Find parts of image that the robot should not drive into

Map these parts and send them to the artificial intelligence system

Attempt to distinguish between physical objects and 2 dimensional images on the ground

Page 4: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.
Page 5: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.
Page 6: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Success

Page 7: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Some Combinations

Page 8: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

•Get an image from the camera approx. 15fps

•Filter out orange

•Extract the blue plane for the dynamic thresh.

•Binarize (note the salt and pepper noise)

•Clean up image using a 5x5 Median filter

•Use Sobel edge extraction and Hough transform to pick out lines

Page 9: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Tarps

Page 10: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Pass Image to AI

This is the target location for the robot to navigate to in this frame.

Page 11: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Extensions Complete color segmentation

Aid with tarps and texture noisePotentially better than current threshold

Template matchingHelp separate objects from lines

Multi-image operations World mapping

Planning AI instead of reactionary AI

Page 12: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation.

Questions, Comments,

Suggestions?

Visit www.cae.wisc.edu/~ieeerobo for more info or send us an email at [email protected]