Back to School Night Mrs. Robin Ciccone Room 207 2014 – 2015.
RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit...
-
Upload
vivian-robbins -
Category
Documents
-
view
213 -
download
0
Transcript of RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit...
![Page 1: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/1.jpg)
RoshamRoboAlexander Ciccone – EEL4665 Spring 2014Oral Report 2 – Special Sensor
Image Credit – Author: Enzoklop URL: http://en.wikipedia.org/wiki/File:Rock-paper-scissors.svg
![Page 2: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/2.jpg)
Special Sensor
• Laptop (Windows or Ubuntu environment) running OpenCV program to interpret images sent from an IP camera (Foscam FI8910W) via a wireless router.
RoshamRobo must:• Use sensors and IP camera to find and position itself in front of a target
human• Display countdown and game moves via LCD screen at appropriate times
The software and special sensor must:• Detect an outstretched hand of varying colors (foreground & background)• Differentiate amongst Rock, Paper, and Scissors hand gestures during play
Images: s-ln.in, wikipedia, amazon.com
![Page 3: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/3.jpg)
Images courtesy of sparkfun, adafruit, amazon.com
Special Sensor Block Diagram
![Page 4: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/4.jpg)
Inspiration• Computer vision algorithms are exciting!• OpenCV algorithms able to detect & track faces, people, hands,
images and many other objects
Images: bassemdy.wordpress.com, www.andol.info, www.creativeapplications.net,www.k2.t.u-tokyo.ac.jp/fusion/Janken/index-e.html
![Page 5: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/5.jpg)
Initial Stages• Install and troubleshoot installation of OpenCV• Compile and study resources on hand gesture recognition and
OpenCV applications• The following resources were extremely helpful:• www.andol.info• anikettatipamula.blogspot.ro• blogs.ugidotnet.org/WetBlog• www.youtube.com/user/khounslow• www.youtube.com/user/18F4550videos
![Page 6: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/6.jpg)
Initial Stages• Subtract background from image while preserving foreground
(hand)
• Find Convex Hull of hand region (the convex set enclosing the hand)
![Page 7: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/7.jpg)
Convex Hull – Experimental Results
![Page 8: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/8.jpg)
Finding Convexity Defects• Find, mark, and count (convexity) defects of the convex hull
![Page 9: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/9.jpg)
Counting Defects & Fingers
![Page 10: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/10.jpg)
Identifying Scissors & Rock Gesture
![Page 11: RoshamRobo Alexander Ciccone – EEL4665 Spring 2014 Oral Report 2 – Special Sensor Image Credit – Author: Enzoklop URL: Rock-paper-scissors.svg.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649f115503460f94c23a31/html5/thumbnails/11.jpg)
Further Experimentation