By: Jonathan Lebron Advisor: Nick Webb
description
Transcript of By: Jonathan Lebron Advisor: Nick Webb
![Page 1: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/1.jpg)
By: Jonathan LebronAdvisor: Nick Webb
SENIOR PROJECT – COMPUTER SCIENCE – 2013
RECOGNIZING MILITARY GESTURES
DEVELOPING A GESTURE RECOGNITION INTERFACE
![Page 2: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/2.jpg)
MOTIVATION• Scenarios where speech would not be possible or optimal
solution
• Giving natural gestures to Robots that resemble Human-to-Human interaction
• No need for special training
• Incorporating both speech an gesture would be ideal, but this problem is out of scope
![Page 3: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/3.jpg)
RESEARCH QUESTION• How do you give a robot a sequence of natural gestures to
interpret and act upon?
Xbox Kinect
![Page 4: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/4.jpg)
HOW IT WORKS• Perform Gesture
• Kinect reads skeleton data
• Data gets transformed into angles
• Classifier reads angles and determines gesture using C4.5 decision tree
left_shoulder: 0.35, 0.12, 2.19left_elbow: -0.18, -0.10, 2.02left_hand: -0.13, -0.34, 1.924
![Page 5: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/5.jpg)
CLASSIFICATION
GesturesAbreast Enemy
Freeze Stop
Listen Rifle
Cover
ClassifierAngleshandTheta
handPhi
elbowTheta
elbowPhi
![Page 6: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/6.jpg)
CLASSIFICATION• How do we handle erroneous data?
• When do we know when to execute the sequence?
• What actions can we expect from the robot?
![Page 7: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/7.jpg)
SOFTWARE DESIGN
![Page 8: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/8.jpg)
ADDING GESTURES• Create new gestures
• Replace old gestures
• Combining gestures
![Page 9: By: Jonathan Lebron Advisor: Nick Webb](https://reader035.fdocuments.us/reader035/viewer/2022062501/56816554550346895dd7d2e2/html5/thumbnails/9.jpg)
CONCLUSION• Future Work
• Wrap-up
• Q&A