They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation...
Transcript of They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation...
![Page 1: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/1.jpg)
They REALLY Are Coming For You:
Research and Opportunities in Rescue Robots The Survivor Buddy Project: Affect in Robot-Assisted Medical Response
Prof. Robin Murphy, PhD
Raytheon Professor of Computer Science & Engineering
IEEE Robotics and Automation Society Distinguished Lecturer
Special Thanks to Microsoft Research
![Page 2: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/2.jpg)
2/19/09 Robin Murphy Microsoft Research 2
IEEE Robotics and Automation Society
2/20/09 2 UWashington [email protected]
•! RAS fellowships for students
•! Mentoring for students, junior faculty, and women/minorities
•! Technical Committee on Safety Security Rescue Robotics
•! IEEE Workshop on Safety Security Rescue Robotics
http://www.ieee-ras.org
![Page 3: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/3.jpg)
2/19/09 Robin Murphy Microsoft Research 3
![Page 4: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/4.jpg)
2/19/09 Robin Murphy Microsoft Research 4
![Page 5: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/5.jpg)
the real-time collection, processing, distribution, and visualization of
information for prevention, preparedness, response and recovery
from emergencies
Emergency Informatics
2/19/09 Robin Murphy Microsoft Research 5
![Page 6: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/6.jpg)
Texas A&M Engineering College
•! Undergrad program Ranked 9th, Grad ranked 7th by US News and World Report
•! 7,500 undergrads, 2,500 graduate students
•! 400 faculty
•! 3rd in Eng. Research $$ (MIT, GT)
2/19/09 Robin Murphy Microsoft Research 6
![Page 7: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/7.jpg)
Computer Science & Engineering
•! Grad program Ranked 15th by US News and World Report
•! 600 undergrads
•! 300 graduate students
•! 46 faculty
2/19/09 Robin Murphy Microsoft Research 7
![Page 8: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/8.jpg)
Disaster City
2/19/09 Robin Murphy Microsoft Research 8
![Page 9: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/9.jpg)
2/19/09 Robin Murphy Microsoft Research 9
![Page 10: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/10.jpg)
Robots Deployed in USA
2/19/09 Robin Murphy Microsoft Research 10
•! 9/11 World Trade Center (2001)
•! California Mudslides (2005)
•! Hurricane Katrina (2005) •! Hurricane Rita (2005) •! Hurricane Wilma (2005) •! Sago Coal Mine (2006) •! Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon Coal
Mine (2007) •! Berkman Plaza II (2007) •! Plus unconfirmed report
of wilderness in North Dakota
![Page 11: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/11.jpg)
Robots Deployed in USA
2/19/09 Robin Murphy Microsoft Research 11
•! 9/11 World Trade Center (2001)
•! California Mudslides (2005)
•! Hurricane Katrina (2005) •! Hurricane Rita (2005) •! Hurricane Wilma (2005) •! Sago Coal Mine (2006) •! Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon Coal
Mine (2007) •! Berkman Plaza II (2007) •! Plus unconfirmed report
of wilderness in North Dakota
![Page 12: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/12.jpg)
2/19/09 Robin Murphy Microsoft Research 12
![Page 13: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/13.jpg)
2/19/09 Robin Murphy Microsoft Research 13
![Page 14: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/14.jpg)
Victim Management
2/19/09 Robin Murphy Microsoft Research 14
![Page 15: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/15.jpg)
Joint Cognitive System (Woods)
2/19/09 Robin Murphy Microsoft Research 15
![Page 16: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/16.jpg)
Traditional HRI Focus
2/19/09 Robin Murphy Microsoft Research 16
Yanco Goodrich Brummer Murphy and Burke
![Page 17: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/17.jpg)
CBIRF Victim Transport
2/19/09 Robin Murphy Microsoft Research 17
![Page 18: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/18.jpg)
What About the Survivor?
2/19/09 Robin Murphy Microsoft Research 18
Vecna BEAR Oh
![Page 19: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/19.jpg)
What About the Survivor?
2/19/09 Robin Murphy Microsoft Research 19
Riddle, Murphy, Rasmussen
![Page 20: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/20.jpg)
VECNA BEAR
2/19/09 Robin Murphy Microsoft Research 20
![Page 21: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/21.jpg)
•! Reeves and Nass: Media=Real Life
The Media Equation
2/19/09 Robin Murphy Microsoft Research 21
![Page 22: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/22.jpg)
•! Fincannon, Barnes, Murphy et al
•! Soldier attachment to Packbots
Empirical Support
2/19/09 Robin Murphy Microsoft Research 22
![Page 23: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/23.jpg)
•! Will expect a socially consistent relationship
–!Proxemic behaviors
•! Will identify with the robot as a discrete, independent agent (social actor) even if clearly being teleoperated
–! Identity, “voice”
Victim Management Ramifications of Mediated Relationship
2/19/09 Robin Murphy Microsoft Research 23
![Page 24: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/24.jpg)
Plus…. Ballad of The Beaconsfield Miners
2/19/09 Robin Murphy Microsoft Research 24
![Page 25: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/25.jpg)
Survivor Buddy
2/19/09 Robin Murphy Microsoft Research 25
![Page 26: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/26.jpg)
•! Will expect a socially consistent relationship
–! Proxemic behaviors
•! Will identify with the robot as a discrete, independent agent (social actor) even if clearly being teleoperated
–! Identity, “voice”
•! Is also a pure medium
Web-Based Media Changes the Mediated Relationship
2/19/09 Robin Murphy Microsoft Research 26
![Page 27: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/27.jpg)
New Position on Identity Spectrum?
2/19/09 Robin Murphy Microsoft Research 27
Identity
Pure Medium Social Actor Social Medium
![Page 28: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/28.jpg)
•! Non-verbal, non-facial affect
•! Communication identity
•! Communication voice
Some Dimensions of Congruence
2/19/09 Robin Murphy Microsoft Research 28
![Page 29: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/29.jpg)
•! Non-verbal, non-facial affect
–!NSF Fellow Cindy Bethel
–!Heuristics based on proxemics
•! Communication identity
•! Communication voice
Affect
2/19/09 Robin Murphy Microsoft Research 29
![Page 30: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/30.jpg)
Bethel et al 2009
2/19/09 Robin Murphy Microsoft Research 30
![Page 31: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/31.jpg)
•! Non-verbal, non-facial affect
•! Communication identity
–!Microsoft Research HRI
–!Prof. Cliff Nass, Victoria Groom Stanford
•! Communication voice
Current Work
2/19/09 Robin Murphy Microsoft Research 31
![Page 32: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/32.jpg)
•! Player is the victim
•! Robot “talks” in one of 3 identities
–! “This is the controller”
–! “I have a message from the controller for you:
–! “This is the robot”
•! Makes suggestions about what to watch
•! If player takes suggestions, likes the robot, shows less anxiety, then that identity is more congruent
Phase 1: Videogame Simulation
2/19/09 Robin Murphy Microsoft Research 32
![Page 33: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/33.jpg)
Phase 2: Field Trials
2/19/09 Robin Murphy Microsoft Research 33
Victim
![Page 34: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/34.jpg)
Social Interaction Plus Mediation
2/19/09 Robin Murphy Microsoft Research 34
![Page 35: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/35.jpg)
•! Non-verbal, non-facial affect
–!Anthropomorphic vs. non-anthropomorphic
•! Communication identity
–!Multiple people interacting (medical, structural, …)
•! Communication voice
–!NSF grant submitted
Future Work
2/19/09 Robin Murphy Microsoft Research 35
![Page 36: They REALLY Are Coming For You - ecology lab · 2020. 8. 10. · IEEE Robotics and Automation Society ... Midas Gold Mine (2007) •! California wildfires (2007) •! Crandall Canyon](https://reader036.fdocuments.us/reader036/viewer/2022071117/6000eba375144129d71fe80e/html5/thumbnails/36.jpg)
•! Texas A&M
–! Robin Murphy (CSE), Aaron Rice
–! Takis Zourntos (ECE), Aaron Hall
•! Stanford
–! Cliff Nass (COM), Victoria Groom, Kim Anderson, Caitlin Reynolds, and Matt Paden
•! University of South Florida –! Cindy Bethel, Jeff Criaghead
The Team
2/19/09 Robin Murphy Microsoft Research 36