Controlling Legged Robots with Coupled Artificial Biochemical Networks
Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf ·...
-
Upload
hoangtuyen -
Category
Documents
-
view
226 -
download
0
Transcript of Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf ·...
![Page 1: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/1.jpg)
Artificial Intelligence and Mobile Robots: Successes and Challenges
David KortenkampNASA Johnson Space Center
Metrica Inc./TRACLabsHouton TX 77058
[email protected]://www.traclabs.com/~korten
![Page 2: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/2.jpg)
Outline
• Where we’ve been– Previous mobile robot competitions– Contributions to the state-of-the-art
• Where we are– Status checklist– Challenges to the AI community
• Where we are going– 2000 Mobile Robot Competition and Exhibition
![Page 3: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/3.jpg)
The First AAAI Mobile Robot Competition (San Jose CA 1992)
• Large arena with fixed obstacles• Robot needed to find and visit 10 poles• Teams could mark poles in any way
they wanted• Contributions
– Sonar-based obstacle avoidance
• Assessment– Robots could move w/o hitting things– Robots could find large, marked objects
![Page 4: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/4.jpg)
Second AAAI Mobile Robot Competition (DC, 1993)
• Office-like environment• Robots modifying environment• Contributions
– Three-layer architecture (Erann Gat, JPL)
• Assessment– Office navigation still unsolved– Start of real-world tasks
![Page 5: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/5.jpg)
Third AAAI Mobile Robot Competition (Seattle, 1994)
• Office building environment is continued• Mobile manipulation is introduced• Contributions
– Successful multi-robot strategy (Georgia Tech)– Probabilistic office navigation (Stanford)
• Assessment– Office navigation more robust– Distributed multi-robots are fast
![Page 6: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/6.jpg)
Fourth AAAI Mobile Robot Competition (Montreal, 1995)
• Office navigation is extended with human interaction
• Mobile manipulation with ability to distinguish objects (trash vs. recycle)
• Contributions– Color vision – Wheelchair applications
• Assessment– Non-trivial vision becomes possible
![Page 7: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/7.jpg)
Fifth AAAI Mobile Robot Competition (Portland, 1996)
• Office navigation with occupancy detection• Mobile manipulation of moving objects• Alan Alda!• Contributions
– Fast color vision– POMDP navigation techniques
• Assessment– Office navigation is solved
![Page 8: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/8.jpg)
Sixth AAAI Mobile Robot Competition (Providence, 1997)
• Real-world tasks (vacuuming, search)• Direct interaction with AAAI attendees (serving
hors d’oeuvres)• Contributions
– Multi-media interfaces– Entertaining robots
• Assessment– Human-robot interaction still young
![Page 9: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/9.jpg)
Seventh AAAI Mobile Robot Competition (Madison WI, 1998)
• Robots move out of the arena• Hors d’oeuvres is continued• Sony robot “dogs” make appearance• Contributions
– AAAI Best Paper to Thrun et al for museum tour robot based on software displayed in previous competitions
• Assessment– Human-robot interaction making progress
![Page 10: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/10.jpg)
Eighth AAAI Mobile Robot Competition (Orlando, 1999)
• No arena at all, robots roam through conference hall on scavenger hunts
• Hors d’oeuvres competition a big hit• Contributions
– Introduced a “challenge” competition
• Assessment– Continued improvement in hors
d’oeuvres serving
![Page 11: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/11.jpg)
Y2K: Where are we?
• What is the current state-of-the-art?• What are the remaining challenges?
CMU and NASA take the Nomad mobile robot to Antarctica in January 2000 to search for meteorites
![Page 12: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/12.jpg)
Mapping and Navigation• State-of-the-artüObstacle avoidanceüOffice building navigationüPublic navigation (with assistance)üMap construction (including 3D) using sonar and laser
• Challenges•Outdoor navigation (even with GPS)•Vision-based navigation
![Page 13: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/13.jpg)
Robot Vision• State-of-the-artüColor vision for object recognitionüObstacle avoidance and cliff detectionüAutonomous highway drivingüActive stereo vision for tracking
• Challenges•Object segmentation•Robust landmark discovery and
recognition
![Page 14: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/14.jpg)
Mobile Manipulation• State-of-the-artüStand-alone manipulators on mobile basesüUncoordinated base and arm motion
• Challenges•Coordinated base and arm motion•Multi-arm robots•Eye-hand coordination
![Page 15: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/15.jpg)
Human-Robot Interaction• State-of-the-artüSimple tracking and gesture recognitionüFace recognition under ideal
circumstancesüCOTS voice recognition
• Challenges•Discourse management tied to task
context•Learning from humans•Adjustable autonomy
![Page 16: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/16.jpg)
Control Architectures• State-of-the-artüLayered architectures to integrate reactive and
deliberative componentsüRobust execution of procedures
• Challenges•Architectures with learning “built-in”•Sharing components (“plug and play”)•Adjustable autonomy•Validation and verification
![Page 17: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/17.jpg)
Multiple Robots• State-of-the-artüHomogeneous robotsüDivide-and-conquer tasks
• Challenges•Architectures for coordination of autonomous,
heterogeneous robots•“On-the-fly” teaming of robots•Distributed sensing•Tasks that require multiple robots
![Page 18: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/18.jpg)
Challenges to the AI Community• Planning
– Planners that can “take advantage” of underlying robust execution systems
– Mixed-initiative planning with robots
• Learning– Fast, on-line learners that handle uncertainty– Improving off-line models from data
• Natural Language– Discourse tied to task contexts and agent
actions
![Page 19: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/19.jpg)
Challenges (continued)• Knowledge Representation
– Representing perceptual information– Moving knowledge between continuous and
discrete (or symbolic) representations
• Applications– Apply known mobile robot results to other
domains that have similar characteristics, I.e., “immobots” (Williams & Nayak 1996)
– Use mobile robots!
![Page 20: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/20.jpg)
The 2000 AAAI Mobile Robot Contest and Exhibition
• Goals– Foster the sharing of research ideas and
technology– Allow research groups to showcase their
achievements– Encourage students to enter the fields of
robots and AI– Increase awareness of the field
• Alan Schultz, Chair
![Page 21: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/21.jpg)
Events• Contest
– Urban Search and Rescue– Hors d’oeuvres– Lisa Meeden, Event Chair
• Challenge– Tucker Balch, Event Chair
• Exhibition– Marc Bohlen and Vandi Verma, Event
Chairs
• Plus, Botball and Robot Building Lab
![Page 22: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/22.jpg)
Urban Search and Rescue• Robots must enter fallen structure
and search for victims• Robots judged on
– Number of victims found– Relaying location of victims and
hazards– Communicating with victims– Innovative technology
• No teleoperation
![Page 23: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/23.jpg)
Hors d’oeuvres• Robots serve hors d’oeuvres to conference
attendees at the reception • Robots judged subjectively by a panel for:
– Ability to serve food– Interaction with attendees– Manipulation– Sensing modes
![Page 24: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/24.jpg)
Challenge• Robot must register and attend AAAI with
no a priori information • Judges will look for technical innovation• Components include:
– Start at front door– Navigate to registration (look at signs or ask
directions)– Register (stand in line, say name)– Attend talk
• Task pushes state-of-the-art
![Page 25: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/25.jpg)
Exhibition• Demonstrations of robot technology that
does not fit within the contests • Scheduled demonstration times• Exhibition themes include:
– Learning by imitation (USC)– Learning by observation (Georgia Tech)– Multi-robot negotiation– Interaction with humans– Intelligent wheelchairs (U Texas)– Enabling technologies
![Page 26: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/26.jpg)
Botball• High school robotics building and
programming competition – Over 150 teams participated
• Finals held at AAAI-2000– 46 high school teams competing– August 1 and 2 (finals at 3:00)
• Organized by David Miller of the KISS Institute for Practical Robotics and the University of Oklahoma
![Page 27: Artificial Intelligence and Mobile Robots: Successes and ...korten/aaai2000_invited_talk.pdf · Artificial Intelligence and Mobile Robots: Successes and Challenges ... – Human-robot](https://reader031.fdocuments.us/reader031/viewer/2022022521/5b234f1d7f8b9a3a1b8b5414/html5/thumbnails/27.jpg)
Sponsors• DARPA • Office of Naval Research• Naval Research Laboratory• AAAI