Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots...
-
Upload
amberlynn-bruce -
Category
Documents
-
view
217 -
download
0
Transcript of Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots...
![Page 1: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/1.jpg)
Chapter 9. PlayMate System (1/2)in Cognitive Systems, Henrik Iskov Chritensen et al.
Course: Robots Learning from Humans
Kwak, Hanock
Biointelligence Laboratory
School of Computer Science and Engineering
Seoul National University
http://bi.snu.ac.kr
![Page 2: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/2.jpg)
2
Contents
Introduction Scenario
System Overview Vision SA Spatial SA Communication SA Binding SA
![Page 3: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/3.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 3
Introduction
![Page 4: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/4.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 4
Scenario
Man: This is a blue square Robot: Ok
![Page 5: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/5.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 5
Scenario
Man: This is a red square Robot: Ok
![Page 6: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/6.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 6
Scenario
Man: (Replace the red square with red triangle) Robot: What is the thing to the right of the blue
square. Man: It is a red triangle.
![Page 7: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/7.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 7
System Overview
![Page 8: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/8.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 8
System Overview
Subarchitectures (SAs) Visual processing (Vision SA) Speech recognition & generator (ComSys SA) Spatial representation and reasoning (Spatial SA) Manipulation (Manipulation SA) Binding of information between modalities (Binding SA) Control of motivation and planning (Motivation and Plan-
ning SA)
![Page 9: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/9.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 9
Vision SA
Change detector determines whether the scene is, or has stopped changing
Regions of interest (ROIs) in the scene are seg-mented
![Page 10: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/10.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 10
Working memory
Vision SA
![Page 11: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/11.jpg)
11
Spatial SA
Captures both metric and qualitative representa-tions
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr
What is the thing to the right of the blue square
![Page 12: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/12.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 12
Spatial SA
Working memory
![Page 13: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/13.jpg)
13
Communication SA
Captures both the indexical and intentional con-tents of an utterance
Working memory
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr
![Page 14: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/14.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 14
Binding SA
Finds cross-modal relations
This is a blue square.
![Page 15: Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.](https://reader035.fdocuments.us/reader035/viewer/2022081515/5697bfbe1a28abf838ca27d4/html5/thumbnails/15.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 15
Integration of SAs
15