Sterling Somers : [email protected]@sterlingsomers.com Dr. Robert West :...
-
Upload
neal-cooper -
Category
Documents
-
view
215 -
download
1
Transcript of Sterling Somers : [email protected]@sterlingsomers.com Dr. Robert West :...
![Page 1: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/1.jpg)
Sterling Somers : [email protected]. Robert West : [email protected]
Both @Institute of Cognitive ScienceCarleton UniversityOttawa, ON, Canada
Macro Cognition : Using SGOMS to Pilot a Flight Simulator
![Page 2: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/2.jpg)
• SGOMS is an extension of GOMS to deal with interruptions, teamwork, and re-planning
• Adds a control structure above unit tasks – planning unit• SGOMS in ACT-R
• A particular way to program ACT-R to do complex tasks• Adds more buffers to ACT-R
• Planning unit buffer• Unit task buffer• Method buffer
• These can be thought of collectively as the goal module• To test SGOMS we need to show that it works across tasks
SGOMS
![Page 3: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/3.jpg)
Sandwiches
Different SGOMS models in the lab
![Page 4: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/4.jpg)
Why Aviation?
1. Real World2. Dynamic3. Both Planned and Reactive Behaviour4. Replanning5. Expertise6. Continuous / Feedback
![Page 5: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/5.jpg)
InterfaceSimulator
• FlightGear• Free• Open Source (hack simulation loop?)
Custom Python API• Property tree via UDP/HTTP/Telnet• http/telnet simultaneously (read/write)
• State / Control of aircraft
Problem• Real time VS ACT-R time (for now…)
Simple Vision• Python bindings to OpenCV
• Very efficient• Redundancy check possible
![Page 6: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/6.jpg)
VisionTop Down:
• SOS VisionVision Module:
• When not busy• Request from environment• Motion Detection
Python bindings OpenCV• Screen shot VS centre of screen comparison / frame
Motion Detection
Screen Shot at frame 1 Screen Shot at frame 2(arrow indicates direction of movement)
![Page 7: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/7.jpg)
Vision : Dynamic Salience / Context Dependence
Vision uses salience factor (0-1) to determine probability of seeing an environment item
• Salience of Horizontal and Vertical movement calculated according to size of movement (in pixels )
• is pixel movement threshold• Possible different for different contexts?
![Page 8: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/8.jpg)
Operator PoolStart Engine Press Both Brakes Recall Heading Maintain Heading
To Full Throttle Set Trim Look Heading Rudder Left/Right
Motor MethodsTo Full Throttle:Continue increasing throttle until lever stops moving
Planning Unit: Prepare for take off
DM
Unit Task: Get Started
Press Both Brakes+
Start Engine+
Cue: Motor module: not busyAuditory Module: no engine noise
Unit Task: Do settings
Set Trim+
Planning Unit: To take off speed
DM
Unit Task: Get to speed
Release Brakes+
To Full Throttle+
Unit Task: Watch Speed
Read Air Speed+
+
![Page 9: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/9.jpg)
Planning Unit: To take off speed
DM
Unit Task: Get to speed
Release Brakes+
To Full Throttle+
Unit Task: Watch Speed
Read Air Speed+
Vision Module
Look at [target]
Look out window
Top-down request
Opportunistic, when no top-down request
See movement+ Reasonable sized move
Interruption
Maintain Heading
Rudder, etc.+
Clear Buffer+(resulting in resume)
![Page 10: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/10.jpg)
Interruption• Interruptions and re-planning take place on different levels• Case 1
– Bottom up scanning– Small– Expected– Context remains the same (still taking off)– Handle it within the unit task
• Case 2– Bottom up scanning– Large– Unexpected– Context is changed (abort take off)– New unit task needed
• SGOMS Hypothesis – there is a set processing structure used across tasks
![Page 11: Sterling Somers : sterling@sterlingsomers.comsterling@sterlingsomers.com Dr. Robert West : robert_west@carleton.carobert_west@carleton.ca Both @ Institute.](https://reader030.fdocuments.us/reader030/viewer/2022032606/56649ead5503460f94bb3b8b/html5/thumbnails/11.jpg)
Thank you.
Sterling Somers : [email protected]
Dr. Robert West : [email protected]
Both @Institute of Cognitive ScienceCarleton UniversityOttawa, ON, Canada