Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained...
-
Upload
diana-mckenzie -
Category
Documents
-
view
226 -
download
2
Transcript of Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained...
![Page 1: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/1.jpg)
Chapter 8
Operant Applications
![Page 2: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/2.jpg)
HeroRats
• African giant pouched rat (Cricetomys gambianus)
• Trained for landmine and tuberculosis detection
• Uses classical and operant learning principles
en.wikipedia.org/wiki/File:Rat_eating_ban.jpg
![Page 3: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/3.jpg)
Why Giant Pouched Rats?
• Indigenous to Africa• Lives up to 8 years in captivity• Big (0.7-1.5 kg), but not “kaboom!-
big”• Calm, easily handled• Can work with multiple human
handlers• Don’t get bored easily; very
motivated by food!• Quick to train (into field in 8-12
months); don’t need obedience training
![Page 4: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/4.jpg)
Details
• Landmines– About 500,000 landmines in Mozambique– One rat can cover 200 m2 in one hour, the equivalent of
two days work for a human manual de-miner– 2006-2007, operating around three villages, 73,485 m2
cleared of ordinance, benefiting 266 families
• Tuberculosis– As accurate as human lab technicians– Nearly 100 times faster than human (40 samples in 7
minutes, or two days microscopy work for a lab technician)
![Page 5: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/5.jpg)
Training
• Start young (5 weeks)• Socialization/habituation
– E.g., pass generators, walk on wet grass, ride in cars, meet new people, etc.
• Classical conditioning– Clicker training
• Operant learning– Discrimination training– Respond (scratch) only in presence
of specific smells to receive food treat
![Page 6: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/6.jpg)
Training
• Classical conditioning– Clicker training
![Page 7: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/7.jpg)
Training
• Operant learning– Discrimination training– Respond (scratch) only in presence of specific
smells to receive food treat
![Page 8: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/8.jpg)
Training• Controlled conditions
– Scratch if buried TNT smelled
• Field training– Scratch if real (but defused) landmine smelled
![Page 9: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/9.jpg)
Certification• Harnessed to run along search grid
• Same certification for landmine detecting dogs
• Final test is “blind” (handlers don’t know mine locations)
![Page 10: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/10.jpg)
Fully Certified and in the Field
![Page 11: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/11.jpg)
HeroRats in Action
• Detecting tuberculosis
• Landmines
APOPO founder, Bart Weetjens, and HeroRat
![Page 12: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/12.jpg)
Self-Awareness
![Page 13: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/13.jpg)
Definitional Issues
• Self-awareness, consciousness
• Being able to observe your own behaviour
• Foresight, planning, self-recognition
![Page 14: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/14.jpg)
Observing the World
• Understanding another’s behaviour beneficial
• Reinforcement through watching others
![Page 15: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/15.jpg)
Observing Self
• Self-knowledge provides benefits
• Prediction of behavioural outcomes
• Appropriate response patterns
• Reinforcing results
![Page 16: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/16.jpg)
Gallup’s Mirror Self-Recognition Task
• Chimpanzees with mirror
• Stages
• Paint dot
• Changed appearance?
• Mental self-image
• Children
![Page 17: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/17.jpg)
General Reinforcement of Self-Observation?
• Skinner• Kinds of questions we ask children reinforces
self-observation• Shaping• e.g., “are you hungry?” “what are you doing?”• Accurate response likely results in some form
of desired outcome (i.e., reinforcement of behaviour)
![Page 18: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/18.jpg)
Self-Control
![Page 19: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/19.jpg)
Self-Control
• Choice
• Forgoing a small, immediate reinforcer for large, delayed reinforcer
• Not easy
• Adults, children, non-humans
• Techniques
![Page 20: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/20.jpg)
Physical Restraint
• Physically prevent behaviour from occurring
• e.g., Gorilla playface
• e.g., liquor cabinet
• e.g., credit cards
![Page 21: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/21.jpg)
Distancing
• Behaviour more likely to occur in specific environment
• Avoid environment to assist self-control
• e.g., smokers who want to quit should avoid places where smokers frequent
![Page 22: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/22.jpg)
Distraction
• Engage in behaviour incompatible with undesired behaviour
• DRI
• e.g., want a snack, go for a walk
![Page 23: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/23.jpg)
Deprivation and Satiation
• To avoid excesses
• e.g., to avoid overeating at party, eat small meal earlier
• Partial satiation
![Page 24: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/24.jpg)
Assistance
• Inform others of your goals
• Get help
• Changes the environment
• e.g., friends may be “enablers”
![Page 25: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/25.jpg)
Behavioural Monitoring
• Keep track of your own behaviour
• Notebook, graphs, etc.
• Out-of-sight, out-of-mind
• Visible indicators– Dieters in room with candy bowl; wrappers
![Page 26: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/26.jpg)
Verbal Behaviour
![Page 27: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/27.jpg)
Skinner (1957)• Verbal Behavior• Suggests ideas not encoded into words by
speaker and decoded by listener• Words are behaviours• Functional relationship between a word and
an outcome (i.e., reinforcement or punishment)
• Social consequences provide shaping and maintenance of language
![Page 28: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/28.jpg)
Early Shaping of Words
• Babies babble
• Parents reinforce certain sounds with attention, etc.
• Increases frequency of these sounds
• Gradually, reinforcement for more complex vocalizations only
![Page 29: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/29.jpg)
Shaping Language?
• Greenspoon (1955)– Plural nouns in word lists
• Verplanck (1955)– Use of opinion statements
• Quay (1959)– Therapists; statements about family members
![Page 30: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/30.jpg)
Complex
• Life-long reinforcement (and punishment) history
• Influences vocal behaviour in complicated ways
• Much vocal reinforcement without conscious knowledge
![Page 31: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/31.jpg)
Insightful Problem Solving
![Page 32: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/32.jpg)
Problem Solving
• Trial and error
• Sudden solution; insight– Skip intermediate steps
![Page 33: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/33.jpg)
Kohler (1927)
• Chimpanzees
• 2 short sticks that slot together
• Need longer stick to reach fruit outside cage
• Chimp suddenly “got it”
![Page 34: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/34.jpg)
Dissenting Views
• Many studies show learning to be a slow, gradual process
• Intermediate steps
• Reinforcement history
• Past experiences
• Observational learning
![Page 35: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/35.jpg)
Creativity
![Page 36: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/36.jpg)
Can Creativity be Shaped?
• Novelty, original behaviour
• Provide reinforcement only for novel behaviour produces novel behaviours
• Pryor’s (1969): dolphins and pigeons
• Various studies with children
• Japanese business model: R&D
![Page 37: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/37.jpg)
Rewards and Creativity• Some studies suggest rewards reduce
creativity
• Design: reward for task vs. no reward for task– More creative responses in no reward group– But, task completion, not creativity, is
reinforced here
![Page 38: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/38.jpg)
Superstition
![Page 39: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/39.jpg)
Accidental Conditioning
• B.F. Skinner (1948)
• Pigeons
• Grain every 15 seconds (FT-15sec)
• Development of behaviours
• Accidental strengthening
![Page 40: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/40.jpg)
Timing?
• Staddon & Simmelhag (1971)
• Interim and terminal behaviours
• Time-based food related behaviour
![Page 41: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/41.jpg)
Humans
• Bruner & Revusky (1961)– Teenagers and 4 buttons; only button 3 gave
reinforcement on FI schedule
• Wagner & Morris (1987)– Children and clown doll giving marbles
• Ono (1987)– University students and levers; told to gain as
many points as possible, but points just given periodically
![Page 42: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/42.jpg)
Social Context
• Behaviour performed for first time
• If social validation occurs, more likely to happen again
• Superstitions starting as children
• Observational learning
![Page 43: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/43.jpg)
Delusions and Hallucinations
![Page 44: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/44.jpg)
Attention Seeking
• Not always a biological root
• Patients
• Delusions provide attention from staff
• Social reinforcement
• “Weird” behaviours might be shaped
• Stop reinforcement to reduce behaviour
![Page 45: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/45.jpg)
Self-Injurious Behaviour
![Page 46: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/46.jpg)
Self-Injuries
• Punishment often effective for suppression
• Lovaas & Simmons (1969)– Boy making 30 hits per minute– Four behaviour-contingent electric shocks to leg– Self-injurious behaviour stopped
![Page 47: Chapter 8 Operant Applications. HeroRats African giant pouched rat (Cricetomys gambianus) Trained for landmine and tuberculosis detection Uses classical.](https://reader031.fdocuments.us/reader031/viewer/2022031922/56649edb5503460f94bea76a/html5/thumbnails/47.jpg)
Wolf (1967)
• Injurious behaviour increased when teacher asked boy questions
• Injurious behaviour dropped when teacher stopped asking questions
• Escape: negative reinforcement– Taking away teacher causes behaviour to
increase
• Use of DRI and DRA to reduce SI behaviour