SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of...
-
Upload
johnathan-patrick -
Category
Documents
-
view
257 -
download
2
Transcript of SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of...
![Page 1: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/1.jpg)
SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING
• Two-term contingency: R SR
• Nature of reinforcer can vary: R S [SR, Sr, S-R, S-r].
• 3-term contingency (Discriminative operant)
SD : R SR (light: bar press food)
S : R SR (no light: bar press food)
• Chaining of discriminative operants:
• Nature of discriminative stimulus can vary: [exteroceptive, interoceptive, proprioceptive].
![Page 2: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/2.jpg)
SKINNER’S “THEORY” (con’t.)
• Contingency of reinforcement can vary: Rn/t SR
• Schedule of reinforcement can vary: R SR
– subject must emit n responses within a particular time frame t.
• Verbal Behavior. Behavior that is reinforced by a member of one’s verbal community.
• Private events. Discriminative responding to proprioceptive or interoceptive stimuli (stimuli under our skin, Sd : r Sr)
![Page 3: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/3.jpg)
![Page 4: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/4.jpg)
Behaviorist Approach• All learned behavior (human and
animal) can be explained by the principles of classical and instrumental learning theory (2-factor learning theory).
• Classical conditioning:– assumes that CS’s and US’s can be paired arbitrarily.– assumes that temporal contiguity of CS and US is
necessary and sufficient for establishing CR.
• Instrumental conditioning:– assumes that responses selected for reinforcement
are arbitrary.
• No need to postulate mental processes.
![Page 5: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/5.jpg)
EVIDENCE THAT QUESTIONED
BEHAVIORISTS’ ASSUMPTIONS• “Misbehavior” of organisms
• Garcia’s experiment on taste aversion
• Autoshaping and omission training
• Blocking
• Rescorla’s experiment on predictiveness of US.
• Experiments on animal cognition
– Hunter’s definition of representation– Radial maze– Matching-to-sample
![Page 6: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/6.jpg)
GARCIA EXPERIMENT ON TASTE AVERSION
• Rats signalled about two types of noxious stimuli (nausea and shock) by two types of CS (taste and sound).– taste: liquid sweetened with saccharine– nausea: induced by lithium chloride
• Group I: Compound CS [taste & sound] Shock
• Group II: Compound CS [taste & sound] Nausea
• Effect of CS evaluated in 2-bottle choice test:– Bottle 1: saccharine flavored water– Bottle 2: water
• Group I: preferred sweet drink (natural preference)
• Group II: preferred water (avoid natural preference)
![Page 7: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/7.jpg)
![Page 8: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/8.jpg)
Blocking experiment (Kamin)
• Training: CS1 Shock:
CS1 + CS2 Shock
• Test: CS1 fear
CS2 no fear
![Page 9: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/9.jpg)
Predictable and Unpredictable Occurrences
of FoodKey
Light
Food
KeyLight
Food
_______p(Food/Key Light) > p(Food/Key Light)
Predictable:
CS:
US:
_______p(Food/Key Light) =p(Food/Key Light)
Unpredictable:
CS:
US:
![Page 10: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/10.jpg)
![Page 11: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/11.jpg)
Omission Training
SD (Key light):
R (Peck):
SR (Food):
![Page 12: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/12.jpg)
EVIDENCE THAT QUESTIONED
BEHAVIORISTS’ ASSUMPTIONS• “Misbehavior” of organisms
• Garcia’s experiment on taste aversion
• Autoshaping and omission training
• Blocking
• Rescorla’s experiment on predictiveness of US.
• Experiments on animal cognition
– Hunter’s definition of representation– Radial maze– Matching-to-sample
![Page 13: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/13.jpg)
HUNTER ON “REPRESENTATIONS”
...If comparative psychology is to postulate a representative fact, ...it is necessary that the stimulus represented be absent at the moment of the response. If it is not absent, the reaction may be stated in sensory-motor term (Hunter, 1913, p. 21).
![Page 14: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/14.jpg)
![Page 15: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/15.jpg)
MATCHING-TO-SAMPLE
Peck Peck (food) Peck (no food)
Peck Peck (no food) Peck (food)
R R G
R R G
A. Matching-to-Sample
B. Oddity
A. Matching-to-Sample
Peck
![Page 16: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/16.jpg)
![Page 17: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/17.jpg)
RADIAL MAZE
![Page 18: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/18.jpg)
![Page 19: SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING Two-term contingency: R S R Nature of reinforcer can vary: R S [S R, S r, S -R, S -r ]. 3-term contingency.](https://reader036.fdocuments.us/reader036/viewer/2022081501/56649f125503460f94c25680/html5/thumbnails/19.jpg)