Operant vs. Classical Operant responses understood by comprehending the consequences they produce...

46

Transcript of Operant vs. Classical Operant responses understood by comprehending the consequences they produce...

Page 1: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,
Page 2: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Operant vs. Classical

Operant responses understood by comprehending the consequences they produce

vs.

Pavlovian responses may have environmental effects, but this is not what controls them

Page 3: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Edward Thorndike

Acquisition of Goal-directed responses.

Law of Effect - behavior occurs in a random, trial-and-error fashion.

Consequences of a behavior can increase or decrease the future probability of that behavior. 1874-1949

Page 4: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Trials

Esc

ap

e T

ime

Cat Puzzle Box

Page 5: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Law of Effect

Responses followed by a satisfying outcome will strengthen the association between the situation and the response.

Responses followed by a dissatisfying outcome will weaken the association between the situation and the response.

Page 6: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Law of Effect

Press lever Escape from boxTime 1:

Time 2: Placed in box higher probability of pressing lever

Strengthens box-lever press association

Pull string Remain in boxTime 1:

Time 2: Placed in box lower probability of pulling string

Weakens box-string pulling association

Page 7: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Discrete-Trial ProceduresW. S. Small (1900) – used the maze as a tool to study operant learning in rats.

“complex” maze; measures = running speed, latency to reach goal.

Page 8: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Hampton Court Palace Maze

Page 9: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

T-Maze

Start

FoodNo Food

Page 10: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Straight Alley “Maze”

Start Food

Page 11: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Operant (Instrumental) Conditioning

The Skinner Box:

Page 12: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

2 Stages of training: 1. Magazine training

2. Shaping = reinforcement of successive approximations

Page 13: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

Page 14: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

Page 15: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

Page 16: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

Page 17: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Lever

Page 18: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Free-Operant Procedures

Discrete-trial procedures provide animal with limited opportunities to respond.

Free-operant procedures allow the animal to perform the instrumental response repeatedly without constraint.

Page 19: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Discrete-Trial Operant Procedure

Lever

Light = Discriminative stimulus (SD)

Page 20: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,
Page 21: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Acquisition and Extinction of Lever Press Response

Page 22: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Fixed

Variable

RatioInterval

Page 23: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Schedules of Reinforcement

Post-reinforcement pause

FI scallop

time

# re

spon

ses

Page 24: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Size of post-reinforcement pause determined by response-reinforcement ratio

Page 25: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

PREE

Page 26: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

What can be an operant?

Practically any behavior or behavioral parameter!

rate of responsetime of responsevariability of responsepushes and pullsposturestudy habitsathletic performancearts and craftscreativitybad habits and behavioral disorders

Page 27: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Allen et al. (1964)

• The case of Ann, a nursery school student

• Problems: asocial behavior, complaining, weird habits.

• Solution: Stop paying attention to her when she does these things.

Page 28: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Extinction of temper tantrums

Page 29: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Reinforcement without awareness

•Conditioning in amesics – eyeblink in HM

“Memento”

•Radio static study

Subjects told it was an experiment on stress.

Twitching of very small thumb muscle actually terminated the aversive stimulus (harsh noise)

•Students condition professor

Page 30: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Pigeon in a Pelican

Page 31: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Ginger

                                                                                                                                                                       

Page 32: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Does anyone know how google works?

google

http://www.google.com/technology/pigeonrank.html
Page 33: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Marian Breland Bailey – How to train a chicken

Page 34: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

The famous dancing chicken

Page 35: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Limits on Operant Conditioning

• Instinctive drift – “misbehavior.”

• Belongingness effects – reinforcer/behavior specificity e.g., behavior systems effects.

• Unintended consequences –Doing one thing precludes doing other things.

• Some responses cannot be conditioned.– E.g., yawning or sneezing.

Page 36: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Factors that affect O.C.

• The response– Maze running vs. lever pressing– Running vs. throwing football

• Temporal contiguity

Page 37: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Delayed reinforcement

Page 38: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Overcoming the effects of delay

• Secondary reinforcers

• “Marking” procedure

Page 39: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,
Page 40: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Factors that affect O.C.

• The response– Maze running vs. lever pressing– Running vs. throwing football

• Temporal contiguity

• Contingency

Page 41: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

“Superstitious Behavior”

• Suggested that temporal contiguity more important than contingency

• 15-s FT, no response requirement

• “adventitious reinforcement”

“In 6 out of 8 cases the resulting responses were so clearly defined that two observers could agree perfectly in counting instances. One bird was conditioned to turn counter-clockwise about the cage, making 2 or 3 turns between reinforcements. Another repeatedly thrust its head into one of the upper corners of the cage….”

Page 42: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Orienting toward feeder

Pecking near feeder

Moving along wall

¼ turn

Page 43: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Degraded Contingency Effect

= bar press = food

Perfect contingency

Degraded contingency

Signal extra food

= light CSResponse

Strong

Strong

Weak

Page 44: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Factors that affect O.C.

• The response– Maze running vs. lever pressing– Running vs. throwing football

• Temporal contiguity• Contingency• The reinforcer

– Magnitude, quality– Upshifts and downshifts

Page 45: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Anticipatory Contrast - Crespi (1942)

00.5

11.5

22.5

33.5

44.5

2 4 6 8 10 12 14 16 18 20 2 4 6 8

Trials

Run

ning

Spe

ed (f

t/se

c)

256-16 Pellets16-16 Pellets1 - 16 Pellets

Rats run down maze to find food pellets in goal arm.

Page 46: Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Reinforcement of Variability


OPERANT CONDITIONING. Responses become more or less likely to occur depending on the Responses become more or less likely to occur depending on the____________________________.

OPERANT CONDITIONING. Responses become more or less likely to occur depending on the Responses become more or less likely to occur depending on the____________________________.

Operant Conditioning. Operant Conditioning – A form of learning in which voluntary responses come to be controlled by their consequences. What does this.

Operant Conditioning. Operant Conditioning – A form of learning in which voluntary responses come to be controlled by their consequences. What does this.

Operant Conditioning Basics A form of learning in which responses come to be controlled by their consequences A form of learning in which responses come.

Operant Conditioning Basics A form of learning in which responses come to be controlled by their consequences A form of learning in which responses come.

Introduction to Operant Conditioning. Operant & Classical Conditioning 1. Classical conditioning forms associations between stimuli (CS and US). Operant.

Introduction to Operant Conditioning. Operant & Classical Conditioning 1. Classical conditioning forms associations between stimuli (CS and US). Operant.

Chapter 3: Pavlovian Conditioning: Foundations Pavlovian Conditioning or Classical Conditioning Ivan Pavlov –Early 1900s –A Russian physiologist digestive.

Chapter 3: Pavlovian Conditioning: Foundations Pavlovian Conditioning or Classical Conditioning Ivan Pavlov –Early 1900s –A Russian physiologist digestive.

Pavlovian or Classical Conditioning Psychology 3306.

Pavlovian or Classical Conditioning Psychology 3306.

Chapter 3: Pavlovian Conditioning: Foundations

Chapter 3: Pavlovian Conditioning: Foundations

Inhibitory Pavlovian Conditioning

Inhibitory Pavlovian Conditioning

CHAPTER 4 Pavlovian Conditioning: Causal Factors.

CHAPTER 4 Pavlovian Conditioning: Causal Factors.

Pavlovian Conditioning Procedures

Pavlovian Conditioning Procedures

Operant applications

Operant applications

Pavlovian, Observational and Instructed Fear Learning: Emotional Responses to Unmasked and Masked Stimuli Andreas Olsson, Kristen Stedenfeld & Elizabeth.

Pavlovian, Observational and Instructed Fear Learning: Emotional Responses to Unmasked and Masked Stimuli Andreas Olsson, Kristen Stedenfeld & Elizabeth.

Learning perspectives: Lecture #3 topics start keeping a dream diary! classical conditioning (Pavlov) conditioned emotional responses operant conditioning.

Learning perspectives: Lecture #3 topics start keeping a dream diary! classical conditioning (Pavlov) conditioned emotional responses operant conditioning.

Operant Variability and the Power of Reinforcement - ERIC · Operant Variability and the Power of Reinforcement ... instrumental responses or voluntary actions. ... Pavlovian conditioning,

Operant Variability and the Power of Reinforcement - ERIC · Operant Variability and the Power of Reinforcement ... instrumental responses or voluntary actions. ... Pavlovian conditioning,

Module 10 Operant & Cognitive Approaches. OPERANT CONDITIONING Operant conditioning –Also called instrumental conditioning –Kind of learning in which.

Module 10 Operant & Cognitive Approaches. OPERANT CONDITIONING Operant conditioning –Also called instrumental conditioning –Kind of learning in which.

NEUROSCIENCE Pavlovian conditioning induced hallucinations … · NEUROSCIENCE Pavlovian conditioning–induced hallucinations result from overweighting of perceptual priors A. R.

NEUROSCIENCE Pavlovian conditioning induced hallucinations … · NEUROSCIENCE Pavlovian conditioning–induced hallucinations result from overweighting of perceptual priors A. R.

Operant Conditioning Pavlovian learning how stimuli provide information about other stimuli Operant learning how your behavior leads to good and bad results.

Operant Conditioning Pavlovian learning how stimuli provide information about other stimuli Operant learning how your behavior leads to good and bad results.

Pavlovian conditioning and cumulative reinforcement

Pavlovian conditioning and cumulative reinforcement

Operant Conditioning: An Overviewai2.on-rev.com/Documents/PrintFiles/OperantCond.pdf · 2016-07-09 · Operant Conditioning: An Overview Classical, or Pavlovian, conditioning is a

Operant Conditioning: An Overviewai2.on-rev.com/Documents/PrintFiles/OperantCond.pdf · 2016-07-09 · Operant Conditioning: An Overview Classical, or Pavlovian, conditioning is a

Classical Conditioning and Reinforcement Learningcdn.preterhuman.net/texts/science_and_technology/... · classical (or Pavlovian) and instrumental (or operant) conditioning. In classical

Classical Conditioning and Reinforcement Learningcdn.preterhuman.net/texts/science_and_technology/... · classical (or Pavlovian) and instrumental (or operant) conditioning. In classical