Chapter 8: Extinction and Stimulus Control Flashcards
Extinction
The non-reinforcement of a previously reinforced response, the result of which is a decrease in the future strength of that response.
Extinction side effects
- extinction bursts: momentary increase in strength of behaviour when you implement extinction
- Emotional behaviour: AGITATED RAT!
- Aggression
- Resurgence: occurrence of other previously reinforced behaviours
- Depression :(
Schedule of reinforcement
intermittent schedules produce greater resistance than continuous ones
Resistance to extinction
the extent to which responding persists after an extinction procedure has been implemented
Partial reinforcement effect
the process whereby a behaviour maintained on an intermittent schedule is harder to extinguish than one on a continuous schedule
History of reinforcement
the more reinforcers that the individual has received for that behaviour the greater the resistance to extinction
Magnitude of reinforcer
magnitude of reinforcer can effect it’s resistance to extinction
Degree of deprivation
degree to which the organism is deprived of a reinforcer also effects resistance to extinction
Previous experience with extinction
greater numbers of exposure to extinction the quicker the behaviour extinguishes during subsequent exposures
Distinctive signal for extinction / Discriminative stimulus for extinction (S∆)
extinction occurs more quickly if there is a discriminative stimulus that indicates extinction
Spontaneous Recovery
the reappearance of an extinguished operant response, despite the continued absence of a reinforcer, following rest period after extinction
Differential reinforcer of other behaviour (DRO)
the reinforcer of any other behaviour other than the target behaviour that is being extinguished
Stimulus Control
a situation in which the presence of a discriminative stimulus reliably effects the probability of a behaviour or reliably “evokes” the behaviour
Stimulus Generalization (operant conditioning)
the tendency for an operant response to be emitted in the presence of a stimulus that is similar to the SD
Generalization Gradient
measure of the strength of responding in the in the presence of stimuli that are similar to the SD (or CS) and vary along a continuum
steep gradient = less generalization
flatter gradient = more generalization
Stimulus discrimination
the tendency for an operant response to be emitted more in the presence of one stimulus than another
Discrimination training
as applied to operant conditioning the reinforcement of responding in the presence of one stimulus (the SD) and not another stimulus
Discriminative stimulus for extinction = S∆
The peak shift effect
following a discrimination training the peak of a generalization gradient will shift from the SD ti a stimulus that is further removed from the S∆
Multiple schedule
A complex schedule consisting of two or more independent schedules presented in sequence, each resulting in reinforcement and having a distinctive SD
red:peck F30” food/ green:peck F60” (repeated)
Behavioural Contrast
A change in the rate of reinforcement on one component of a multiple schedule produces an opposite change in the rate of response on another component
Negative contrast effect
An INCREASE in the rate of REINFORCEMENT on one component of a multiple schedule produces a DECREASE in the rate of RESPONSE on the other component
Positive contrast effect
a DECREASE in the rate of RESPONSE on one component of a multiple schedule produces an INCREASE in the rate of REINFORCEMENT on the other component
** as one component becomes less attractive the unchanged component becomes more attractive
Anticipatory contrast
the process whereby the rate of response varies inversely with an upcoming “anticipated” change in the rate of reinforcement
** pigeons increase rate of responding when there is a stimulus indicating that extinction is imminent
Errorless discrimination training
a gradual training procedure that minimizes the number of errors (non reinforced responses to the S∆) and reduces many of the adverse effects of discrimination training
1. S∆ is introduced early in training
2. the S∆ is presented in weak form and is gradually strengthened
Fading, targeting, and habit
fading: gradually altering the intensity of a stimulus
targeting: training an animal to approach and touch a particular object
habit: an operant behaviour that is so well learned that practiced that it seems to automatically occur
