Chapter 8: Extinction and Stimulus Control

Question 1

Extinction

Answer 1

The non-reinforcement of a previously reinforced response, the result of which is a decrease in the future strength of that response.

Question 2

Extinction side effects

Answer 2

1. extinction bursts: momentary increase in strength of behaviour when you implement extinction
2. Emotional behaviour: AGITATED RAT!
3. Aggression
4. Resurgence: occurrence of other previously reinforced behaviours
5. Depression :(

Question 3

Schedule of reinforcement

Answer 3

intermittent schedules produce greater resistance than continuous ones

Question 4

Resistance to extinction

Answer 4

the extent to which responding persists after an extinction procedure has been implemented

Question 5

Partial reinforcement effect

Answer 5

the process whereby a behaviour maintained on an intermittent schedule is harder to extinguish than one on a continuous schedule

Question 6

History of reinforcement

Answer 6

the more reinforcers that the individual has received for that behaviour the greater the resistance to extinction

Question 7

Magnitude of reinforcer

Answer 7

magnitude of reinforcer can effect it’s resistance to extinction

Question 8

Degree of deprivation

Answer 8

degree to which the organism is deprived of a reinforcer also effects resistance to extinction

Question 9

Previous experience with extinction

Answer 9

greater numbers of exposure to extinction the quicker the behaviour extinguishes during subsequent exposures

Question 10

Distinctive signal for extinction / Discriminative stimulus for extinction (S∆)

Answer 10

extinction occurs more quickly if there is a discriminative stimulus that indicates extinction

Question 11

Spontaneous Recovery

Answer 11

the reappearance of an extinguished operant response, despite the continued absence of a reinforcer, following rest period after extinction

Question 12

Differential reinforcer of other behaviour (DRO)

Answer 12

the reinforcer of any other behaviour other than the target behaviour that is being extinguished

Question 13

Stimulus Control

Answer 13

a situation in which the presence of a discriminative stimulus reliably effects the probability of a behaviour or reliably “evokes” the behaviour

Question 14

Stimulus Generalization (operant conditioning)

Answer 14

the tendency for an operant response to be emitted in the presence of a stimulus that is similar to the SD

Question 15

Generalization Gradient

Answer 15

measure of the strength of responding in the in the presence of stimuli that are similar to the SD (or CS) and vary along a continuum
steep gradient = less generalization
flatter gradient = more generalization

Question 16

Stimulus discrimination

Answer 16

the tendency for an operant response to be emitted more in the presence of one stimulus than another

Question 17

Discrimination training

Answer 17

as applied to operant conditioning the reinforcement of responding in the presence of one stimulus (the SD) and not another stimulus
Discriminative stimulus for extinction = S∆

Question 18

The peak shift effect

Answer 18

following a discrimination training the peak of a generalization gradient will shift from the SD ti a stimulus that is further removed from the S∆

Question 19

Multiple schedule

Answer 19

A complex schedule consisting of two or more independent schedules presented in sequence, each resulting in reinforcement and having a distinctive SD
red:peck F30” food/ green:peck F60” (repeated)

Question 20

Behavioural Contrast

Answer 20

A change in the rate of reinforcement on one component of a multiple schedule produces an opposite change in the rate of response on another component

Question 21

Negative contrast effect

Answer 21

An INCREASE in the rate of REINFORCEMENT on one component of a multiple schedule produces a DECREASE in the rate of RESPONSE on the other component

Question 22

Positive contrast effect

Answer 22

a DECREASE in the rate of RESPONSE on one component of a multiple schedule produces an INCREASE in the rate of REINFORCEMENT on the other component

** as one component becomes less attractive the unchanged component becomes more attractive

Question 23

Anticipatory contrast

Answer 23

the process whereby the rate of response varies inversely with an upcoming “anticipated” change in the rate of reinforcement

** pigeons increase rate of responding when there is a stimulus indicating that extinction is imminent

Question 24

Errorless discrimination training

Answer 24

a gradual training procedure that minimizes the number of errors (non reinforced responses to the S∆) and reduces many of the adverse effects of discrimination training
1. S∆ is introduced early in training
2. the S∆ is presented in weak form and is gradually strengthened

Question 25

Fading, targeting, and habit

Answer 25

fading: gradually altering the intensity of a stimulus
targeting: training an animal to approach and touch a particular object
habit: an operant behaviour that is so well learned that practiced that it seems to automatically occur