Chapter 9 Flashcards
extinction provides ________ and _______
flexibility and adaption
2 approaches to extinction
classical conditioning:
- acquisition: CS + US —- CR
- Extinction: remove US
- results: decrease responding
instrumental conditioning:
- acquisition: response —- reinforcement
- extinction: remove reinforcer
- result: decrease responding
T/F: extinction is forgetting
FALSE
extinction is NOT forgetting, rather an active process by pairing CS or response with an absence of outcome
extinction effects (early, late and final response):
early:
- multiple attempts (mistyped passcode, try same one again)
late:
- increase response variability (try different passcode)
final:
- responding decreases (stop trying)
neuringer et. al. 2001 experiment for extinction
subject: 2 groups of rats in skinner box
response requirement: 3 responses for reinforcement
- left lever
- right
- spinner
training:
- group 1: sequence of 3, must vary/reinforces creativity/variability
- group 2: yoked to group 1 reinforcers, any combo of 3 of their choosing, more stereotyped responding
extinction phase:
- reinforcement removed for both groups
results of reinforcement:
- yoked rats responded slightly faster (easier response)
- reinforcing variability increased variable responses
results of extinction:
- both groups increased variability
- eventually both stop responding
what was missing in the neuringer et. al. 2001 experiment for extinction
burst of responding at beginning oof extinction
what emotion does extinction elicit?
frustration
although extinction produces important behavioral and emotional effects, it does not reverse …
acquisition
CS-US relationship is still maintained, but extinction is an additional process that co-exists
4 acquisition supported phenomena
spontaneous recovery
renewal
reinstatement
sensitivity to devaluation
spontaneous recovery
the learned response returns after a delay
TIME is key word, passage of time needed for this to occur
Rescorla spontaneous recovery experiment
classical conditioning
acquisition of tracking
- ex. CS (noise) — US (sucrose) ~ 32 head poke entries
extinction
- 32 extinction trials (noise with no sucrose/CS without US)
4 test trials (2 groups)
- immediately (no rest)
- after 8 days of rest (rest)
results
- extinction decreases responding
- low responding persists in No rest
- CS: rest produces spontaneous recovery
renewal
recovery of behavior when contextual cues present during extinction are changed
CONTEXT being the key word
2 things to look for in renewal
- how does renewal confirm if acquisition remains
- means in terms of exposure/behavioral therapy
bouton and king, 1983, study about renewal
phase 1: conditioning in context A (skinner box with lights and rose scent)
- lever press for food
- tone (CS) paired with foot shock (US)
- condition suppression/suppression ratio approaching 0 = fearful
- tone = low lever pressing
phase 2: extinction procedure (3 groups)
- group 1: CS extinction in context A (extinguishing fear of tone in context A)
- group 2: CS extinction in context B (extinguishinig fear of tone in context B)
- group 3: no extinction (NE)
test:
- 4 trials with CS in original context A
- measure conditioned suppression (0 = fear, 0.5 = no fear)
results of bouton and king, 1983, study about renewal
- conditioning suppressed lever pressing
- extinction reduced suppression
what happened in bouton and king study when tested in original context (A)
when tested in original context (A):
1. NE demonstrate suppression
2. extinction A maintain responding
3. extinction B show renewal of suppression
memory of extinction is specific to ____ present during extinction
cues; big problem in exposure therapy!
renewal example in clinical settings
extinct the fear of riding elevators using the science four elevator but it the fear renews when riding an elevator in a tall NYC building
if we renew a subject back to the extinction context, extinction can quickly be _______!
restored
reinstatement
recovery of responding to an extinguished stimulus produced by exposure to the original US or reinforcer
key words being exposure to original US or reinforcer
reinstatement study by LaBar and Phelps, 1983
subjects: yale undergrads
phase 1: acquisition - 4 trials
- CS: blue square on screen
- US: loud pulsating noise burst
- CR: skin conductance (sweat)
phase 2: extinction procedure
- CS, no US
phase 3: reinstatement - 4 trials and 2 separate groups
- US alone in extinction context
- US alone in different context
test: testing skin conductance to CS in acquisition context
reinstatement study by LaBar and Phelps, 1983 results
results: (not as simple as you think)
- acquisition: skin conductance (SCR) to CS increases over training
- extinction: SCR decreases with CS alone
- Test:
- reinstatement noise bursts (US) in acquisition/extinction context reinstates SCR to CS in test
- reinstatement does not occur if noise burst US is given in different context
real world example of reinstatement
seeing an ex-girlfriend in the same city where you guys dated will increase the likelihood of you rekindling the romance
in acquisition for Pavlovian conditioning, what associations drive responding?
S-S
T/F: in acquisition for instrumental conditioning, all associations contribute to responding
true; S-O, S-R, and R-O
in extinction, what associations are the most important?
S-R
non-reinforcement produces an _______ S-R associatioin
inhibitory
non-reinforcement in the presence of specific stimuli or environments (S) inhibits …
responding (R)
for renewal, the extinction context is often the …
specific stimulus (S)
the inhibitory S-R relationship depends upon __________ ________ of organism
reinforcement history
_________ produces an inhibitory S-R relationship
frustration; “why try”
according to the summation test, does A inhibit responding to B?
train: A+/B+
extinguish: A-
Test: AB
YES
according to the retardation of acquisition test, does A inhibit reacquisition?
train: A+
extinguish: A-
Test: A+
YES
spot check:
extensive reinforcement training should slow the rate of extinction:
true or false?
false
spot check:
responding declines more rapidly in extinction following reinforcement with a larger reinforcer:
true or false
true
spot check:
continuous reinforcement produces more resistance to extinction than partial reinforcement:
true or false
false
paradox
a true statement that contradicts intuition
Does more extensive training produce resistance to extinction?
NO
overtraining
if decreased responding is due to frustration of unexpected lack of reinforcement, more rapid extinction should occur when expectancy is higher
Does responding decrease more rapidly in extinction following training with a larger reinforcement?
YES
magnitude reinforcement extinction effect
more rapid extinction should occur when reinforcer expectancy is larger
Partial reinforcement extinction effect (PREE)
extinction is slower if partial rather than continuous reinforcement was previously in effect
ex. will stop trying to use an ATM (continuous reinforcement) if it doesn’t work quicker than stop playing roulette (partial reinforcement)
using the PREE, what should you do to prevent tantrums as well as reversing tantrum development?
if acquired behavior and goal to extinct it as soon as possible, go through crash and burn:
- expect it so the first time they do not receive it they lose their minds, second time is just angry and by the third they will be ok
3 hypotheses/mechanisms of PREE
discrimination hypothesis
frustration hypothesis
sequential hypothesis
Mechanism of PREE: discrimination hypothesis
introduction of extinction is easier to detect after continuous reinforcement vs. partial reinforcement
Mechanism of PREE: frustration hypothesis
persistence in extinction results from learning to respond when you anticipate you will be non-reinforced or frustrated
dependent upon intermittent reinforcement in training/acquisition (refer to image)
non-reinforcement trials leads to a subconscious expectation (key word) of an eventual reinforcer, even in the face of extinction
Mechanism of PREE: sequential hypothesis
subjects remember rewarded trials followed by non-rewarded trials and the memory of the non-rewarded trials serve as cure for the next reward
the explicit memory creates a “it’s got to happen sooner or later” idea
what is the hypothesis that is NOT a paradoxical reinforcement effect
behavioral momentum hypothesis
behavioral momentum hypothesis
NOT a paradoxical reinforcement effect, postulates persistence in extinction may represent resistance to change
suggests that behavior with momentum is difficult to stop
ex. drug addiction is a behavior too much momentum
spot check:
a rat has been trained to lever press for food reinforcement on a continuous schedule of reinforcement. If the rat is allowed to lever press but food is suddenly no longer provided, what will happen first?
the rat twill increase the variability of his responses
the rat will increase its response rate
the rat will learn the lever and food are no longer associated
the ratt will reduce its response rate
the rat will increase its response rate; although continuous reinforcement = faster extinction, we still stick to the rules of extinction with an increase of behavior first
