Chapter 9: Extinction Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Extinction

A
  • Omitting the US (classical) or reinforcer (instrumental)
  • conditioned response declines
  • forgetting ? Not the same; changes bc of a passage of time, not because of experience
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

effects of extinction procedures

A
  1. target response decreases whine no longer = in reinforcement
    - after extinction burst
  2. increase in response variability (at first)
  3. frustration and aggression
  4. depression
  5. resurgence (regression)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Neuringer et al. (2001)

A

Rats presented 2 levers and a key in operant chamber

  • 3 responses in a row to get food
  • during acquisition:
    • group 1: had to vary response pattern
    • group 2: no variation necessary
  • then extinction (no reinforcement)
    results:
    1. rate of responding
  • decrease in overall rate of responding for both groups (during the reinforcement phase the control group with no variation had higher rates of responding)
    2. Response variability
  • increase in response variability during extinction for both groups (but the highest response variability was found in the experimental group!)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Tomie et al. (1993)

A

methods:

  • rats water deprived
  • four phases:
    1. alternative schedule of:
  • 3 min: VI-30 sec delivery of water
  • 3 min: no water (ext) singled by tone (S-)
    2.
  • no tone and tone conditions both = no water
    3.
  • same as phase 1.
    4.
  • no tone and tone both = water

behavioural measure: target bite bar (target biting is a sign of frustration in rats)

Result:
phase 1.
- no water presented during tone sessions. Lots of target biting during tone sessions
see slide 12

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

extinction and original learning

A

extinct does not reverse/undo original learning

  • how do we know this?
    1. spontanteous recovery
    2. renewal
    3. reinstatement
    4. resurgence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

extinction is not the _______ of acquisition

A

reversal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

spontaneous recovery

A

when responding recovers after a period of rest, after extinction trials

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Rescorla (1996) Spontaneous recovery: operant conditioning

A
  • responses (lever press or nose poke) acquired, then extinguished
  • R-rest: tested 7 days post-extinction
  • R-No rest: tested shortly after extinction
  • graph: R-Rest group had higher response rates always, they were really high initially then dropped off; the no rest group always had the lower responses!
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

renewal of original excitatory conditioning

A

incerased behaviour when the contextual cues that were present during extinction are changed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Bouten and King (1983) renewal of fear

A

fear conditioning in context A
then extinction in context A
test with context A => no fear

fear conditioning in context A
extinction training in context B
test with context A => fear!

  • fear measured in conditioned suppression of lever pressing
  • important: original acquisition generalizes across contexts more readily than extinction performance does!!!!
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what does renewal tell us?

A

extinction is about learning new S- contexts rather than “un-learning”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

reinstatement of conditioned excitation

A

rapid recovery of conditioned behaviour produced by exposures to the US

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Reinstatement of fear in humans: :bar and Phelps (2005)

A

fear conditioning -> extinction -> US presentations -> tested with CS ( = recovery of fear)or (= no fear)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Resurgence of conditioned behaviour

A

appearance of an extinguished response caused by the extinction of another behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

techniques for enhancing extinction

A
  • greater # of trials (decrease in spontaneous recovery)
  • massing and spacing
  • many alternations of extinction and rest sessions
  • extinction in many diff contexts qa
  • deepen extinction by using compound stimuli
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Compound stimuli in extinction, Rescorla (2006)

A
  • rats
  • three stimuli: light, noise, tone
  • acquisition of lever pressing in presence of stimuli, presented independently
  • compound extinction phase (light w/ one of the auditory stimuli; other with auditory alone)

results:
- compound stimuli = compound extinction trials deepened the extinction of the stimulus (also reduced reinstatement and slows rate of reaquisition)

17
Q

what is learned in extinction?

A
  • SR and RO associations are not eliminated ( shown by spontaneous recovery, renewal and reinstatement)
18
Q

why does extinction reduce responding is learning persists?

A

due to an inhibitory S-R association

- non-reinforcement of a response in the presence of a particular stimulus (S) produces an inhibitory association

19
Q

extinguished effects will be highly specific to the _____ in which the response was extinguished

A

context!

20
Q

Inhibitory S-R associations in instrumental extinction: rescoral 1993)

A
  • Noise and Light discriminative stimuli in extinction create expectancy
  • only one response available in extinction (inhibitory S-R)
  • the extinction procedure produced an inhabit S-R association that was specific to a particular stimulus and response
  • can’t be due to R-O or S-O associations bc changes in these would effect R1 and R2 equally
21
Q

Paradoxical rewards effects

A

you might expect that more acquisition training = behaviours that are harder to extinguish
- NOT TRUE

22
Q

overtraining extinction effect

A
  • the more acquisition trials, the greater the expectancy of reward, and the greater the frustration when extinction is introduced
  • produces more rapid extinction
  • odd!
23
Q

Ishida and Papini (1997)

overtraining extinction effect

A

titles that were trained longer showed more rapid extinction

24
Q

magnitude reinforcement extinction effect

A
  • more rapid extinction if trained w/ larger rather than smaller magnitude reinforcer
  • expectancy of greater reward produces greater frustration when it is not forthcoming
25
Q

Hulse (1958) magnitude reinforcement extinction effect

A

group reinforced 100% of the time w/ a large reward showed rapid extinction

26
Q

partial reinforcement extinction effect (PREE)

A
  • schedule in effect prior to extinction is important
  • chief characteristic is whether the schedule was CRF or PRF
  • much less resistance to extinction with PRF
  • high and low gamblers study
27
Q

Discrimination hypothesis

Jenkins (1962)

A

easier to notice at the start of extinction if on CRF than on PRF
jenkins:
- 2 groups of pigeons, 1st on CRF, 2nd on PRF
- both put on CRF, then immediately on extinction
- 2nd group took longer to extinguish

28
Q

Frustration theory (Amsel)

A
  • intermittent reinforcement (PRF) has rewarded and non-rewarded responses
    • reward responses motivation, non-rewarded responses are frustrating
  • sometimes what you expect will be a non-reinforced response produces a reinforcer
  • hence, frustrated responses lead to future expectation of reward; on CRF can’t learn to respond when expecting non-reward
29
Q

Sequential theory (Capaldi)

A
  • based on what subjects learn about the memory or non-reward
  • eg. you can’t remember whether or not a response was reinforced in recent past
  • based on memory, a non-rewarded trial can become a cue for responding
30
Q

Behavioural momentum

A
  • analogy with Newtonian physics
  • behaviour that has a lot of momentum will be hard to disrupt through manipulation
  • studied using multiple schedules of reinforcement
      1. diff reinforcement schedules are in effect for diff stimuli presented in succession
      1. add disruption (e.g. extra food b/w components, extinction, novel salient stimulus, etc)
      1. test how responding is affected for each schedule
31
Q

momentum of human behaviour: Mace et al. (1990)

A

VI 60, more reinforcement, more momentum

32
Q

lever pressing extinguishes less when…

A

pressing also leads to info about food elsewhere

33
Q

Fading

A

slowly extinguishing aspects of discriminative stimuli signalling reinforcement

  • increases success rates, decreases anxiety, prompts intrinsic reinforcement
  • taking the training wheels off the bike
34
Q

DRO

A
  • help alleviate frustration

- blurred line b/w extinction and negative punishment

35
Q

extinction

A

response no longer produces reinforcement

36
Q

negative punishment

A

response leads to withdrawal of reinforcement