b mod final Flashcards
unconditioned/ primary reinforcer
consequence that functions as a reinforcer without prior learning (eg. food, water, sex)
infant test
a reinforcer is an unconditioned reinforcer if it functions as a reinforcer for a newborn infant (exceptions: things that don’t become natural reinforcers until puberty, like sex)
conditioned reinforcer
consequence that acquires the capacity to function as a reinforcer through learning (association with unconditioned/primary reinforcer or other conditioned reinforcer)
backup reinforcer
reinforcer that gives the originally neutral stimulus its ability to reinforce behaviour
token economy
system in which tokens that can be accumulated are given as reinforcers for behaviour, then exchanged for backup reinforcers at a later point in time (often used with groups)
advantages of conditioned reinforcers, such as praise (2)
(1) can be delivered more immediately than a backup reinforcer and (2) can be used to bridge the delay between a behaivour and a backup rinforcer
conditioned punisher
consequence that acquires the ability to punish behaviour through association with (predictive of) backup punishers (eg. demerit, threat)
unconditioned punisher
consequence that functions as a punisher without prior learning (eg. pain, electric shock)
factors influencing effectiveness of conditioned reinforcement (4)
(1) powerful backup reinforcers produce powerful conditioned reinforcers, (2) variety (the more backup reinforcers the better), (3) schedule of pairing with backup (more frequent is better) and (4) respondent extinction
simple conditioned reinforcer
associated with a single backup reinforcer
generalized conditioned reinforcer
associated with many backup reinforcers
pitfalls of conditioned reinforcers (2)
(1) unknowingly misapply principle of conditioned reinforcement and (2) cease pairing a conditioned reinforcer with the backup reinforcer
liking for licks
spanking becomes a conditioned reinforcer because it is predictive of a treat/toy provided by a parent that feels guilty about spanking (no longer a punishment)
unknowlingly misapplying principle of conditioned reinforcement
pairing backup reinforcer with stimuli meant to be punishing; consequence meant to be a punisher by parent may actually come to function as a reinforcer for the undesirable behaivour because of the attention (conditioned reinforcement) it brings
extinction
non-reinforcement of a previously reinforced behaviour leads to a decrease in the likelihood of that behaviour occurring in that context; gradual and can be preceded by an initial increase in the behaviour frequency
factors that influence extinction (8)
(1) control the occurrence of reinforcers for the behaviour, (2) combine extinction with reinforcement of an alternative behaviour, (3) control the setting in which extinction is carried out, (4) use instruction, (5) Humphrey’s Paradox, (6) extinction bursts, (7) extinction elicits aggression and (8) spontaneous recovery
controlling reinforcement during extinction (4)
make sure behaviour is not inadvertantly reinforced by others or the environment, (2) make sure you control the correct reinforcer, (3) understand that sensory/automatic reinforcement is difficult to control and (4) be prepared for criticism,
Humphrey’s Paradox
extinction occurs quicker for a behaviour that is reinforced every time it occurs than for a behaviour that is intermittently reinforced, because it is easiter to discriminate that the contingency of reinforcement has changed
resistance to extinction = ____ in extinction = ?
persistence; index of the stength of a behaviour
extinction bursts
behaviour gets worse before it gets better; when extinction procedure is initiated, behaviour increases in frequency/ intensity before it gradually declines; DO NOT give up
extinction elicits aggression
placing a behaviour on extinction can produce an emotional reaction that can take the form of aggression directed toward other people or things in the context; less likely when extinction is combined with reinforcement of an alternative behaviour
spontaneous recovery
after a delay, a behaviour that has been extinguished can recover spontaneously (at a lower level than originally)
remedy for spontaneous recovery
conduct further extinction sessions, because recovery will be less following each session
extinction: positively reinforced behaviour
extinction involves withholding a reinforcer that was previously delivered contingent upon a behaviour
extinction: negatively reinforced behaviour
extinction involves preventing avoidance or escape from aversive stimulus (aversive stimulus is no longer removed by behaviour)
common misconception:
extinction = ____ the behaviour (ONLY true if reinforcer is attention)
ignoring
pitfalls of extinction (2)
(1) distribute attention unwisely (only to problem behaviours) and (2) apply extinction unknowingly to the behaviour of others in your context
shaping
development of a new behaviour through reinforcement of successive approximations to a final desired behaviour
shaping combines ___ and ____
reinforcement; extinction
what does extinction do in shaping?
induces variability in a response that was previously reinforced; variability inceases likelihood that the behaviour will meet the new criterion
factors influencing the effectiveness of shaping (4)
(1) precisely specifying the terminal behaviour, (2) choosing the starting behaviour, (3) choosing the shaping steps and (4) moving along at the correct pact
requirements for starting behaviour in shaping (2)
(1) occurs frequently enough to be reinforced within the session time and (2) approximates the final behaviour
pitfalls of shaping (2)
(1) can inadvertently shape a harmful behaviour and (2) failing to shape a desirable behaviour
intermittent reinforcement
not every response produces reinforcement
continuous reinforcement
every response produces reinforcement
intermittent reinforcement is used to ____ behaviour
maintain
advantages of intermittent schedules of reinforcement (4)
(1) reinforcer is effective for longer due to slower satiation (especially consummables), (2) behaviour is more resistent to extinction, (3) individuals work more consistently for reinforcement and (4) behaviour will be more readily transfered to control by natural reinforcers in the environment
fixed ratio (FR) schedule
reinforcement occurs after set number of responses
advantages of fixed ratio (FR) (2)
(1) high resistance to extinction and (2) produces high steady rate of responding (after PRP)
post-reinforcement pause (PRP)
no responses immediately after reinforcement; the more responses required to obtain reinforcement, the longer the PRP will be
which intermittent reinforcement schedules have a PRP and why?
fixed ratio and fixed interval; because they are predictable
ratio strain
increasing the number of responses required for reinforcement too quickly causes deterioration in responses (too rapid of a ratio change)
avoiding ratio strain
gradually increase number of response required to obtain reinforcement
variable ratio (VR) schedule
reinforcement after varied number of responses (average out to a fixed number)
advantages of VR (2)
(1) high steady rate of response and (2) no PRP
VR maintains behaviour at ____ ratio values than FR
higher
VR has ____ resistance to extinction than FR
greater
fixed interval (FI) schedule
reinforcement produced by the first response after a fixed interval of time (response before interval has elapsed has no effect)
PRP in fixed interval (FI) schedules varies directly with _____ of the ____
duration; interval
variable interval (VI) schedule
reinforcement produced by the first response after an interval of varying length (averages out)
in FI schedules, responses increase as the ___ of the interval nears
end
advantages of VI (2)
(1) moderately steady rate of response and (2) no PRP
in practice, ____ schedules are less common than ___ schedules
because?
interval; ratio
because:
- FI has long PRP
- VI has lower response rate than VR
what schedule type is a proposed model for procrastination?
fixed interval (FI)