Exam 3 Review Flashcards
a schedule for reinforcing the first response after a fixed number of responses
Fixed Ratio
Fixed Ratio
a schedule for reinforcing the first response after a fixed number of responses
reinforcing the first response after a variable number of responses
variable ratio
Variable Ratio
reinforcing the first response after a variable number of responses
schedule for reinforcing the first response after a fixed period of time since the prior reinforcement
fixed interval
fixed interval
schedule for reinforcing the first response after a fixed period of time since the prior reinforcement
reinforcing the first response after a varying period of time
variable interval
variable interval
reinforcing the first response after a varying period of time
What are the different types of intermittent reinforcement?
Continuous: every repose reports a reinforcer
Intermittent: some responses are reinforced (FR, FI, VR, VI)
Extinction: every response earn no reinforcer
Which schedule of reinforcement is the fastest and most consistent with responses and is our favorite?
Variable Ratio
Which schedule of reinforcement has a scallop pattern?
Fixed Interval
What scientist tested intrinsic versus extrinsic motivation with markers?
Neuringer
What were the conclusions of Neuringer’s studies?
any time you move from more to less reinforcement, there will be a below-baseline dip in responding
the type of reinforcement used (intrinsic vs extrinsic) doesn’t appear to matter
the effect is temporary
extrinsic rewards are not evil
Any task that involves vigilance involves which schedule of reinforcement?
Variable Interval
When behavior occurs in the presence of novel stimulus (that resemble an SD)
generalization
generalization
When behavior occurs in the presence of novel stimulus (that resemble an SD)
What is the shape of the generalization gradient?
Bell-shaped, curved
What three techniques are used to promote generalization?
train and hope, generalization training (best), similar stimuli
What is the Milgram compliance studies?
person in lab coat tells participant to deliver shock. 40% give fatal shock.
The more status the person appeared to have the more likely they’ll give the fatal shock
Study where participant delivers shock
Milgram Compliance Study
Importance of Milgram Compliance Study of generalization?
participants found people who wore white lab coats (fit their generalized view of reliable authority) to be trustworthy to the point of lethal shock
positive punishment
The procedure in which a stimulus is delivered contingent upon a behavior and the rate of that behavior decreases
The procedure in which a stimulus is delivered contingent upon a behavior and the rate of that behavior decreases
postive punishment
2x2 grid
Top row: Increase and Decrease
Left column: Presented and Removed
Presented-Increase: Positive Reinforcement
Presented-decrease: Positive Punishment
Removed-Increase: Negative Reinforcement
Removed-Decrease: Negative Punishment
a procedure for determining why inappropriate behavior occurs
functional analysis
functional analysis
a procedure for determining why inappropriate behavior occurs
What are the steps of function analysis?
self-stimulating, attention-seeking, escape behavior
chart all of these to see what the SIB is for
if the SIB can’t be diminished with reinforcers, then they can use punishers
When can punishment be used?
the behavior is harmful to the client or those around the client
Functional analysis fails to yield an effective reinforcement based intervention
punishment is part of a meticulously designed and professionally monitored clinical intervention
clients or client’s parent/guardian consents to procedure
the procedure in which a stimulus is withdrawn contingent upon a behavior and the rate of that behavior decreases
negative punishment
negative punishment
the procedure in which a stimulus is withdrawn contingent upon a behavior and the rate of that behavior decreases
In order for timeout to be an effective punishment by contingent withdrawal procedure, what has to happen?
the organism has to be removed from a reinforcing environment or activity
What are the characteristics of effective punishment?
contingency: deliver punisher when behavior occurs
Immediacy: deliver punisher directly after behavior
size: larger magnitude punisher are more effective
establishing operation: the more motivated one is for the reinforcer, the less effective punishment will be
What are some of the side-effects of punishment?
emotional response: you deliver punishment, you are conditioned as aversive stimulus
addiction to using punishment: immediate effectiveness, more likely to use it again
Overt, voluntary behavior emitted where more than one action could have been taken
choice
choice
Overt, voluntary behavior emitted where more than one action could have been taken
What are the four variables of choice?
reinforcement, reinforcer size, response effort, reinforcer immediacy
What does the left side of the Matching Law equation stand for?
behavior
What does the right side of the Matching Law equation stand for?
reinforcement rates
What is the Matching Law equation and who discovered it?
Herrnstein
B1/B1+B2 = R1/R1+R2
the value of a reinforcer is discounted when it is delivered following a delay.
delay discounting
delay discounting
the value of a reinforcer is discounted when it is delivered following a delay.
What is the shape of the delay discounting function?
It starts high then drops quickly and kinda levels out but continues to drop. Like a curved “L.”
A complex choice situation that pits two variables against one another. occurs when you choose a smaller-sooner over a larger- later reinforcer
impulsivity
impulsivity
A complex choice situation that pits two variables against one another. occurs when you choose a smaller-sooner over a larger- later reinforcer
one that is inconsistent over time
irrational choice
irrational choice
one that is inconsistent over time
How does the shape of the delay discounting function help us understand irrational choices?
e.g. seeing the benefit of studying for a test that’s 28 days away once break is over, over watching tv in 8 days. But as the break ends, the value of tv increases to being higher than a test that’s still 20 days away. So you change your mind which is irrational.
What is the Rachlin and Green experiment?
Pigeon picks between red key orange key. Red key goes to blue (delay then 3) and green key (no delay and 1). Orange goes to blue (delay then 3) and black key (nothing). Pigeon ends up picking orange, forcing themselves to wait for larger-later reinforcer.
How are the results of the Rachlin and Green experiment relevant to human decision making?
If we often choose irrational choices, we can learn from the pigeons to force ourselves to pick the larger-later. Leaving us no option of the smaller-sooner.
