Unit 3 study guide Flashcards
Definition of establishing operation (EO)
An environmental and/or biological event that
(1) temporarily increases the value of a specific reinforcer and
(2) increases the probability of behaviors yielding that reinforcer.
Example of an establishing operation (EO)
- Depriving an individual of any primary reinforcer or an operant behavior is an EO.
- Getting a sunburn –> temporarily increases the use of aloe vera.
Definition of motivating operation (MO)
an environmental and/or biological event that
(1) temporarily alters the value of a specific reinforcer and
(2) increases/decreases the probability of behaviors yielding that reinforcer.
Example of a motivating operation (MO)
Food deprivation. This MO increases the probability of food-seeking, food preparing and food eating behaviors. Each of these actions are ultimately reinforced when food passes the lips.
Definition of an abolishing operation (AO)
an environmental and/or biological event that
(1) temporarily decreases the value of a specific reinforcer and
(2) decreases the probability of behaviors yielding that reinforcer.
Example of an abolishing operation (AO)
A stomach full of food. Temporarily decreases the reinforcing value of food.
What is a reinforcer survey?
A structured interview or written survey that asks the individual to identify highly preferred activities.
Why is a reinforcer survey used?
To identify potential reinforcers.
What is a stimulus preference assesement?
A rank ordered list of preferred stimuli is obtained by observing choices between those stimuli.
Why is a stimulus preference assessment used?
to identify reinforcers to use in behavior interventions to reduce problem behavior.
What is a preference hierarchy
a list of stimuli ranked ordered from most to least preferred
Define the Premack principle
- Involves offering a pleasurable incentive in exchange for completing an unpleasurable task.
- EX) You get ice cream if you eat your vegtables.
What is a breakpoint?
the maximum amount of behavior the reinforcer will maintain
What does a breakpoint tell us about a reinforcer’s efficacy?
The harder the break point to reach, the more effective it is.
ex) Cocaine’s breakpoint was about four times higher than chlorphentermine’s; that is, the baboons participating in this study worked four times as hard for a cocaine reinforcer than for chlorphentermine. Therefore, we may conclude that cocaine is four times as reinforcing – it maintained four times as much behavior.
Four dimensions of reinforcer efficacy
- contingency
- reinforcer size
- reinforcer quality
- reinforcer immediacy
Define contigency
- If I do the dishes –> THEN I can play my video game
- if you cheat on this self-imposed contingency, allowing yourself to play video games despite a sink full of dirty dishes, then video game access will fail to function as a reinforcer. Your reinforcer has faltered on the dimension of contingency.
Define reinforcer size
- Larger reinforcers are more effective than smaller reinforcers.
- The larger the reinforcer, the sooner satiation will occur.
Define reinforcer quality
The subjective value of a reinforcer, which can vary from one individual to the next.
Define reinforcer immediacy
Reinforcement should be given as soon after the target behavior as possible.
What is a habit? How are they formed?
- operant behavior that is (1) evoked by antecedent stimuli and (2) persists despite the imposition of an AO.
- when an operant response has been repeatedly reinforced, hundreds, if not thousand of times in the presence of the same antecedent stimulus.
List 5 strategies for forming good habits, or getting rid of bad habits (hint: its linear and summer cant say the word from step 1)
- Find the antecedents that evoke bad habits
- Replace them with stimuli that will, one day, evoke a good habit.
- Set the bar very low.
- Experience the self esteem building intrinsic reinforcers that can only be sampled when we engage in the desired behavior.
- Gradually increase the daily goal, remembering to keep it easy.
Definition of a punisher
A contingent consequence that decreases the future probability of behavior below its pre-punishment level.
Definition of a punishment
The process or procedure whereby a punisher decreases the future probability of an operant response.
Difference between positive punishment and negative punishment
- The contingent presentation of a consequence that decreases the future probability of the behavior below its no punishment level.
- The contingent removal, reduction, or prevention of a reinforcer; the effect of which decreases the future probability of the behavior below its no-punishment level.
Under what circumstances will behavior analysts use punishment in a clinical setting?
When multiple reinforcement strategies alone have not been effective.
6 characteristics of effective punishment interventions
- Focus on reinforcement first
- Combine punishment with extinction and/or differential reinforcement
- Deliver punishers immediately
- Deliver punishment contingently
- Punish every time
- Use a punisher in the goldilocks zone
Definition of a primary punisher
a contingent consequence that functions as a punisher because, in the evolutionary past of the species, this consequence decreased the chances of survival.
Example of a primary punisher
Removal of food, water, etc.,
Definition of a conditioned punisher
A contingent consequence that signals a delay reduction to a backup punisher.
Example of a conditioned punisher
Loss of money
Definition of timeout from positive reinforcement
A signaled response-contingent suspension of a positive reinforcement contingency, the effect of which decreases the future probability of problem behavior.
4 guidelines for the effective use of timeout from positive reinforcement
- Provide no more than one verbal warning
- Significantly reduce access to reinforcers.
- End after no more than 5 minutes, even if the child is not sitting quietly.
- Every instance of the problem behavior produces a time out.
Response-cost punishers
Negative punishers that involve the removal or reduction of a reinforcer.
What are the results of the public goods game experiments
Players will reliably punish selfish behavior, and this markedly decreases selfishness.
What effect did punishment have on cooperation?
Punishment increases cooperation
Do players prefer to play with punishment or without punishment?
Players prefer to play with punishment
Knowing that you are being watched has what effect on punishable behavior?
It would decrease it
What are the reinforcers that maintain the behavior of using punishment?
when we see someone cheating, bullying, pulling into our parking space, etc., it makes us angry and we really want to see them get what they deserve. Seeing their behavior get punished functions as a reinforcer.
What is a schedule of reinforcement?
Fixed Ratio, Fixed Interval, Variable Ratio, and Variable Interval
Who discovered the schedule of reinforcement?
B.F skinner
Defining properties of FR
- break and run pattern
- dependent on a specific number of responses
Defining properties of VR
- the number of responses required is unpredictable
- reduce the post-reinforcement pause
Defining properties of FI
- First response after the time elapses.
- 30 seconds needs to elapse and then the first response after that is reinforced,.
- scalloping response pattern
- Let’s say you’re training a dog to sit on command using a fixed interval schedule of reinforcement. Every 5 minutes, you give the dog a treat, regardless of whether or not it has sat when you commanded it to. So, if the dog sits within that 5-minute interval, it still receives a treat at the end of the 5 minutes. If the dog doesn’t sit during that interval, it also receives a treat at the end of the 5 minutes.
Defining properties of VI
- unpredictable (therefore reistant to extinction)
- leads to a fairly constant rate of checking.
- Imagine you are training a rat to press a lever using a variable interval schedule of reinforcement. Each time the rat presses the lever, it receives a food pellet, but the time intervals between each food pellet delivery vary unpredictably. However, on average, the rat receives a food pellet every 3 minutes.
Unique patterns of behavior that are maintained by the four schedules of reinforcement
- Fixed ratio
- Variable ratio
- Fixed interval
- Variable interval
Which schedule of reinforcement is in operation based on a description of everyday behavior?
Variable Interval (VI) schedule.
What happens to the total amount of responses made per day when the price (FR requirement) increases?
- Increased effort
- Decreased Rate of response
- Possible extinction
Which schedule of reinforcement maintains the most behavior and, at high schedule values is preferred over other schedules?
- Variable Ratio (VR) schedule.
What is schedule thinning and why is this technique used?
- Transition the behavior from being reinforced at a high frequency to being reinforced at a lower frequency or intensity while maintaining the behavior itself.
- Promotes Generalization, Increases independence, Sustainable.
