Chapter 6: Operant Conditioning - Introduction Flashcards
Operant Behaviors
Behaviors that are influenced by their consequences.
Operant Conditioning
A type of learning in which the future probability of a behavior is affected by it’s consequences.
Operant Conditioning is also known as…
Instrumental conditioning, because the response is instrumental in producing the consequence.
Who founded the “Law of Effect”?
Edwin L. Thorndlike
What is the “Law of Effect”?
The law of effect indicates that behavior leading to a satisfying state of affairs are strengthened, while unsatisfying state of affairs are weakened.
According to Thorndlike and his Law of Effect, behaviors that worked were…
stamped in.
According to Thorndlike and his Law of Effect, behaviors that did not work were…
stamped out.
How does Skinner’s theory of operant conditioning compare to evolution?
In evolution, genes are passed down to future generations if the the organism determines the genetic trait will help the organism live longer. In operant conditioning, favorable behaviors will continue and unfavorable behaviors will not.
“Free Operant” Procedure
Subjects feely responds with a particular behavior for consequences and may do so at any rate.
Operant behaviors are influenced by their _________
consequences
Elicited behavior is a function of what (precedes/follows) it; operant behavior is a function of what (precedes/follows) it.
precedes
follows
Respondent behavior is ________ in nature and controlled by ____.
involuntary
stimuli
Operant behavior is _______ in nature and controlled by _____.
voluntary
consequences
Who founded the Free Operant procedure?
B. F. Skinner
What are the components of operant conditioning?
- A response the produces a certain consequence.
- A consequence that serves to either increase or decrease the probability of a response that preceded it.
- A discriminative stimulus that precedes the response and signals that a certain consequence is now available.
Why is operant behavior defined as a class of responses and what does that mean?
Operant behaviors are not defined by specific responses, rather, operant behaviors are defined by all responses that are effective in reaching the consequence.
A rat can press a lever many times to get food; operant behavior does not determine how much pressure or which paw triggers the lever.
Classically conditioned behaviors are _____ by stimulus, where as operant behaviors are ____ by organisms.
elicited
emitted
What is the difference between Thorndlike’s Law of Effect compared to Skinner’s Operant Conditioning?
Skinner’s concept of operant conditioning avoid the speculation of internal state of affairs. Rather, Skinner emphasizes the effect of the consequence on the future probability of the behavior increasing or decreasing.
Operant responses are also called…
operants
What is a reinforcer?
A reinforcer is a consequence that strengthens a behavior.
What is a punisher?
A punisher is a consequence that weakens a behavior.
A reinforcer (follows/precedes) a behavior and (increases/decreases) the future probability of that behavior.
follows
increases
A punisher (follows/precedes) a behavior and (increases/decreases) the future probability of that behavior.
follows
decreases
What is the abbreviation for reinforcer?
S^r
Which means reinforcing stimulus
What is the abbreviation for punisher?
S^p
Which means punishing stimulus
Are animals and humans reinforced or punished, or are there behaviors?
The BEHAVIOR of animals and humans are reinforced/punished.
What is the difference between reinforcer/punisher and reinforcement/punishment?
Reinforcers and punishers are the specific consequence used to strengthen or weaken a behavior.
Reinforcement and punishment refer to the process/procedure by which a certain consequence changes the behavior.
Reinforcers and punishers are defined by their _____ on behavior.
effect
What is the importance of defining a consequence by their effect on behavior?
The definition of pleasant and unpleasant can vary for each subject. A punisher for one subject can be a reinforcer for a different subject.
What is extinction in regards to operant conditioning?
Extinction is the weakening of a behavior through non-reinforcement of a previously reinforced behavior.
_____ tends to be (fast/slow) compared to punishment.
Extinction
slow
Discriminative Stimulus
A stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced.
What is the abbreviation for discriminative stimulus?
S^d
Discriminative stimuli is said to “_____ the _______” for the behavior, meaning that it’s presence makes the behavior (more/less) likely.
Set the occasion
more
What is the three-term contingency?
Discriminative stimulus + Operant behavior + Consequences
What is the A-B-C sequence of the three-term contingency?
Antecedent - Behavior - Consequence
Another way to think about the three-term contingency is to ______ something, ______ something, and ______ something.
notice
do
get
Discriminative Stimulus for Punishment (S^dp)
A stimulus that signals that a response will be punished.
Discriminative Stimulus for Extinction (S^delta)
A stimulus that signals the absence of reinforcement.
What are the similarities between operant and classical conditioning?
Operant conditioning and classical conditioning can overlap that a particular stimulus can act as both a discriminative stimulus and a conditioned stimulus.
What is the conditioning sequence for classical conditioning?
Stimulus-stimulus-response (SSR)
What is the conditioning sequence for operant conditioning?
Stimulus-response-stimulus (SRS)
What are the four types of contingencies?
- Positive Reinforcement
- Negative Reinforcement
- Positive Punishment
- Negative Punishment
What does the term “positive” regard when paired with reinforcement or punishment?
Positive indicates when something has been added or presented.
Pleasant example - Receiving a compliment
Unpleasant example - Being yelled at
What does the term “negative” regard when paired with reinforcement or punishment?
Negative indicates when something has been removed.
Pleasant example - Dessert is taken away
Unpleasant example - Person stops yelling
Positive Reinforcement
Presentation of a stimulus following a response, which then leads to an increase in the future strength of that response.
Negative Reinfocement
Removal of a stimulus following a response, which then leads to a decrease in the future strength of that response.
What is an example of escape behavior?
Turning the heat off when you get too hot
What is an example of avoidance behavior?
Using an umbrella before it starts to rain.
Escape Behavior
The termination (stopping) of an aversive stimulus.
Avoidance Behavior
Occurs before the aversive stimulus is presented and prevents it’s delivery.
Positive Punishment
Presentation of a stimulus following a response, which leads to a decrease in the future strength of that response.
Negative Punishment
Removal of a stimulus following a response, which leads to a decrease in the future strength of that response.
The more (immediate/delayed) the reinforcer, the stronger it’s effects on the behavior.
immediate
Define this behavior contingency.
Molly loses her glasses while playing at the park. Her parents spank her for being careless. Molly is less likely to lose her glasses in the future.
Positive punishment
Define this contingency.
When getting a shot at the doctor’s office, Sean is asked to stay still. After staying still for the shot, Sean is given a lollipop for good behavior. Sean will most likely stay still for shoots in the future.
Positive reinforcement
Define this contingency. A teacher tells her bored class that if everyone participates during the discussion, she will let them out early for recess. The children happily participate in order to get out of the boring class early.
Negative reinforcement
Define this contingency.
Jessica used to tease Gabrielle, making her cry. Lately Gabrielle has not been affected by Jessica’s teasing and she no longer responds with tears. Jessica is less likely to tease Gabrielle in the future.
Extinction
Define this contingency.
Mitch plays roller hockey in front of his neighbor’s house. In a goal attempt, his hockey puck breaks the neighbor’s window. His father yells at him and demands that he take on an afterschool job to earn the money to replace the neighbor’s window. Mitch is less likely to play hockey in front of the neighbor’s house in the future.
Negative punishment
The effectiveness of delayed reinforcers in humans largely depends on _____ or ________ to bridge the gap between the behavior and the delay.
rules
instructions
It has been suggested that delayed reinforcers (do/do not) function in the same manner as immediate reinforcers.
do not
Primary Reinforcer (aka Unconditioned Reinforcer)
An event that is innately reinforcing.
Born to like; i.e. food, water, etc.
Secondary Reinforcer (aka Conditioned Reinforcer)
An event that is reinforcing because it has been associated with some other reinforcer.
Learn to like; fine clothes, nice car, etc.
A (CS/US) that has been associated with an appetitive (CS/US) can serve as a secondary reinforcer for an operant response. As well, a stimulus that serves as a(n) _________ for an operant response can also serve as a secondary reinforcer for some other response.
CS
US
discriminative
Intrinsic Reinforcement
Reinforcement provided by the mere act of performing the behavior.
Extrinsic Reinforcement
Reinforcement provided by some consequence that is external to the behavior.
In what ways can an external rewards negatively impact intrinsic motivation?
The the reward is expected, tangible and given for performance rather than quality.
Natural Reinforcers
An expected consequence of the behavior such as money from selling something or the light turning on after flipping a switch.
Contrived (or Artificial) Reinforcers
Reinforcers that have been deliberately arranged to modify a behavior.
In applied behavior analysis, although one might initially use (contrived/natural) consequences to first develop a behavior, the hope is that the behavior will become “trapped” by the ________ consequences associated with that behavior.
contrived
natural
What is shaping?
Shaping is the gradual creation of new behavior through reinforcement of successive approximation to the ideal behavior.
