Final Flashcards
A type of learning in which the future frequency of a behaviour is
affected by its consequences
Operant conditioning
Behaviours that are motivated by their consequences
Operant behaviours
In classical conditioning, responses are elicited by —. In operant conditioning, responses are maintained by —
Antecedent stimuli, consequences
Who was the first to study operant conditioning?
Edward Thorndike
Explain Thorndike’s law of effect
Behaviours change as a result of consequences: A response followed by a pleasant consequence (satisfier) will tend to be repeated, a response followed by an unpleasant consequence (annoyer) will tend to decrease in frequency
Controlled by antecedent stimuli
Respondent behaviour
Controlled and selected by consequences after the behavior
Operant behaviour
A response that produces a consequence
Operant response (R)
A consequence that serves to increase or decrease the frequency of the response
Operant consequence (S^R/P)
Consequences that strengthen behaviours
Reinforcers
Consequences that weaken behaviours
Punishers
In the context of operant conditioning, what does strength refer to?
The probability/frequency of responses
The process by which a consequence strengthens a behaviour
Reinforcement
The process by which a consequence weakens a behaviour
Punishment
Stimulus in the presence of which responses are reinforced and in the absence of which responses are not reinforced
Discriminative stimulus/operant antecedent (S^D)
What is the three-term contingency?
Antecedent event (S^D): Behaviour (R) -> Consequence (S^R/P)
Weakening of a behaviour through non-reinforcement of a previously reinforced behaviour
Extinction
Name a pro and a con for extinction
Gentler than punishment, slower to condition
Name and describe the four types of contingencies
Positive reinforcement (S^R+): The presentation of an appetitive stimulus following a response (increase in strength)
Negative reinforcement (S^R-): The removal of an aversive stimulus following a response (increase in strength)
Positive punishment (S^P+): The presentation of an aversive stimulus (decrease in strength)
Negative punishment (S^P-): The removal of an appetitive stimulus following a response (decrease in strength)
Stimulus that signals the absence of reinforcement
Discriminative stimulus for extinction (S^Δ)
Reinforcement inherent to performing the behaviour
Intrinsic reinforcement
Reinforcement by a consequence that is external to the behaviour
Extrinsic reinforcement
Gradual creation of new behavior through reinforcement of successive approximations to that behaviour
Shaping
The response required to obtain reinforcement
Schedules of reinforcement
Stable response patterns that emerge after considerable
exposure to a schedule
Steady-state behaviours
Each specified response is reinforced
Continuous reinforcement schedule (CRF)
What are continuous reinforcement schedules best for?
Strengthening a newly learned behavior
Only some responses are reinforced
Intermittent schedule
Name the four main types of intermittent schedules
Fixed ratio
Variable ratio
Fixed interval
Variable interval
Reinforcement is contingent on a fixed, predictable number of responses
Fixed ratio (FR)
Describe the typical rate of response for a fixed rate schedule
Generally produces high rate of response with a “post-reinforcement pause” after each reinforcer
Schedule has a very low response requirement
Rich/dense schedule
Very high response requirement
Lean schedule
Increasing the response requirement from a very rich schedule to a very lean schedule
Stretching the ratio
Breakdowns in behavior due to increasing response requirement too quickly or too high
Ratio strain
Reinforcement is contingent upon varying, unpredictable number of responses
Variable ratio (VR)
Reinforcement is contingent upon the first response after a fixed, predictable time period
Fixed interval (FI)
Reinforcement contingent upon the first response after a varying, unpredictable time period
Variable interval (VI)
Reinforcement is contingent on performing the behaviour continuously
Duration schedule
Behavior must be performed continuously for a fixed, predictable period of time
Fixed duration (FD)
Behavior must be performed continuously for a varying, unpredictable period of time
Variable duration (VD)
Reinforcement is directly contingent on the rate of response
Response-rate schedules
Reinforcement contingent upon emitting at least a certain number of responses in a certain period of time
Differential reinforcement of high rates (DRH)
Minimum amount of time must pass between each response before the reinforcer is delivered
Differential reinforcement of low rates (DRL)
Reinforcement contingent upon emitting a series of responses at a steady rate
Differential reinforcement of paced responding
Reinforcer delivered independently of a response
Noncontingent schedules (response independent schedules)
Reinforcer is delivered after fixed, predictable period of time, regardless of one’s behavior.
Fixed time (FT) schedule
Reinforcer is delivered following varying, unpredictable period of time, regardless of one’s behavior.
Variable time (VT) schedule
Combination of two or more simple schedules
Complex schedules
Requirements of 2+ simple schedules must be met before a reinforcer is delivered
Conjunctive schedule
Response requirement changes as a function of performance while responding for previous reinforcer
Adjusting schedule
Sequence of 2+ simple schedules, each of which has its own S^D
and ending with a final reinforcer
Chained schedule
Increase in strength and/or efficiency of responding as one draws near goal
Goal-gradient effect
Responding on a chained schedule established by training the final link first and the initial link last (in animals)
Backward chaining
How are response chains usually established in humans?
Instructions
Explain drive reduction theory
All reinforcers are associated (directly or indirectly) with some type of drive reduction
An event is reinforcing to the extent that it is associated with a reduction in some type of physiological drive
Describe the criticisms of drive reduction theory
Not all reinforcers are associated with drive reduction
Incentive motivation: Derived from some property of the reinforcer as opposed to an internal drive state
Explain the Premack principle
High-probability behavior (HPB) can be used to reinforce low-probability behavior (LPB)
Reinforcement consists of a sequence of 2 behaviours: The behaviour that is being reinforced, and the behaviour that is the reinforcer (reinforcers are viewed as behaviors rather than stimuli)
Explain the response deprivation hypothesis
A behaviour can serve as a reinforcer when access to that behaviour is restricted or its frequency falls (or is in danger of falling) below its preferred level of occurrence
Baseline level of occurrence when an organism can freely engage in the activity
Preferred level of occurence
Explain the behavioural bliss approach
An organism with free access to alternative activities will distribute its behaviour in such a way as to maximize overall reinforcement
Optimal distribution of activities
Behavioural bliss point
A decrease in the strength response due to nonreinforcement of a previously reinforced response
Extinction
List the three common side effects of extinction
Extinction burst
Increase in variability
Emotional behaviour (extinction-induced aggression, depressive symptoms)
Temporary increase in frequency and intensity of responding when extinction is first implemented
Extinction burst
Reappearance during extinction of other behaviors that had once been effective in obtaining reinforcement
Resurgence
Why is consistency important for extinction?
Behaviours can be strengthened if reinforcement is suddenly given during extinction
Extent to which responding persists after an extinction procedure has been implemented
Resistance to extinction
List the four factors affecting resistance to extinction
Schedule of reinforcement
Degree of deprivation
Previous experience with extinction
Discriminative stimulus
Describe the partial reinforcement effect
Behavior maintained on intermittent (partial) reinforcement schedule will extinguish more slowly than behavior maintained on continuous schedule
How does history of reinforcement impact extinction?
More reinforcers received = greater resistance to extinction
How does the magnitude of the reinforcer impact extinction?
Large reinforcers often result in greater resistance to extinction
How does the degree of deprivation impact extinction?
The greater the level of deprivation for the reinforcer, the greater the resistance to extinction
How does previous experience impact extinction?
The greater the number of previous exposures to extinction, the quicker extinction will occur
How does the discriminative stimulus impact extinction?
Extinction occurs more quickly when there is a distinctive stimulus that signals the onset of extinction
The reappearance of an extinguished response, despite the continued absence of reinforcement following a rest period of extinction
Spontaneous recovery
Reinforcement of any behavior other than the target behavior that is being extinguished.
Differential reinforcement of other behaviour (DRO)
Concerning differential reinforcement of other behaviour (DRO), what is the target behaviour weakened by?
Both the non-reinforcement of unwanted behaviour and the reinforcement of the alternative behaviour
A stimulus in the presence of which responses are reinforced and in the absence of which responses are not reinforced
Discriminative stimulus
When the presence of discriminative stimulus reliably affects probability of a behavior
Stimulus control
Tendency for an operant response to be emitted in the presence of a stimulus that is similar to an SD
Stimulus generalization
With stimulus generalization, the more similar the stimulus…
The stronger the response
Describes the strength of responding in the presence of stimuli that are similar to the SD and that vary along a continuum
Generalization gradient
Tendency for an operant response to be emitted more in the presence of one stimulus than another
Stimulus discrimination
Describe the relationship between stimulus generalization and discrimination
Less generalization = strong discrimination
More generalization = weak discrimination
Reinforcement of responding in the presence of SD and not in the presence of another stimulus
Discrimination training
Describe the peak shift effect
Following discrimination training, the peak of the generalization will often shift from the SD to a stimulus further removed from the discriminative stimulus for extinction (S∆)