Exam 3: Operant Conditioning Flashcards
Operant Conditioning
A learning process in which behavior is influenced by its consequences.
Reinforcement
A consequence that increases the likelihood of a behavior recurring.
Positive Reinforcement
Adding a pleasant stimulus to increase a behavior.
Negative Reinforcement
Removing an unpleasant stimulus to increase a behavior.
Punishment
A consequence that decreases the likelihood of a behavior recurring.
Positive Punishment
Adding an aversive stimulus to decrease a behavior.
Negative Punishment
Removing a pleasant stimulus to decrease a behavior.
Discriminative Stimulus (SD)
A stimulus that signals the availability of reinforcement.
Stimulus Control
When behavior is influenced by the presence or absence of specific stimuli.
Shaping
Reinforcing successive approximations toward a desired behavior.
Extinction
The process by which a behavior weakens when reinforcement is no longer provided.
Extinction Burst
A temporary increase in the frequency or intensity of a behavior when reinforcement is first removed.
Spontaneous Recovery
The reappearance of an extinguished behavior after a period of non-exposure to the stimulus.
Schedules of Reinforcement
Rules that determine when and how often reinforcement is delivered.
Continuous Reinforcement
Reinforcing a behavior every time it occurs.
Partial Reinforcement
Reinforcing a behavior only some of the time.
Fixed Ratio Schedule
Reinforcement after a set number of responses.
Variable Ratio Schedule
Reinforcement after a variable number of responses.
Fixed Interval Schedule
Reinforcement after a set amount of time and one correct response.
Variable Interval Schedule
Reinforcement after varying amounts of time and one correct response.
Premack Principle
Using a more probable behavior to reinforce a less probable one.
Response Deprivation Hypothesis
A behavior becomes reinforcing when access is restricted below baseline.
Avoidance Behavior
Performing an action to prevent an aversive stimulus.
Escape Behavior
Performing an action to stop an ongoing aversive stimulus.
Two-Process Theory
Avoidance learning involves both classical and operant conditioning.
Stimulus Generalization
Responding similarly to stimuli that resemble the original discriminative stimulus.
Stimulus Discrimination
Responding only to the discriminative stimulus, not to similar stimuli.
Motivating Operations
Factors that change the effectiveness of a reinforcer or punisher.
Primary Reinforcer
A reinforcer that is naturally reinforcing (e.g., food, water).
Secondary Reinforcer
A reinforcer that gains value through association with a primary reinforcer (e.g., money).
Law of Effect
Thorndike’s principle stating that behaviors followed by satisfying consequences are more likely to recur.
Connectionism
Thorndike’s theory that learning involves the formation of connections between stimuli and responses.
Respondent Behaviors
Behaviors that are elicited automatically by a specific stimulus (involuntary).
Contingency
A relationship in which one event depends on the occurrence of another (e.g., reinforcement depends on behavior).
Contiguity
The closeness in time between a behavior and its consequence.
Establishing Operation
A motivating operation that increases the effectiveness of a reinforcer.
Abolishing Operation
A motivating operation that decreases the effectiveness of a reinforcer.
Intrinsic Reinforcement
Reinforcement that comes from engaging in the behavior itself because it is naturally rewarding.
Extrinsic Reinforcement
Reinforcement provided by an external reward or outcome separate from the behavior itself.
Natural Reinforcers
Reinforcers that occur naturally as a consequence of the behavior (e.g., relief, satisfaction).
Contrived Reinforcers
Reinforcers that are deliberately arranged to modify behavior, not naturally occurring.
Fixed Duration (FD) Schedule
Reinforcement is delivered if the behavior occurs continuously for a set period of time.
Variable Duration (VD) Schedule
Reinforcement is given if the behavior occurs continuously for a variable amount of time.
Fixed Time (FT) Schedule
Reinforcement is delivered after a fixed amount of time, regardless of behavior.
Variable Time (VT) Schedule
Reinforcement is delivered after varying amounts of time, regardless of behavior.
Progressive Ratio (PR) Schedule
A schedule in which the number of responses required for reinforcement increases systematically.
Complex Schedules
Schedules that involve combinations of two or more simple reinforcement schedules.
Chained Schedule
A type of complex schedule in which each component must be completed in sequence and is signaled by a unique stimulus.
Differential Reinforcement
Reinforcing some responses but not others, to shape specific behaviors.
Differential Reinforcement of Alternative Behavior
Reinforcing a desirable alternative to an unwanted behavior.
Differential Reinforcement of Other Behavior
Reinforcing the absence of the unwanted behavior during a specific time period.
Differential Reinforcement of Low Rates of Responding
Reinforcing behavior only if it occurs at low rates within a certain time frame.
Differential Reinforcement of Incompatible Behavior
Reinforcing a behavior that cannot occur at the same time as the unwanted behavior.
Differential Reinforcement of High Rates of Responding
Reinforcing high rates of a desired behavior within a given time frame.
Hull’s Drive Reduction Theory
Theory proposing that reinforcers reduce internal biological drives or states of deprivation.
Prompts
A stimulus or cue used to increase the likelihood that a desired behavior will occur.
Fading
The gradual removal of prompts to transfer control to natural stimuli.
Time-outs
A behavioral intervention in which access to reinforcement is removed for a period of time.
Response Cost
A punishment procedure where a reinforcer is taken away following a behavior.
Overcorrection
A punishment procedure requiring effortful behavior to correct the effects of misbehavior.
Partial Reinforcement Effect
The tendency of behaviors reinforced on partial schedules to be more resistant to extinction.
Discrimination Hypothesis
The idea that it is harder to distinguish extinction from partial reinforcement, making behavior more persistent.