Chapter 7 Flashcards
Operant (behavior)
A class of behavior that operates on the environment to produce a common environmental consequence, (eg. pushing a lever in a lever box)
Learning
A change in behavior due to experience.
Operant Learning
A change in a class of behavior as a function of the consequences that followed
Reinforcement
Behavior is Increasing
The occurrence of a particular behavior that is followed by an immediate consequence and results in the strengthening of behavior, (eg. the person is more likely to engage in the behavior again in the future.)
Reinforcement
Behavior is Increasing
The occurrence of a particular behavior that is followed by an immediate consequence and results in the strengthening of behavior, (eg. the person is more likely to engage in the behavior again in the future.)
Positive Reinforcement
The response produces an appetitive(good) stimulus which increases in response rate(behaviour)
Negative Reinforcement
Response eliminates/prevents aversive(bad) stimulus which Increases in response rate
(eg. speeding, removing chances of getting a ticket from not speeding)
Positive Punishment
The response produces an aversive(bad) stimulus which Decreases in response rate
(giving someone something bad will decrease their behavior, eg speeding ticket, timeout)
Negative Punishment
Response eliminates/prevents appetitive(good) stimulus which Decreases in response rate
Aversive Stimulus
An event or stimulus that an organism escapes or avoids
Escape Behavior
When operant behavior increases by removing an ongoing event or stimulus
Avoidance behavior
When operant behavior increases by preventing the onset of the event or stimulus
Unconditional (primary) Reinforcer
A reinforcer that acquired its properties as a function of species evolutionary history. (sleep, sex to pass on genes)
Conditional (secondary) reinforcer
Otherwise neutral stimuli or events that have acquired the ability to reinforce due to a contingent relationship with others are typically unconditional reinforcers. (eg money during an apocalypse)
Immediacy (Contiguity)
A stimulus is more effective as a reinforcer when it is delivered immediately after the behavior, (eg. giving a dog a treat after a trick)
Contingency
A stimulus is more effective as a reinforcer when it is delivered contingent on the behavior (eg. getting chocolates for doing a target behavior)
Motivation Operations
Establishing Operations make a stimulus more effective as a reinforcer at a particular time, (eg. Deprivation, increases the effectiveness of food)
Abolishing Operations make a stimulus less potent as a reinforcer at a particular time.(eg. Satiation, cant consume more food if you don’t want more food)
Individual Differences
Reinforces vary from person to person
Magnitude
Generally, a more intense stimulus is a more effective reinforcer, Not Linear. (eg getting out of a burning building compared to getting out of the hot sun.)
Premack Principles
eating = high probability; lever pressing = low probability. L –> H, reinforces L, and, H–> L does not reinforce H.
Premack Principles
eating = high probability; lever pressing = low probability. L –> H, reinforces L, and, H–> L does not reinforce H.
Premack Principles
eating = high probability; lever pressing = low probability. L –> H, reinforces L, and, H–> L does not reinforce H.
Premack Principles
eating = high probability; lever pressing = low probability.
L –> H, reinforces L
H–> L does not reinforce H.
Continuous Reinforcement
Behavior is reinforced each time it occurs, rate of behavior increases rapidly
Intermittent Reinforcement
4 types,
Fixed ratio
Variable Ratio
Fixed Interval
Variable Interval
Fixed Ratio
Behavior reinforced after a fixed number of times, generates Post-Reinforcement Pause (PRP) which are essentially just steady run rates (eg. paper route must deliver 30 papers in order to get paid)
Variable Ratio
The number of responses needed varies each time,
Variable Ratio Schedule
PRP’s are rare and very short, influenced by the lowest ratio and or the average ratio and produces higher rates than a comparable Fixed-Ratio schedule
(eg. casinos). Creates a breaking point.
Fixed Interval Schedule
Behavior is reinforced when it occurs after a given period of time. Produce PRP’s. Responding gradually producing a scallop shape. (eg. not reinforced with clean clothes until after the cycle is done.)
Variable Interval Schedule
The timing of the response needed varies each time, and intervals vary around the mean. (eg. waiting for bus but its early or late)
Extinction
A behaviour that has been previously reinforced No longer results in the reinforcing consequences And therefore the behaviour stops occurring in the future.
Extinction Burst
Increase in frequency duration and/or intensity of the unreinforced behaviour during the extinction process. (eg. car wont start and you keep trying to start it to gain the reinforcement.)
Spontaneous Recovery
The tendency for extinguished behaviour to occur again in situations similar to those it had been previously reinforced.
Punishment
The occurrence of a particular behavior that is followed by an immediate consequence and that results in the weakening of the behavior (person is less likely to do it in the future.)
Positive Punishment
Adding a stumulus to decrease the behavior (eg. spanking)
Negative Punishment
Removing a stimulus to decrease behavior (eg. taking drivers licence away for DUI)
Premack for Punishment
Low probability behavior punishes high probability behavior, (eg. Coffee (high prob) –> Piano (low prob) = decrease coffee>)
Contingency in Punishment
The degree of correlation between a behavior and its consequence
Contiguity in Punishment
Nearness of events in time (temporal contiguity) or space (spatial contiguity)
Contiguity in Punishment
Nearness of events in time (temporal contiguity) or space (spatial contiguity)
Intensity for Punishment
The more intense the punisher is in terms of magnitude the more effective it typically is.
Escape and Avoidance
Punishment can induce escape and avoidance behaviors (eg. hiding lying cheating)
Classical Conditioning
Process of learning, learning to associate two stimuli.
Unconditional (Unlearned) Relfex
The natural response, (eg. Natural salivating to food or blinking when something in eye).
Conditional Reflex
Neutral stimulus becomes condtion stimulus and leads to learned condition response of salvation, (eg. a bell rang simulates food for dog.)
Amount of Exposure to the Contingencies
(Number of parings). In general, more exposure = greater conditional responding. Early exposure produces more learning than later exposure.
Conditional responding is asymptotic
Conditioning can occur at a different rate
Intertrial Interval
Interval between one CS-US exposure (a trial) and another CS-US exposure(a different trial)
Age
Degenerative/health effects of aging and learning history.
Conditioned Emotional Responses
An emotional response to a stimulus that is acquired through Respondent Conditioning. (eg lil alberto)
