chapter test 5 6 & 7 Flashcards
Behavior causation
ultimate causes
(evolutionary history); (learning history)
proximate causes
(current stimuli) ; (CNS)
Proximate causes
close in time to behavior (stimulus)
ultimate causes
distant in time
(learning history)
two types of learning histories
pavlovian conditioning
operant conditioning
learning
relatively permanent changes in environment behavior relations to certain types of experiences.
classical conditioning is….
the conditioning of reflexes
two (or more) stimuli are paired
NS—–association— + –> UR
Any behavior that is followed by pleasant is likely to be repeated, and any behavior followed by unpleasant consequences is likely to be stopped
the law of Effect (Thorndike’s Law)
The Law of Effect
Behavior is determines its consequences
Thorndikes experiment is can be regarded as a….
discrete trials
trial & error vs trial & success
B.F Skinner
Operant conditioning
free operant experiment—-measuring behavior over time in restricted environment
two term contingency operant conditioning
R——————–S
Response——–Stimulus (consequence)
operant behavior
operates on the environment, changes the environment, and is changed as a result of the environment
environment
all stimuli that affect behavior at any given moment
a stimulus that follows a response and increases the probability of similar responses under similar circumstances
reinforcement procedure and process
reinforcement (procedure and process)
a stimulus change follows a response and increases the probability of similar responses under similar circumstances
the procedure of reinforcement…
Stimulus change follows a response
the process of reinforcement
increases the probability of similar responses under similar circumstances
one instance of behavior
response
response
one instance of behavior
increases the probability (rate or frequency, duration, magnitude etc), of similar responses (response class)
reinforcement process
the reinforcer is added after the response (+)
positive reinforcement
reinforcer is subtracted after the response (-)
negative reinforcement
three characteristics to be called reinforcement
the behavior must be a consequence
the behavior must increase in strength
the consequence must be the reason it increases in strength
negative reinforcement is also called…
escape learning
avoidance learning
when the aversive stimulus is present and you do something to get rid of it
escape learning
when the aversive stimulus is not present yet, and you do something to avoid it
avoidance learning
operant conditioning association example chart
Kids Behavior
S(d)—-R——–S(R+)
parent’s behavior
EO/S(d)——-R—–S(R-)
response dimension that can be reinforced
response rate (# of responses over time)
response magnitude (or intensity)
response duration (how long the response lasts)
response topography (form)
latency - the time a stimulus is presented and a total response occurs
reinforce randomness/variability/creativity of response (responding differently each time)
terminology
reinforcement vs. reinforcer vs. reward
the actual consequence
–in positive reinforcement was added
–in negative reinforcement what is subtracted
reinforcer
something to give to someone for a job well done
reward
Unconditioned (primary) reinforcers
food
water
sexual arousal
sleep
warmth/coolth
pain removal
control of environment
sensory stimulation
some_______reinforcers lose their effectiveness temporarily through_______
unconditioned
satiation
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
3 practical advantages of conditioned (or generalized) reinforcers
satiation doesn’t occur
easier to reinforce immediately
less disruptive than primary reinforcers
events that naturally follow a response
are usually not deliberately mediated by other individuals
automatic reinforcers
variables that affect operant conditioning
contingency
temporal contiguity
reinforcer magnitude
motivating operations
all things equal, the greater the _____________between responses and their consequences, the quicker and stronger the conditioning
contingency
temporal contiguity
all things equal, the greater ___________, the quicker and stronger the conditioning (reinforcer characteristics)
reinforcer magnitude
all things equal, the lower the ____________, the quicker and stronger the conditioning (behavior characteristics)
response effort
operates on the environment, changes the environment, and is changed as a result
operant behavior
reinforcer
increases the probability of similar responses under similar circumstances
reinforcement
a stimulus change following a response with a consequence that results in an increase in the probability of similar responses under similar circumstances
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
_______ is an equal opportunity consequence
reinforcement
motivating operations
establishing operations
–alter the effectiveness of a reinforcer
—evoke behavior that has produced that reinforcer
3 term contingency motivating operations
EO—-R—–S(R+)
EO—-R—–S(R-)
(EO) Establishing operations
alter the effectiveness of a reinforcer
evoke behavior that has produced that reinforcer
motivating operations
high probability behaviors reinforce low probability behaviors
Premacks’ Principle
considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors.
Premack’s relative value theory
when deprived from engaging in a behavior below the baseline, engaging in it back to baseline becomes reinforcing to other behaviors
response-deprivation theory
selection by consequences
behavior like species evolves
reinforcement is like natural selection
Behavior evolves over time
behavior is inherently variable
Environment selects behavior
Behavior retention
a procedure
the differential reinforcement of successive approximation towards a final or target behavior
shaping
shaping:
the differential reinforcement of (2 words)__________ towards or target behavior
successive approximation
events that follow spontaneously from a behavior.
Natural reinforcers
events that are provided by someone for the purpose of modifying behavior.
Contrived reinforcers
the degree of correlation between a behavior and its consequence
Contingency
A term used to refer to the strength of a reinforced behavior.
Behavioral momentum
the gap in time between a behavior and its reinforcing consequence
Temporal contiguity
anything that changes the effectiveness of a con- sequence
Motivating operation
The reward center of the brain, in particular, an area in the septal region running from the middle of the brain to the frontal cortex where dopamine is the most important neurotransmitter
Reward pathway/dopamine
attributes a reinforcer’s effectiveness to the reduction of a drive.
Hull’s drive reduction theory
High-probability behavior reinforces low-probability behavior.
Premack principle
behavior becomes reinforcing when the individual is prevented from engaging in the behavior at its normal frequency.
Response deprivation theory
the reinforcement of successive approximations of a target (desired) behavior
Shaping
the process of reinforcing each of a series of related behaviors to form a behavior chain
Chaining
procedure of breaking a task down into its component elements
Task analysis
begin chaining by reinforcing performance of the first link in the chain
Forward chaining
begin chaining with the last link in the chain and work backward toward the first component (link)
Backward chaining
A series of related behaviors, the last of which produces reinforcement
Behavior chain –
a situation in which reinforcement is available but the behavior necessary to produce it is not
Problem
the response that produces reinforcement
solution
a sudden appearance of the solution (in the mind?)
Insight
novelty
Common feature (of creativity)
Common feature (of creativity)
novelty
any behavior that occurs repeatedly even though it does not produce the reinforcers that maintain it
Superstitious behavior
The tendency to give up on a problem as a result of previous exposure to insoluble problems
Learned helplessness
The tendency to persist at a problem as a result of previous reinforcement of persistence at difficult problems
Learned industriousness
a procedure in which a sequence of responses that make up a more complex chain is reinforced
chaining
a series of responses that occur consecutively
behavior chain
Behavior chain example chart
conditioned reinforcement S(D)——R—->S(r+)
Unconditioned reinforcement
S(D)——-R——–S(R+)
Chaining
- construct a task analysis (TA): breakdown all steps of behavior chain
- reinforce one response in the chain at a time until it occurs, then reinforce when two responses occur, then when three
Two chaining procedures
—forward chaining
—backward chaining
when there is a reinforcer available but no behavior available to produce the reinforcer
problem
the response that produces the reinforcement
solution
the use of imaginations or orignal ideas
reification–making something abstract concrete or real
creativity
randomness (a dimension of behavior)–can be reinforced
novelty
based on the definition of (reinforcement),
why does it seem absurd that reinforcement can increase novel behavior?
similarity is random
as acquisition of behavior
Most people use the term learning
changes in which no new behavior occurs
changes in the pattern of behavior
Learning includes
rules describing the contingency between behavior and reinforcement
Schedule of reinforcement
distinctive patterns of behavior (produced by different schedules)
Schedule effects
a behavior is reinforced every time it occurs (or every response produces a reinforcer)
Continuous schedule (of reinforcement
reinforcement occurs for some responses but not others.
Intermittent schedule
Four simple schedules of reinforcement
FR - Fixed Ratio
VR - variable ratio
FI - Fixed interval
VI - variable interval
reinforcement occurs after a set (or fixed) number of responses.
Fixed ratio
reinforcement occurs after an average number of responses
Variable ratio
reinforcement occurs after the first response after a set (or fixed) amount of time.
Fixed interval
a pause after reinforcement
Post-reinforcement pause
reinforcement occurs after the first response after an average amount of time.
Variable interval
the rate at which behavior occurs once it has resumed following reinforcement
Run rate
reinforcement is withheld from a previously reinforced behavior (or a schedule which no responses are reinforced)
Extinction
a sudden increase in the response dimensions of a behavior when reinforcement is withheld
Extinction burst –
the reappearance of previously reinforced behavior
Resurgence
the sudden reappearance of behavior following extinction and a period of time
Spontaneous recovery
other simple schedules
FT - fixed time
VT - variable time
FD - fixed duration
VD - variable duration
progressive ratio schedule
break point
reinforcement is delivered after a fixed amount of time regardless of what behavior occurs
fixed time
reinforcement is delivered after an average amount of time regardless of what behavior occurs
Variable time
reinforcement is contingent on the continuous performance of a behavior for a fixed period of time
Fixed duration
reinforcement is contingent on the continuous performance of a behavior for an average period of time
Variable duration
the requirement for reinforcement increases in a predetermined way following each reinforcer
Progressive ratio schedule –
the point which behavior stops on a progressive schedule
Break point
the procedure of gradually increasing the number of responses required to reinforcement
Stretching the ratio
the disruption of the pattern of responding due to stretching the ratio too abruptly
Ratio strain
6 types of complex schedules
multiple schedules
mixed schedules
chain schedule
tandem schedule
cooperative schedule
concurrent schedule
two or more simple schedules alternate each associated with a particular stimulus
Multiple schedule
two or more simple schedules alternate with neither associated with a particular stimulus
Mixed schedule
reinforcement is delivered contingent on the completion of the last in a series of schedules each associated with a different stimulus
Chain schedule
Reinforcement is contingent on the completion of a last in a series of schedules none of which is associated with a particular stimulus
Tandem schedule
reinforcement is dependent on the behavior of two or more individuals
Cooperative schedule
two or more schedules are available simultaneously
Concurrent schedule
the tendency of behavior to be more resistant to extinction following intermittent reinforcement than continuous reinforcemen
Partial reinforcement effect
the principle that the rate of responding on two or more reinforcement schedules will match the rate of reinforcement on each schedule
Matching law –
the rules describing the contingencies change systematically
progressive schedules
schedules in which the requirement for reinforcement increases in a predetermined way
progressive ratio schedule
the rate of responding (# response/times)
the pattern of responding
schedule effects
five schedules of reinforcment
Continuous schedule
1.CRF (FR1) - continuous reinforcement
Intermittent schedules
2. FR - fixed ration
3. VR - variable ratio
interval schedules
4. FI - fixed interval
5. VI - variable interval
leads to fast aquisition of response
high response rate
good to use when shaping/teaching new behavior
CRF characteristics
CRF is the same as….
FR- 1 (fixed ratio of 1)
a fixed or set number of response is reinforced
fixed ratio
the two effects of schedules that we are going to look at…
rate and pattern of responding
characteristics of FR schedules
high response rate
–overall rate
–run rate
break and run pattern of responding
break and run =…..
pause and respond
why is there a pause____
there is a relationship to amount of effort and the lenght of the pause
pre-ratio pause
post reinforcement pause
the rate of response which includes the pauses -r/t
overall rate
the rate minus the pauses -r/t-prp
run rate
an average number of responses is reinforced
variable ratio
total responses divided by number of total reinforcers, (or)
sum of individual FR values divided by the total FR schedules
VR - variable ratio
characteristics of VR schedules
high, steady response rate
no PRP, except when there is no low FR in the series
high, steady response rate
no PRP, except when there is a low FR in the series
characteristics of VR schedules
generates persistent behavior
VR Schedules
the first response that occurs after a specific interval produces reinforcement
FI - fixed interval schedules
After every minute minute, the first response is reinforced
FI - 1 min
Moderately high response rate
A scalloped shaped curve pattern
FI - characteristics
FI - characteristics
Moderately high response rate
Scallop-shape curve pattern
the number of response over time
rate
the first response after an average amount of time produces reinforcement
VI - variable interval
characteristics of VI - variable interval schedule
low, steady rate of responding
consistent responding with few or very short pauses
VR schedule examples
sales person working on commission
gambling
pick up lines
applying for jobs
VI - variable interval real-life examples
refreshing your new social media app
checking emails
fishing
FR schedule real life examples
assemble 10 beams for fence and your done for the day and get paid
passcode on phone: FR 4/6 for 4/6 code password an so on
a schedule in which 0 reinforcers are delivered for responding
a schedule in which no response produces a reinforcer
witholding ____________( from a previously_________ behavior
extinction
reinforcement
reinforced
extinction Burts
decrease in the probability of similar responses under similar circumstances
extinction effects
momentary (immediate) increase in..
response rate
magnitude
duration
variability - shaping
emotional responding
extinction burst characteristics
the _______ of extinction depends on the _________ of reinforcement for the ___________ behavior
rate
history
extinguished
the rate of extinction depenents on the history of reinforcement for the extinguished behavior
frequency of reinforcement
magnitude of reinforcement
response effort
schedule of reinforcement
extinction will proceed faster if….
the frequency and magnitude of reinforcement and a response effort are low, and the schedulee is a CRF
behavior on an intermitten schedule is more diffiuclt to extinguishe than one on CRF
PRE - partial reinforcement extinction effect
response-independent schedules
FT - fixed time schedule
VT - variable time schedule
stimulus that has been shown to be a reinforcer is delivered after a fixed amount of time
Fixed time (FT)
A stimulus that has been shown to be a reinforcer is delivered after an average amount of time
Variable time
Two or more simple schedules are combined.
Compound Schedules
Two or more simple schedules, each associated with a different stimulus, are completed sequentially
Chain Schedule
Two or more simple schedules, not associated with different stimuli, are completed sequentially.
Tandem schedule
Spontaneous_____ after ________ and a period of _________, the extinguished behavior__________ under similar circumstances
recovery
extinction
time
recovers
gradually increasing the number of responses required for reinforcement (shaping response rate)
stretching the ratio
rapid increase in the response requirement
ratio strain
