chapter test 5 6 & 7 Flashcards
Behavior causation
ultimate causes
(evolutionary history); (learning history)
proximate causes
(current stimuli) ; (CNS)
Proximate causes
close in time to behavior (stimulus)
ultimate causes
distant in time
(learning history)
two types of learning histories
pavlovian conditioning
operant conditioning
learning
relatively permanent changes in environment behavior relations to certain types of experiences.
classical conditioning is….
the conditioning of reflexes
two (or more) stimuli are paired
NS—–association— + –> UR
Any behavior that is followed by pleasant is likely to be repeated, and any behavior followed by unpleasant consequences is likely to be stopped
the law of Effect (Thorndike’s Law)
The Law of Effect
Behavior is determines its consequences
Thorndikes experiment is can be regarded as a….
discrete trials
trial & error vs trial & success
B.F Skinner
Operant conditioning
free operant experiment—-measuring behavior over time in restricted environment
two term contingency operant conditioning
R——————–S
Response——–Stimulus (consequence)
operant behavior
operates on the environment, changes the environment, and is changed as a result of the environment
environment
all stimuli that affect behavior at any given moment
a stimulus that follows a response and increases the probability of similar responses under similar circumstances
reinforcement procedure and process
reinforcement (procedure and process)
a stimulus change follows a response and increases the probability of similar responses under similar circumstances
the procedure of reinforcement…
Stimulus change follows a response
the process of reinforcement
increases the probability of similar responses under similar circumstances
one instance of behavior
response
response
one instance of behavior
increases the probability (rate or frequency, duration, magnitude etc), of similar responses (response class)
reinforcement process
the reinforcer is added after the response (+)
positive reinforcement
reinforcer is subtracted after the response (-)
negative reinforcement
three characteristics to be called reinforcement
the behavior must be a consequence
the behavior must increase in strength
the consequence must be the reason it increases in strength
negative reinforcement is also called…
escape learning
avoidance learning
when the aversive stimulus is present and you do something to get rid of it
escape learning
when the aversive stimulus is not present yet, and you do something to avoid it
avoidance learning
operant conditioning association example chart
Kids Behavior
S(d)—-R——–S(R+)
parent’s behavior
EO/S(d)——-R—–S(R-)
response dimension that can be reinforced
response rate (# of responses over time)
response magnitude (or intensity)
response duration (how long the response lasts)
response topography (form)
latency - the time a stimulus is presented and a total response occurs
reinforce randomness/variability/creativity of response (responding differently each time)
terminology
reinforcement vs. reinforcer vs. reward
the actual consequence
–in positive reinforcement was added
–in negative reinforcement what is subtracted
reinforcer
something to give to someone for a job well done
reward
Unconditioned (primary) reinforcers
food
water
sexual arousal
sleep
warmth/coolth
pain removal
control of environment
sensory stimulation
some_______reinforcers lose their effectiveness temporarily through_______
unconditioned
satiation
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
3 practical advantages of conditioned (or generalized) reinforcers
satiation doesn’t occur
easier to reinforce immediately
less disruptive than primary reinforcers
events that naturally follow a response
are usually not deliberately mediated by other individuals
automatic reinforcers
variables that affect operant conditioning
contingency
temporal contiguity
reinforcer magnitude
motivating operations
all things equal, the greater the _____________between responses and their consequences, the quicker and stronger the conditioning
contingency
temporal contiguity
all things equal, the greater ___________, the quicker and stronger the conditioning (reinforcer characteristics)
reinforcer magnitude
all things equal, the lower the ____________, the quicker and stronger the conditioning (behavior characteristics)
response effort
operates on the environment, changes the environment, and is changed as a result
operant behavior
reinforcer
increases the probability of similar responses under similar circumstances
reinforcement
a stimulus change following a response with a consequence that results in an increase in the probability of similar responses under similar circumstances
Conditioned reinforcers- Depends on pairing with primary reinforcers
generalized conditioned reinforcers - depend on pairing with many other reinforcers.
conditioned (secondary) reinforcers vs generalized conditioned reinforcers
_______ is an equal opportunity consequence
reinforcement
motivating operations
establishing operations
–alter the effectiveness of a reinforcer
—evoke behavior that has produced that reinforcer
3 term contingency motivating operations
EO—-R—–S(R+)
EO—-R—–S(R-)
(EO) Establishing operations
alter the effectiveness of a reinforcer
evoke behavior that has produced that reinforcer
motivating operations
high probability behaviors reinforce low probability behaviors
Premacks’ Principle
considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors.
Premack’s relative value theory
when deprived from engaging in a behavior below the baseline, engaging in it back to baseline becomes reinforcing to other behaviors
response-deprivation theory
selection by consequences
behavior like species evolves
reinforcement is like natural selection
Behavior evolves over time
behavior is inherently variable
Environment selects behavior
Behavior retention
a procedure
the differential reinforcement of successive approximation towards a final or target behavior
shaping
shaping:
the differential reinforcement of (2 words)__________ towards or target behavior
successive approximation
events that follow spontaneously from a behavior.
Natural reinforcers
events that are provided by someone for the purpose of modifying behavior.
Contrived reinforcers
the degree of correlation between a behavior and its consequence
Contingency
A term used to refer to the strength of a reinforced behavior.
Behavioral momentum
the gap in time between a behavior and its reinforcing consequence
Temporal contiguity
anything that changes the effectiveness of a con- sequence
Motivating operation
The reward center of the brain, in particular, an area in the septal region running from the middle of the brain to the frontal cortex where dopamine is the most important neurotransmitter
Reward pathway/dopamine
attributes a reinforcer’s effectiveness to the reduction of a drive.
Hull’s drive reduction theory
High-probability behavior reinforces low-probability behavior.
Premack principle
behavior becomes reinforcing when the individual is prevented from engaging in the behavior at its normal frequency.
Response deprivation theory
the reinforcement of successive approximations of a target (desired) behavior
Shaping