chapter 5 & 6 test Flashcards
behavioral causation
ultimate causes: evolutionary history; learning history
proximate causes: close in time to behavior
current stimuli
CNS
learning history
pavlovian conditioning
operant conditioning
learning
realtively permanent changes in envrionment behavior relations due to certain types of experiences
Pavlovian (Classical) conditioning
conditioning of reflexes
two or stimuli are paired
NS association to US (UR)
Experiments by Thorndike
discrete trials
trial and error vs. trial and success
learnings only happens by trials and success
Any behavior that is followed by pleasant consequence is likely to be repeated and any behavior followed by unpleasant consequences is likely to be stopped
The Law of Effect
the law of effect
behavior is determined by its consequences
the capacity for learning by consequences is a function of our evolutionary history
fixed plasticity
free operant conditioning
B.F Skinner, used no trials (free to move around)
operant conditioning (two-term contingency)
response (R)—->(S) stimulus consequence
R—->S
operant conditioning (two-term contingency)
the 3 components of operant behavior
operates on the environment
changes the environment
and is changed as a result
operates on environment, changes the environment, and is changed as a result
operant behavior
operant behavior
operates on environment, changes the environment, and is changed as a result
operant conditioning
Kid behavior
S(d)———–R———-S(r+)
EO/S(d)——-R——– S(r-)
behavior is determined by its…
consequences
stimulus consequence follows a response and increases the probability of similar response under similar circumstances
reinforcement
reinforcement—followes a_____
response = one instance of behavior
reifnrcement ________ the probability
increases the probability (e.g. rate or frequency, duration, magnitude)
reinforcement procedure
follows the response
reinforcement process
increase probability
similar responses
under similar circumstance
the reinforcer is added after the response (+)
positive reinforcement
reinforcer is subtracted or remove after the response (-)
negative reinforcement
3 characteristics to be called reinforcement
the behavior must a consequence
the behavior must increase the in strength
the consequence must be the reason it increases in strength
negative reinforceme is called
escape learning
avoidance learning
when the aversive stimulus is present and you do something to get rid of it
escape learning
when the aversive stimulus is not present yet, and you do something to avoid
avoidance learning
response dimensions that can be reinforced
response rate (# of responses over time)
response magnitude (or intensity)
Response duration (how long the response lasts)
response topography (form)
latency
reinforce randomness of response (responding differently each time)
the actual consequence
in positive renforcement (what is added)
in negative reinforcement what is subtracted
reinforcer
depends on pairing with one other (usually primary)
conditioned reinforcers
depends on pairing with many other reinforcers
generalized conditioned reinforcers
uncoditioned reinforcers
food
water
sexual arousal
sleep
warmth/ coolness
three practicial advantages of conditioned (or generalized reinforcers)
satiation doesn’t occur
easier to reinforce immediately
less disruptive than primary reinforcers
automatic reinforcers
events that naturally follow a response
are usually not deliberately mediated by other individuals
variables that affect operant conditioning
contingency
temporal contiguity
reinforcer magnitude
response effort
motivating operations
operant contingency
all the things equal, the greater the contingency between responses and their consequences, the quikcer tand stronger the conditioning
all things equal, the greater the
operant contiguity
alter the the effectiveness of a reinforcer
evoke behavior that has produced that reinforcer
establishing operation
3 term contingency
EO—R—–S(R+)
EO—–R—-S(R-)
Premack principle
high probability behavior reinforce low-probability behavior
high probability behavior reinforce low-probability behavior
R1———————————————-r2
Low Prob. High Prob.
Premack principle
when deprived from engaging in a behavior below the baseline level, engaging in it back to baseline becomes reinforcing relative to other behaviors
response-deprivation theory
selection by consequences
behavior, likes species (genes) evolved
reinforcement is like natural selection
- (genetic or behavioral) variation
- (environmental) selection
- retention (genetic vs. neural)
a procedure
the differential reinforcement of successive approximations towards a final or target behavior
natural vs. contrived_____
selection by reinforcing consequence
shaping
novelty
common feature of creativity
a behavior that occurs repeatedly even though it does not produce the reinforcers that maintain it
superstitious behavior
