matching + biases ch 6 continued Flashcards
What does the matching law state about the relationship between relative rates of responding and reinforcement?
The relative rate of responding R matches the relative rate of reinforcement r for that choice
Formula: RA/RB = rA/rB
What is a limitation of the Rescorla-Wagner model?
Not good to explain extinction or counter blocking
The model primarily focuses on associative learning.
Which variable in the matching law affects sensitivity to choose a particular schedule despite loss of reinforcement?
Sensitivity S
For choice A: RA/RB = (rA/rB)^S
What does undermatching refer to in the context of the matching law?
Choice responding less than predicted, s < 1.0
Example: If the law predicts a 2:1 ratio but the choice is less than 2:1 (e.g., 1:1).
What is overmatching in the context of the matching law?
Choice responding more than predicted, s > 1.0
Example: If the law predicts a 2:1 ratio but the choice is greater than 2:1 (e.g., 3:1).
What does response bias indicate in the matching law?
Tendencies to certain responses and/or reinforcers
b > 1.0 indicates a more preferred response; b < 1.0 indicates a less preferred response.
What influences the rate of responding (R) according to reinforcer value?
Reinforcer features
Examples include amount, palatability, and immediacy.
How does the matching law apply to basketball shooting?
Shooting is the rate of responding; points are reinforcement
Players choose between 3-pointers (higher points) and 2-pointers (easier).
What are the three levels of choice in reinforcement schedules?
Molecular, Melioration, Molar
Molecular refers to individual responses, Melioration to local rates of responding, and Molar to the sum of responses.
What does molecular maximizing involve?
Choosing the response that is best at a single time point
Example: A pigeon choosing a key light in a single instant.
What does molar maximizing involve?
Choosing the response that will maximize reinforcement over the long run
Example: A rat’s lever pressing behavior over several days.
What is melioration in the context of reinforcement?
Responding to improve local rates of reinforcement
Local rate refers to the time a subject responds to a particular alternative.
What is choice commitment in self-control?
Some decisions make other choices unavailable
Example: Buying an economical car can prevent saving for a more expensive car.
What is the difference between choice link and terminal link in a concurrent chain schedule?
Choice link is not reinforced; terminal link is a reinforced free operant situation
Example: A leads to VR10 and B leads to FR10.
What is self-control as defined in the context of reinforcement?
Choosing a large delayed reward over an immediate small reward
Example: The marshmallow test comparing one vs. two marshmallows.
What is the value discounting function (VDF)?
The value of the reinforcer is reduced by how long you have to wait for it
Formula: V = M(1 + KD)
What happens to the value of a reward as the delay increases according to the VDF?
The value of the reward goes down
If the delay = 0, then V = M.
What is the consequence of the value discounting function over time?
As reward value decays over time, choice is shifted
At T0, large reward preferred; at T1, immediate small reward preferred; at T2, large reward retains value.
Can individual differences affect self-control according to the VDF?
Yes, individuals display inherent or developed lack of self-control
The VDF may account for these differences.
