Week 10: Choice, Matching, Self-Control Flashcards
Concurrent Schedule of Reinforcement
The simultaneous presentation of two or more independent schedules, each leading to a reinforcer.
The Matching Law
The proportion of responses emitted on a particular schedule matches the proportion of reinforcers obtained on that schedule.
Undermatching
The proportion of responses on the richer vs the poorer schedule is less different than would be predicted by matching.
Changeover Delay (COD)
A slight delay in available reinforcement after signalling intent of switching to a new schedule.
Overmatching
The proportion of responses on the richer vs the poorer side is more different than would be predicted by matching.
Bias From Matching
When one response alternative attracts a higher proportion of responses than would be predicted by matching, regardless of whether that alternative contains the richer or poorer schedule of reinforcement.
Melioration Theory
The distribution of behaviour in a choice situation shifts towards those alternatives that have high value regardless of the long-term effect on the overall amount of reinforcement.
How can Melioration Theory reduce the overall level of reinforcement.
- An alternative may not require as much responding as one is distributing towards it to obtain all of the available reinforcers.
- Overindulgence in a high reinforcing alternative can often result in long-term habituation to that alternative, thus reducing its value as a reinforcer.
- Melioration is often the result of behaviour being too strongly governed by immediate consequences as opposed to delayed consequences.
Self-Control
Choosing a larger later reward over a smaller sooner reward.
Impulsiveness
Choosing a smaller sooner reward over larger later reward.
The Ainslie-Rachlin Model of Self-Control
Preference can shift over time.
Experience a reversal of preference as time passes and smaller soomer reward becomes imminent.
Commitment Response
An action carried out at an early point in time that serves either to eliminate or greatly reduce the value of an upcoming temptation.
Behavioural Contracting
Formally arranges to attain certain rewards for resisting temptation or receive certain punishers for yielding to temptation.
The Small-but-Cumulative Effects Model
Each individual choice on self-control has only a small but cumulative effect on our likelihood of obtaining the desired long-term goal.