Choice, Matching, and Self-Control

Question 1

Concurrent Schedules of Reinforcement

Answer 1

• the simultaneous presentation of two or more independent schedules that lead to a reinforcer
• the organism is allowed to choose one schedule vs. another

Question 2

The matching law

Answer 2

The proportion of responses emitted on a schedule matched the proportion of reinforcers obtained on that schedule
ex: a pigeon will emit twice as many responses on an FI30 schedule as on an FI60

Question 3

What does the matching law equation express?

Answer 3

the proportion of responses emitted on schedule A = the proportion of reinforcers earned on schedule A

Question 4

Melioration theory

Answer 4

Distribution of behavour shifts toward the alternatives that have higher value regardless of longer effect on the overall amount of reinforcement

ex: FI30 (red key) will have higher value than FI60 (green key), so the pigeon will shift more toward the red key than the green key (twice as many reinforcers for the same amount of work

but… this can sometimes result in a reduction in the total amount of reinforcement obtained

Question 5

Qualities of melioration theory

Answer 5

1. an alternative may not require as much effort
   - you may spend more time studying for a more enjoyable course rather than a least enjoyable, you should probably spend more time on the least one… cause you’ll end up with a bad great which is the more beneficial one
2. overindulgence can result in longterm habituation
   - if you spend all ur time on the enjoyable course you may get tired of it, may not feel rewarding anymore (moderation!)
3. behaviour is governed by immediate consequences
   - the immediate reinforcement temps you away from the least enjoyable course
   - you often choose the immediate reinforcement (ex: going out) instead of the delayed one (ex: getting an A on your test)

Question 6

Self-Control - Skinner

Answer 6

• a person who behaves wisely and resists temptations is said to have a lot of willpower
• he argued against the influence of free will
• our choices manage conflicting outcomes

Question 7

what are 2 types of responses involved in managing conflict?

Answer 7

controlling response + controlled response

ex: want better spending habits:
- controlling: leaving money at home (ACT)
-controlled: amount you spend

Question 8

Types of controlling responses:

Answer 8

1. physical restraint
2. depriving + satiating
3. doing something else
4. self-reinforcement/punishment

Question 9

self-control: physical restraint

Answer 9

physically manipulatig the environmwnt to prevent a problem behaviour
ex: throwing out junk food in ur house to not be tempted to eat it
ex: leaving money at home to spend less on an evening out

Question 10

self-control: depriving + satiating

Answer 10

use motivating operations to alter the extent to which an event can act as a reinforcer
ex: go grocery shopping after you’ve eaten (you’re satiated)

Question 11

self-control: doing something else

Answer 11

prevent yourself from engaging in certain behaviours in an alternate behaviour
ex: have water with you so you’re not tempted in drinking a soda

Question 12

self-control: self-reinforcement/punishment

Answer 12

stick to a diet = watching football on Sunday
don’t stick to a diet = $10 in a jar
self-delivered consequences are more effective when other people are aware of the contingency
- people fail to deliver self concequences

Question 13

Temporal Issue: reinforcers

Answer 13

immediate consequences are more powerful than delayed

self-control: choosing the larger later reinforcer than the smaller sooner reinforcer

ex: choosing to study to get your degree (LLR) vs. watching tv (SSR)
ex: going to the gym to lose weight (LLR) vs eating junk food (SSR)

Question 14

Temporal issue: punishers

Answer 14

self-control = choosing a smaller sooner punisher vs a larger later one

smaller sooner ex: studying
larger later ex: failing the course

Question 15

value of delayed consequences

Answer 15

the value of them is weakened because they are delayed and less certain

Question 16

Ainslie-Rachlin Model of Self-Control

Answer 16

the prefernce for the SSR are LLR can shift overtime
- when both are distant LLR is preferred
- As time passes, SSR becomes imminent, and its value increases sharply and comes to outweigh the value of the LLR
ex: saying you’ll study all afternoon, but instead you go out with friends
-The value of the reward increases more sharply as the reward approaches.

Question 17

Small-But-Cumulative Effects Model

Answer 17

achieving a long-term goal isn’t the result of a single choice:
- each choice of SSR has a small but cumulative effect on reaching our goals, this is why self-control is so difficult

ex: a habit of choosing burgers for lunch over a healthy alternative will lead to cumulative punishing effects

Question 18

Mischel’s Delay of Gratification Paradigm

Answer 18

• Self-control: choosing a larger later reward over a smaller sooner reward.
• Impulsiveness: choosing a smaller sooner reward over a larger later reward.
• The task of choosing between a smaller sooner reinforcer and a larger later reinforcer.
• The subject has to “delay gratification”