Self-Control and DD Flashcards
Examples of self-control:
Studying Sticking to a diet / exercise plan Giving up smoking Finishing planned projects Saving money
What do self-control situations have in common?
Choice between smaller, sooner reinforcer =
and larger, later reinforcer =
Capture the…
Impulsive choice
Self controlled choice
immediacy amount trade offs of self-control
Experimental Analogue : Pigeon
Smaller sooner: left key > less food (shorter delay)
Larger later: right key > more food (longer delay)
Smaller sooner: left key > 1s food (3s delay)
Larger later: right key > 3s food (10s delay)
Experimental Analogue: Human
Would you prefer?
$80 now OR $100 in one year
How much value does a reinforcer lose if it is delayed?
At what point the impulsive choice changes to a self-controlled choice
Larger reinforcer losing value with time
e.g., go for self-controlled option, wait for reinforcer because more valued, if go for impulsive option, even though the reinforcer is larger, not willing to wait for it, not valuable (worth less)
Titrating amount procedure
Receive $100 now OR Receive $200 in 7 months √
Receive $120 now OR Receive $200 in 7 months √
Receive $140 now OR Receive $200 in 7 months √
Receive $160 now √ OR Receive $200 in 7 months
Indifference point
Indifferent between ? now and ? in 7 months.
Receive $100 now √ OR Receive $200 in 7 months
Receive $80 now √ OR Receive $200 in 7 months
Receive $60 now √ OR Receive $200 in 7 months
Receive $40 now OR Receive $200 in 7 months √
Indifference point = ?
Indifferent between ? now and ? in 7 months.
= $150
$150
$200
(i.e., $200 loses $50 of its value when delayed by 7 months)
= $50
$50
$200
(i.e., $200 loses $150 of its value when delayed by 7 months)
Indifference points:
- determine how much subjective value…
This is known as the indifference point between the…
e.g. indifferent between $65 now and $100 in 8 months
$100 loses $35 (35%) of its value when delayed by 8 months
is lost when an outcome is delayed
smaller, sooner and the larger, later option
Slide 14, 15, 16
Slide 14, 15, 16
Criteria for a good quantitative model
- High
- model is a good representation of…
- Predicts/describes…
R2
the underlying “signal” (residuals are non-systematic)
phenomena we observe
Preference reversal
How often do you make a plan to complete a certain study activity but then find yourself doing another, non-study activity instead?
How often do you set your alarm before you sleep to ring early in the morning, but when it rings in the morning you decide to continue sleeping instead?
A change in preference from the larger, later reinforcer to the smaller, sooner reinforcer as the…
Before you sleep the larger later was more valuable, foresee self for going for the smaller sooner (sleeping in), far away in time for the smaller sooner and larger later, easier to show self-control, go for larger later when wake up, when morning is here and closer to smaller sooner and larger later, go for smaller sooner (sleep in)
choice point moves closer to the two alternatives
Do pigeons show preference reversal?
Condition 1:
Red key > 2s food (2s delay)
Green key > 6s food (6s delay)
Condition 2:
Red key > 2s food (20s delay)
Green key > 6s food (24s delay)
Pigeons prefer: red key > 2s food (2s delay) - smaller sooner
Pigeons prefer: green key > 6s food (24s delay) - larger later
Slide 22
Slide 22
Hyperbolic discounting equationthat produces the curve
Value = Amount / 1+k * Delay
Value =
k =
Delay
Amount =
determine this subjective value. What effect did delay have on original amount?
free parameter
delay to receiving this amount
original, un-discounted amount
Slide 24 and 25
Slide 24 and 25
K - the discounting rate parameter
Higher k means:
Reinforcers…
More likely to…
Curve is…
Lower k means:
Reinforcers…
More likely to…
Curve is…
Higher k means person is more…
Lower k means person is more…
lose value more quickly
select smaller sooner
steeper
lose value less quickly
select larger later
shallower
impulsive, less self-controlled
self-controlled, less impulsive
Slide 27
Slide 27
