Lecture 8- Choice, matching, self control Flashcards
What are concurrent schedules of reinforcement ?
2pts
- The simultaneous presentation of two or more independent schedules, each leading to a reinforcer
- The organism is thus allowed a choice
What are the 2 neural decision pathways?
6pts
Reflexive system (impulsivity):
- fast, automatic, emotionally based
- immediate gain
- Mediated by dopaminergic (DA) reward system
- Ventral striatum
Reflective system (self control):
- slow, deliberate decisions
- mediated by prefrontal cortex, medial temporal cortex, posterior parietal cortex
Skinner on self control-
Skinner argued against the influence of BLANK.
* Our choices reflect management of…
What are the 2 responses involved in managing conflict and what is the difference?
- free will
- conflicting outcomes
Managing a conflict involves two types of responses: Controlling response:
- steps taken to shape your environment to engage in the desired behavior
Controlled response:
- desired behavior
To stick to a healthy eating plan, keep only
healthy food in the house.
What is the controlling response vs. controlled response?
Controlling response:
- keeping only healthy food in the house
Controlled response:
- eating a healthier diet
What are some types of controlling responses?
4pts
- physical restraint
–> Ex-throwing out the junk food in the house so that you won’t be tempted to eat it - depriving or satiating
–> Ex- going grocery shopping after you’ve eaten - doing something else
–> Ex- drinking water instead of soda - self-reinforcement or self-punishment
–> Ex- stick to diet a diet and get a reward, if don’t stick to diet have to put $10 in jar
BLANK consequences are generally more powerful
than BLANK consequences.
- Self-control involves choosing the….
- Impulsiveness involves choosing the…
*Hint: LLR, SSR
- immediate, delayed
- larger later reinforcer
(LLR) over the smaller sooner reinforcer (SSR) - smaller sooner
reinforcer (SSR) over the larger later reinforcer (LLR).
What would self control look like in eating a healthy diet (SSR vs LLR)?
- Avoiding SSR: fat, salt, sugar
- Choosing LLR: improved health
Why is the value of delayed consequences weakened ?
because they are delayed and less certain
What is the Ainslie-Rachlin Model of Self-Control?
3pts
- The preference for the SSR and LLR can shift over time
- When both the SSR and LLR are distant, the LLR is preferred so initially, the value of the LLR outweighs the value of the SSR
- As the SSR becomes imminent, it’s value outweighs the value of the LLR
What is the small but cumulative effects model?
2ps
- Achieving a long term goal is not the result of a single choice- its an ongoing series of choices
- Each choice of an SSR vs. LLR has a small but cumulative effect on reaching our goals
The task of choosing between a SSR and a LLR.
- The subject has to “ BLANK”
What task is this?
Delay of gratification task
- “ delay gratification”
An action carried out at an early point in time that
serves either to eliminate or greatly reduce the
value of an upcoming temptation.
What type of response is this? What does it involve?
Give an example.
2pts
- commitment response
- adding a consequence for not following through: To ensure that she studies, she gives her brother $20 in the morning and instructs him to keep it if she fails to study that evening
The proportion of responses emitted on a particular schedule matches the proportion of reinforcers obtained on that schedule.
What concept is this?
Give an example.
- The matching law
Ex- if you get more praise for studying than for watching TV, you’ll likely spend more time studying.
Ex- 2 different vending machines: one gives snacks every 30 seconds, the other every 60 seconds. You’ll spend more time at the faster one, because it offers more rewards.
What is the melioration theory?
Give an example.
3pts
- Melioration= “make better”
- Distribution of the behavior shifts towards the alternatives that have higher value.
Ex- The FI30 sec schedule will have much higher value than the FI60 sec schedule.
