Module 2: Drug habits, cognitive control and neural basis Flashcards

Distinguish between goal-directed action and habit based on their definitions [paraphrasing and analyzing] Explain how habits are formed according to the 'Law of Effect' [paraphrasing], and explain the ideal conditions for forming a strong habit [evaluating] Explain how to experimentally test whether a behavior is goal-directed or habitual [paraphrasing], and identify the essential features of this experimental paradigm [analyzing] Apply the 'outcome devaluation' paradigm to a new research quest

1
Q

When is drug-seeking called goal-directed?

A

When it is based on an expectation (cognitive criterion) and consists of a positive hyper-evaluation (motivational criterion) of the drug

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does the habit account argue that drug-seeking involves?

A

Behaviour is followed by a reward or absence of a negative event which reinforces the SR association. If stimulus is presented, old behaviour can be triggered and can become dominant after many repetitions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Outcome-devaluation test

A
  1. Instrumental learning so if a rat presses lever they will gain pellets in the Skinnerbox
  2. Outcome devaluation so given unlimited food
  3. Critical test phase: if goal-directed then they will reduce lever pressing due to reduced value, but if it is a habit then will continue to press the lever
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why is this test carried out in extinction?

A

A devalued outcome will lead to weaker S-R associations and if not due to extinction unclear why the rat presses less for the reward. If behaviour is immediately adjusted then suggests it is goal-directed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Habit theory of addiction

A

There is a transition from targeted control to drug habits. There are individual differences in forming dominant habits and some can be more vulnerable in developing an addiction. Drugs are strong reinforcers of S-R habits and drugs lead to structural changes in the brain which results in a stronger tendency to rely on control.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Dual process models

A

Substance abuse is the result of reinforced automatic/reflexive bottom-up processes and weakened top-down cognitive/executive functions. This means that impaired cognitive control can result in relying on habits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does previous research suggest about habits?

A
  • habits allow for responses to be efficiently executed to free up cognitive resources
  • prefrontal cortex and dorsomedial striatum involved in goal-directed action and dorsolateral striatum supports habit-based behaviour
  • specific neural circuity for outcome insensitive habitual behaviour unclear
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Aims of this research

A

To determine whether instrumental responding in humans can be habitual (whether response will persist no matter the outcome) and to uncover neural mechanisms which contribute to development and control habitual behaviour in humans

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Method of this research

A

Participants were given little training or were over-trained to press a button with a rewarding outcome delivered on a variable- interval schedule. Responses were self-paced and an image was shown and a schematic indicating a button to press. Then either a picture or grey circle was shown to indicate a reward. Then devaluation took place in selective satiation, where participants had to eat the food until no longer pleasant. Then the responses were assessed and fMRI measurements took place.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Results found from the study

A

Response rates for the 1 day group decreased during presentation of the cue to the devalue cue in comparison to the day 3 group even though there was no difference for valued outcome. Activity in DLS increased during the final sessions and left nucleus accumbens displayed a significant response to reward presentation for both groups. Ventromedial prefrontal cortex showed a significant effect in anticipation of the upcoming rewards.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What do these results mean?

A

Posterior putamen into globus pallidus became more sensitive to stimuli associated with a behavioural response. Significant difference between first and last 2 sessions so area becomes more involved after successive days of training. Goal-directed to habitual control is a dynamic relationship and early phase of habit learning occurs when behaviour is goal-directed. Reward expectancy is important in goal-directed behaviour. vmPFC and DLS play a role in behaviour, but DLS can preferentially influence behaviour. Goal directed representations remain intact throughout.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Goal-directed actions

A

These are instrumental behaviour that are performed with a certain goal and that a certain behaviour will increase the likelihood of reaching that goal. Belief criterion argues that goal-directed actions are mediated by knowledge of action-outcome relationship. Desire criterion is that these actions are only executed when outcome is desirable. Habits occur irrespective of the evaluation of outcome.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Factors which can influence habits

A
  • behavioural intentions are weak predictors of actions performed frequently than those performed rarely
  • habits are contextually dependent (habit discontinuity hypothesis)
  • goal pursuit and behavioural repetition are intertwined
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How has goal-directed action been studied in humans?

A
  • selective satiation
  • ‘instructed devaluation’ which participants are explicitly informed that an outcome is devalued as it does not earn points or credits
  • but, symbolic outcomes can fail to engage basic learning mechanisms
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Fabulous Fruit game

A

Participants press keys to gain fruit icons to gain points which are each worth points. Some of the fruits were then told they were worth less points and healthy participants were able to do well in this task in a goal-directed manner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What has been found in animal lesion research?

A
  • pre-training lesions of prelimbic cortex led to behavioural autonomy and important in learning process underlying goal-directed action
  • lesions of dorsomedial striatum disrupt goal-directed performance
  • lesions of dorsolateral striatum disrupt habit formation (can become goal-directed and sensitive to devaluation)
  • infralimbic context important, can be part of corticostriatal pathway
16
Q

What has human neuroimaging research found?

A

-preferential responding for outcome was associated with ventromedial prefrontal cortex/medial orbitofrontal cortex
- those with strong connectivity with ventromedial prefrontal cortex and caudate act more goal-directed in slips-of-action test
- premotor cortex-posterior putamen connectivity was negatively related with performance
- posterior putamen was a predictor of habitual control

17
Q

Clinical relevance in addiction

A

Recreational drug use starts as voluntary but can lead to strong S-R associations and develops into compulsive drug-seeking habits. Shift towards behavioural autonomy is reflected in progression from ventral to dorsal striatum. Weak prefrontal functioning is a vulnerability factor

18
Q

Clinical relevance in OCD

A

OCD were impaired at directing responses towards valuable outcomes and away from devalued ones. Found that those with OCD continued to press to avoid the devalued shock, related to hyperactivity in ventromedial prefrontal-orbitofrontal cortex and caudate

19
Q

Clinical relevance in obesity and eating disorders

A

Excessive consumption of energy-dense food and lack of physical activity are important to rise in obesity. Obese and lean men were trained to obtain snacks and then devalued these. The reduction in response was negatively related to BMI. Rats on a binge-eating diet failed to adjust their performance

20
Q

How are habits found to be a transdiagnostic compulsive trait?

A

Overreliance on habit learning has been found in Parkinson’s disease, treatment response in SAD and schizophrenia, no habit propensity found in children with ASD. Unclear whether impaired sensitivity to outcome revaluation is related to general impairment in cognitive control (working memory and response inhibition). Stress could play a role in mediating observed deficits, can lead to dominant habitual control.

21
Q

Challenges for the field

A
  • an integrative approach should be used to understand habits across approaches. Issues with ecological validity and integrating research into inflexibility of habits assessed with outcome revaluation and efficiency of trained behaviour. Look at how these aspects are interrelated
  • habit interventions. Habits should try to turn desired behaviour into a habit, use of implementation intention to improve context-dependent habits, remove contextual cues associated with old habit and capitalise on existing habits to build more.