Cognitive Modelling ARTICLES Flashcards

Diffusion Model of Decision Making & Value learning through reinforcement learning

1
Q

What does the diffusion model aim to explain?

A

Two-choice decision-making by modeling evidence accumulation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two main criteria in the diffusion model?

A

Evidence thresholds for decision alternatives.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What determines the time to make a decision in the diffusion model?

A

The time to accumulate enough evidence to cross a threshold.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is ‘drift rate’ in the diffusion model?

A

The rate at which evidence accumulates toward a decision.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How does stimulus difficulty affect drift rate?

A

More difficult stimuli lead to lower drift rates.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does between-trial variability in the model account for?

A

Differences in starting points and drift rates across trials.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does the term ‘non-decision time’ refer to?

A

Time spent on processes other than decision-making, such as encoding and response.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does the model explain the speed-accuracy tradeoff?

A

By adjusting the distance between decision thresholds.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the significance of response time distributions in the model?

A

They provide a detailed fit to empirical data on decision speed and accuracy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How do the model’s parameters vary with stimulus discriminability?

A

Higher discriminability increases drift rate and reduces decision time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What role does noise play in the diffusion process?

A

It introduces variability in evidence accumulation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the function of setting different thresholds in the model?

A

To prioritize speed or accuracy depending on task demands.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What experimental data supports the diffusion model?

A

Distributions of reaction times and error rates under varying conditions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How does starting point variability influence decision outcomes?

A

It biases decisions toward one threshold over the other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a key advantage of the diffusion model over simpler decision models?

A

Its ability to predict both choice accuracy and detailed response time patterns.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What historical models influenced the development of the diffusion model?

A

Sequential sampling and random walk models.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How are ‘fast errors’ explained by the model?

A

They occur when the starting point is closer to the incorrect threshold.

18
Q

What is a ‘first passage time’ in the context of the model?

A

The time at which the evidence first reaches a decision boundary.

19
Q

Why is the diffusion model particularly useful in cognitive neuroscience?

A

It links decision-making processes to neural mechanisms like firing rates.

20
Q

What types of tasks are best suited for diffusion model analysis?

A

Speeded, two-choice decision-making tasks.

21
Q

What is reinforcement learning?

A

A trial-and-error method to learn decision-making strategies that maximize rewards.

22
Q

What are prediction errors in reinforcement learning?

A

Differences between expected and received rewards.

23
Q

What role do dopamine neurons play in reinforcement learning?

A

They signal prediction errors.

24
Q

What is the Rescorla-Wagner model?

A

A mathematical model of learning based on prediction error updates.

25
Q

What is temporal difference learning?

A

An extension of reinforcement learning that predicts long-term rewards.

26
Q

How do dopamine neurons respond to unexpected rewards?

A

With phasic increases in firing rate.

27
Q

What is the significance of blocking in learning theory?

A

It shows that previously learned associations can prevent new learning.

28
Q

How do dopamine neurons react to predicted rewards?

A

They show no phasic activity.

29
Q

What is the role of the striatum in reinforcement learning?

A

It integrates reward signals from dopamine neurons.

30
Q

What is the main idea behind the Bellman Equation?

A

It represents value as the sum of immediate reward and future rewards.

31
Q

What is a major application of reinforcement learning in neuroscience?

A

Understanding decision-making and reward processing.

32
Q

How does the prediction error change with increased learning?

A

It decreases as predictions become more accurate.

33
Q

What is the learning rate in the Rescorla-Wagner model?

A

A parameter controlling the size of prediction updates.

34
Q

How do drugs of abuse affect the dopamine system?

A

They enhance dopamine activity, reinforcing addictive behaviors.

35
Q

What is second-order conditioning?

A

Learning associations between stimuli that predict other reward-predictive cues.

36
Q

How does variability in dopamine neuron responses reflect learning?

A

It tracks changes in prediction errors over time.

37
Q

What is the impact of stochastic rewards on learning?

A

They create variability in prediction error signals and slower learning curves.

38
Q

What does a negative prediction error indicate?

A

That a reward was less than expected or omitted.

39
Q

How are reinforcement learning theories tested experimentally?

A

Using tasks that vary reward probability and timing.

40
Q

What is the relationship between motivation and dopamine?

A

Dopamine signals influence motivation to perform rewarded actions.

41
Q

IN-CLASS MINI-QUIZ QUESTION 1:
The linear ballistic accumulator (LBA) and the diffusion decision model (DDM) belong to the same class of decision-making models. Describe a key feature or assumption shared by these 2 models.

A
42
Q

IN-CLASS MINI-QUIZ QUESTION 2:
Describe a benefit of combining behavioral and neural data with cognitive modelling, as is done in model-based cognitive neuroscience.

A