M06 - Decision Making Flashcards

1
Q

What processes are needed for decision making

A
  • goal-directed behavior
  • reward learning & memory
  • executive control
  • inference establishes causal links
  • often in a social context
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two discipline based models in decision-making?

A
  • economic models
  • psychological models
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What type of choice do you have in an economic model?

A

Rational choice but choice bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the type of choice in a psychological model?

A

Choices are context-dependent (social, cultural, moral)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are economic decisions?

A
  • sophisticated rational beliefs
  • stale preferences
  • maximizes own payoff
  • disregards other peoples well-being
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the disadvantage of economic decisions?

A

Prone to biases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What disciplines make up neuroeconomics?

A
  • psychology
  • economics
  • neuroscience
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What decisions are made in neuroeconomics?

A
  • value-based decision making
    Is social value accounted like non-social value?
    Are the underlying circuits similar?
    Which brain chemicals are involved?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the core concepts in decision making?

A
  • expected value
  • risk & ambiguity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a risk?

A

Known variance of a distribution (you know all the possible outcomes of the distribution)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is ambiguity?

A

Unknown variance (outcomes) (we don’t know the entire distribution)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is risk aversion?

A

Prefer a lower, certain reward over a risky higher (on average) reward

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is risk seeking?

A

You need to be paid more than the expected outcomes to not take the gamble

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the purpose of rewards?

A

To reinforce behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What brain region is largely destroyed in Parkinson’s disease?

A

Up to 60% of Substantia Nigra

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the reasons of destroyed SNr in Parkinson’s?

A
  • trauma, tumors
  • encephalitis lethargica
  • MTPT (frozen addicts)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What happens to dopamine in Parkinson’s patients?

A

Up to 80% of dopamine is lost because brain desperately tried to compensate (reducing degradation, increasing receptors)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the role of dopamine in learning?

A
  • plays a large role in reinforcement learning
  • acts as a teaching signal
  • learning from (un)expected outcomes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Where does dopamine act as a teaching signal?

A
  • Reward Prediction Error
  • Rescorla-Wagner learning rule
  • Basis of associative learning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is the Rescorla-Wagner learning rule and prediction error?

A

→ mathematical rule used to describe and predict classical conditioning

→ basic idea: learning occurs when there is a discrepancy or prediction error between what is expected and what actually happens

→ rule suggests that learning occurs when actual outcome differs from what was predicted based on the existing associations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is Neuroeconomics for?

A

concepts and methods of neuroscience could help resolve issues in economic and social sciences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is an expected value?

A

The magnitude of an offer * its probability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is utility?

A

Subjective valuation of outcomes (an apple could be worth more to me than you)

24
Q

What does the certainty equivalent show?

A

It can show us the risk aversion level

25
Q

How does a risk neutral individual approach a gamble?

A

There don’t prefer one outcome over another because they don’t have a risk attitude

26
Q

How does a risk-averse individual approach a gamble?

A

The mean gamble payoff needs to be higher than the certainty equivalent

aka positive risk premium

aka happy to take a certain outcome even though it is lower than the expected outcome

27
Q

Reward Signals influence processing in the whole brain. True or False.

A

True.

28
Q

What is one of the most influential learning rules?

A

Temporal Difference Learning

29
Q

What is temporal difference learning?

A
  • reward prediction is not just dependent on what is happening to right now
    Reward prediction error = actual reward at the time + predicted reward in the future - predicted rewards at this time
30
Q

What is ambiguity aversion?

A

The difference what you would normally pick without ambiguity (nothing hidden) vs pick with ambiguity (hidden info)

31
Q

What is the hyperbolic delay discounting?

A

You have small immediate reward (SS) vs large, delayed reward (LL). If you put the delay for the LL to a certain time, it’s value will become same as the SS and you “might as well” choose the SS. The value of future rewards decays hyperbolically.

32
Q

Humans but not monkeys follow hyperbolic discounting. True or False.

A

False. BOTH humans and monkeys follow hyperbolic discounting.

33
Q

How can you map out the discount curve?

A

By pushing out the reward and increase it in size you can map out the discount curve

34
Q

Humans generally act pro-social (even in one-shot anonymous interactions). True or False.

A

True

35
Q

What drives pro-social behavior?

A

Evolutionary account:
- stabilizes long-term social bonds
- increases group fitness

36
Q

What are the 2 possible brain mechanisms behind pro-social behavior?

A
  • High-valuation-specific
  • Extended common currency
37
Q

What is the Social-valuation-specific?

A

Network in the brain that is devoted to social value as opposed to non-social value (food etc.) are distinct

38
Q

What is the extended common currency?

A

Social and Non-social processed separately but ending up in the same mechanisms

39
Q

What are the main influences on trust?

A
  • reputation matters (trust based on feedback, grows as you grow up)
  • perception of moral character (stories about a person affect trusting behavior)
40
Q

What is the reflection effect?

A

People become risk-seeking in the loss domain

41
Q

In what situation does dopamine act as pleasure?

A
  • recreational drugs activate DA receptors
  • medial forebrain bundle electric stimulation prioritizes behaviour over basic needs
42
Q

When does dopamine act as motivation?

A
  • destroying DA neurons does not change “liking” of rewards
43
Q

When does the dopamine level increase?

A
  • when unexpected reward occurs
  • when cue predicts reward fully
44
Q

When does the dopamine level decrease?

A
  • when outcome is lower that expected
45
Q

What brain region is modulated during an unexpected gain?

A

Anterior cingulate cortex (ACC)

46
Q

What brain region is activate during unexpected events?

A

Basal Ganglia

47
Q

What brain region is activated during risk taking?

A

Insula

48
Q

What brain region is active during ambiguity (aka incomplete information)?

A

lateral PFC

49
Q

What are neural signatures of reputation?

A
  • multi-round trust game (hyperscanning fMRI)
  • players learned to build trust (activity correlated between brains)
  • when reciprocated, players anticipated trust-reciprocation (potential signal of upcoming reward)
50
Q

When does altruistic punishment occur?

A
  • in a 2-person interaction (tit-for-tat)
  • in a multi-person interaction (Public Goods games
51
Q

How can you do common currency evaluation?

A

Through Padoa-Schioppa

52
Q

What is Padia-Schioppa

A
  • presented monkey with different rewards
  • psychometric curves establishes “rate of exchange”
  • neural activity reflected “integrated value”
53
Q

How does value-based decision-making change in vmPFC (vento-medial PFC) patients?

A

vmPFC patients do not adapt their choice away from risky decks with learning/feedback. They retain their levels of risk -sensitivity in a betting game in the face of losses.

54
Q

Explain drift-diffusion models.

A
  • simulate the integration of evidence over time
  • represent the integration of positive and negative information
  • applied to various decision-making tasks
55
Q

What brain area in mainly involved in drift-diffusion models?

A

dorsolateral prefrontal cortex (dlPFC)
- setting and maintaining the decision threshold
- influences the speed and accuracy of decisions