Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PSYC 440 > Decision Making > Flashcards

Decision Making Flashcards

1
Q

What is one of the most interesting things about how we make decisions?

A

-how we compare things that dont have a quantifiable value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
1
Q

What is most cognitive neuroscience research about decision making based on?

A

behavioral economics and animal models from behaviorism where the value or likelihood of reward can be quantified

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

In an decision what do we have to represent in order to come up with a set of feasible actions?

A

represent our environment (external states) and our own states (internal states)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How do we make decisions in three broad phrases?

A

we evaluate potential actions
select an action
and evaluate the outcome of the action

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What do we get the chance to do with the outcome of a decision?

A

we have a chance to learn something from the outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

In the weather prediction task what could learning potentially influence?

A

presentation of cards in the deck
predicted reward contingencies for the cards
selection of rain or shine based on those contingencies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is it harder to study decision making in real life?

A

do not get to see the direct outcome of a decision immediately

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does valuation overlap with in the brain?

A

areas involved in habit learning and some of the same reward circuitry is active

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What was seen and done in the study in which Roitman and Shalden trained monkeys on coherent dot motion display?

A

-told the monkeys to make a saccade to the target when you have decided what direction the dots are moving in
-single unit activity was measured in the LIP
-actviity ramps up over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does the LIP represent in the context of the dorsal attentional system?

A

-represents both the location of the stimulus you are monitoring for and the target location of eye movement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How come in the Roitman and Shalden study even if there was 0% coherence for the motion of the dots the monkey still made a saccade in a certain direction?

A

the monkey might be gathering evidence in a way that favors one side

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

LIP neurons show sustained activity associated with what?

A

associated with endogenous attention to specific retinotopic locations
-LIP is representing the motor target of eye movement and location in space where the stimulus occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How do attention related regions represent in the context of decision making?

A

represent both actions and internal and external states relevant to deciding among actions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Where in the brain does activity correspond to accumulating evidence for a perceptual decision?

A

dorsal attentional stream

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is valuation?

A

what is the value of each action given internal and external states

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the three different valuation systems?

A

-pavlovian
-habitual
-goal directed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is an appetitive and avoidant example of pavlovian valuation system?

A

appetitive - eat all food on the plate - reward obtained food
avoidant - cross street upon seeing dangerous person punishment avoided - potential harm

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is an appetitive and avoidant example of habitual valuation system?

A

appetitive - morning cup of coffee; reward - stimulant
avoidant - drive usual route to work; punishment avoided - traffic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is an appetitive and avoidant example of goal directed valuation system?

A

appetitive - movie selection reward - entertainment
avoidant - go for a run - punishment avoided - obesity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Wha kind of conditioning is habit learning?

A

operant conditioning - associating behavior with reward not stimulus with reward - is a form of nondeclarative learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What kind of conditioning is pavlovian learning?

A

classical conditioning where you associate a reward with a stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How is goal directed learning?

A

it is longer term and more abstract and conlifct in goal directed evaluation system and more simple brain evaluation system

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

In pavlovian learning what is the value assigned based on?

A

an evolutionarily appropriate response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

The habit learning system is highly conserved evolutionarily what regions of the brain is based on?

A

basal ganglia or striatum
midbrain dopaminergic nuclei vta or SNc
medial prefrontal cortex

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the value assigned based on in goal directed learning?

A

computes new values based on the evaluation of new rewards - a more dynamic system in response to new information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What region of the brain is associated with goal directed system?

A

dorsolateral prefrontal cortex

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What are the valuation systems and the limits of rational economic models?

A

risk and uncertainty - expected value vs unexpected utility and prospect theory
time - immediate rewards and rewards offered at a delay are evaluated differently

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are some of the assumptions we make in regards to how people make rational decisions about buying and selling?

A

-they represent value accurately
-they have accurate information
-they make decisions that optimize value

-there are issues thought with assuming humans are rational though

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is the st petersburg paradox?

A

-bernoulli was interested in gambling game involving coin flipping
-you pay a fixed amount to play the game
-heads you win
-the prize on each flip is proportional to the likelihood of winning n times
-keep flipping until it comes up tails
-how much would you pay to play

-the paradox is that the expected value is essentially infinite
s-o people should be willing to pay huge sums to play but are not
-the expected value - sum the product of the probability of reward and likelihood of reward for all possible outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What relationship must we assume between value and utility to get more reasonable results?

A

a logarithmic relationship between value and utility
-have a logarithmic terms for potential gain and loss
-cost to play
and current wealth where people with more money feel the cost les for a game like this

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Since log scales are a basic feature of perceptual systems what is another example of a log scale?

A

the just noticeable difference between two stimuli varying in intensity gets larger as the value of the intensity increases
-utility is not linearly related to value

31
Q

What does it mean to estimate utility in a reference dependent way?

A

do not treat values of gains and losses as equivalent
-bad at estimating probabilites at lower end of scale

32
Q

What is prospect theory?

A

prospect theory relates subjective value or utility to objective value as a complex function
-the function is steeper below zero which means people are loss averse
-the function is slightly diffreent across individuals but general shape is the same
-subjective probability follows a weighting function

-people overestimate likelihood of infreuqenct events and underestimate likelihood of high frequency events

-to compute expected uiltiy we apply utility function and probability weighting then compute the sum of products as before

33
Q

How did tom et al investigate expected utility in the reward system?

A

presented participants with a decision on each trial
-possible win
-possible loss
-full range of win loss combinations tested
-50/50

-participants had top decide whether to accept or reject the bets on each trial
-no win loss feedback was given during the imaging session

-big win and small loss and small win and big los are easy decisions and when both the loss and win are small or large the decision is more difficult
-the loss range is smaller than win range whcih is consistent with prospect teheory

-gains half as valuable as losses so needed to gain twice more than you lose to play - people take this bet 50/50 of the time

34
Q

IN WHAT REGIONS OF THE BRAIN IS THEIR ACTIVITY RELATED TO THE REPRESENTATION OF EXPECTED UTILITY OF EACH TRIAL?

A

STRIATUM AND VENTROMEDIAL PFC
-OTHER RESEARCHERS HAVE FOUND THAT SYSTEMS INVOLVED IN NEGATUVE EMOTIONS LIKE FEAR ARE MORE STRINGLY ASSOCIATED WITH POTENTIAL LOSSES

FOUND ESTIMATED LOSS AVERSION NAD ACTIVITY IN VENTRAL STRIATUM TO BE STRONGLY CORREALTED

35
Q

What is delay disocunting?

A

people prefer the larger sum in the future but the smaller sum when it is immediately available
-there is a premium in rewards that are available immediately discount rewards that are available at a delay

36
Q

How did mcclure et al investigate the immediacy premium?

A

gave people choices that varied in delay (days to weeks to month) and value (5 dollars vs 40 dollars)
-participants told would get one choice at end of experiemtn

37
Q

what regions of the brain respond more strongly when a reward is immediately offered?

A

striatum and medial pfc - dopaminergic system

38
Q

What set of reions was sjown to have no sensitivity to imemdiacy but are strongly actuvated by the task in general?

A

-visual cortex and pre supplementary motor areas

-the lateral pfc and ofc are thought to be related to goal direction evaluation
-the posterior parietal region - aka dorsal attentional network is involved in accumulating evidence for response

39
Q

When mcclure et al focused on more difficult decisions in whcih the more delayed rewrad was 5-25% more than the less delayed reward what did they see?

A

the areas associated with goal direction value were more actuve during difficult decisions than easy decisions

40
Q

How are expected utility and surprise related?

A

evaluation involves comparison between expected and observed outcomes
-outcome evaluation is negative compared to expected utility
-expected utility or predicted reward is important - a pair of comfortable socks is better than nothing but it is less than what is hoped for

41
Q

How is expetec utility ties to activity in the vta or dopaminergic midbrain area and is behaving in accordance with the temporal difference learning function?

A

-recordings n the vta during classical conditioning (which is different from habit learning because a reward is paired with a stimulus not with a repsonse or a stimulus associated response)
-learning is about the pairing of a conditional stimulus with a primary reward which is a squirt of juice
-learning is also paired with expected value and the vta represents this

42
Q

In the neuronal recodings in vta of a monkey what was seen in actviity when there was no cs and the reward is there?

A

this is an unexpected reward the vta responds when the reward is presented

43
Q

After training the monkey as learned that the cs predicts a reward at constant delay so what is the neuronal activity seen in the vta in the monkey when there is a cs and a reward occurs?

A

-the reward signal is seen when the cs is presented there is no reward signal to the reward

44
Q

After training the monkey as learned that the cs predicts a reward at constant delay so what is the neuronal activity seen in the vta in the monkey when there is a cs and NO reward occurs?

A

if the cs is presented and the reward is withheld get response to cs but get a dip in dopaminergic activity when the reward should have occurred

45
Q

What is learning?

A

update the representation valuation and action selection processes

46
Q

What is reward learning in general driven by?

A

differences between expected and observed outcomes
-temporal dofference leanring function

47
Q

What is the temporal difference learning function?

A

reward prediction error (temporal difference) = (actual reward at this time + (discount factor * predicted reward in the future) - predicted reward at this time

IF GET NO CS AND GET A REWARD = ACTUAL REWARD IS POSITIVE PREDICTED REWARD AT THIS TIME IS ZERO AND PREDCITED REWARD IN FUTURE IS ZERO SO GET POSITIVE TEMPORAL DIFFERENCE

IF SEE JUST THE CS - ACTUAL REWARD IS ZERO PREDICTED AWARD IN THE FUTURE IS POSIITVE AND PREDICTED REWARD AT THIS TIME IS ZERO SO POSITIVE OVERALL

IF SEE CS AND REWARD - ACTUAL REWARD IS POSITIVE AND PREDCITED REWARD AT THIS TIME IS POSITIVE NEGATIVE AND PRECITED REWARD IN FUTURE IS POSITIVE

IF SEE CS AND NO REWARD - PREDCITED REWARD IN FUTURE IS ZERO AND PREDCITED REWARD AT THIS TIME IS NEGATIVE AND ACTUAL REWRAD AT THIS TIME IS ZERO - GET NEGTATIVE VALUE

48
Q

WHAT DISTRUBITED SYSTEM REFLETCS EXPECTED UTILITY?

A

DA NEURONS IN THE FRONTAL CORTEX THE MIDBRIAN AND BAAL GANGLIA

49
Q

WHAT AREAS OF THE RIAN ARE ASSOCIATED WITH COMPUTING EXPECTED UTILITY WHICH IS RATHER HABIT LEARNING OR PAVLOVIAN BASED?

A

MEDIAL PFC AND MIDBRAIN
-LOSS AND GAIN FUNCTION
-TEMPORAL DISCOUNTING

50
Q

WHAT AREAS OF THE BRAIN ARE AASSOCIATED WITH GOAL DIRECTED VALUATION?

A

LATERAL PFC

51
Q

WHAT IS REWARD LEARNING DRIVEN BY AND WHAT IS THAT DRIVEN BY?

A

REWARD LEARNING ID DRIVEN BY PREDICTION ERROR WHCIH IS DRUVEN BY SURPRISE RELATIVE TO WHAT WAS PREDICTED Y THE VALUATION SYSTEM

52
Q

When does risky decision making peak?

A

adolescence (the social capacity to engage in these behaviors also changes so there is a social component in addition to the behavioral)

53
Q

What are some attributes associated with risky decision making?

A

-facilitates independence
-encourages exploration away from caregivers
-increased rates of sexual promiscuity
-high incidence of addiction
-reckless driving

54
Q

What is the neural explanation for the risk behavior of adolescents?

A

the pfc continues to develop throughout adolesence
-this is in contrast to other brain regions which approach their adult state as measured by relative proportion of grey to white matter by late childhood

55
Q

What higher congitive functions is the pfc involved in?

A

decision making
impulse control - can have go and no go stimulus to measure impulsivity in the lab
future planning
goal directed behavior
appreciation of future outcomes

56
Q

If children have an even more less developed pfc that why do they not seek out the same risks in decision making as adolescents?

A

reward regions are hyper excoyable in adolescents

57
Q

Initial models of adolecsent behavior psoted that teens engage in risky behavior because they do not have a fully capable pfc howevre this is actually not due to insuffiecnt knowledge or intellectual abilities?

A

in laboraory studies adolesents to no differ from adults in
-knowledge of the dange of risky behavior
-ability to perceive risks
-feelings of invulnerability
-logical reasoning abilities
-psychscoial maturity is declined in adolsecnts compared to adults but intelletucal ability is the same

58
Q

What study conducted by Galvan et al showed that reward regions are hyper excitable in adolescents?

A

participants
children - 7-11
adolescents - 13-17
adults - 23-29

simple right and left perceptula decision
-difrenet pirate accessoires implicityly associated with different amounts pf reward
-some of the medial pfc and the NAcc have a u shaped developemntal function in repsonse to reward where it peaks in adolescents - this is in response to feedback about the value of the reward not the response to the cue

59
Q

How was it shown in the galvan et al study that the size of the response is modulated ore strongly by the size of the reward in adolescents than in either children or adults?

A

the loss of aversion might be weaker because the gain function is so tuned up
- adolescents have a steeper gain function than adults
-large and medium rewards gave greater response enad small reward is negatuve response

-

60
Q

What to reward responses to near misses in adults associated with?

A

the desire to continue in a gambling task

61
Q

Does reward hypersensitivity in teens extend to near misses?

A

the slot machine paradigm includes two different kinds of loss trials
-near misses XXY and full misses XYZ
-adolescents show a stronger response to reward in the striatum than either adults or children
-reward sensitivity n adolescents is often observed under conditions where adults and children show no striatal activity

response to near misses are also much stringer in adolecsents

62
Q

Why might responses to near misses being much stronger in adolescents be possibly adaptive?

A

-this is important for learning new skills or adapting to a new environment or contingencies

63
Q

How does teen drivers riskiness of death change with the passenger in the car?

A

adult decreases
other teen increases the more teens you add

64
Q

What is the stoplight driving game?

A

stoplight is 3 seconds and miss stoplight and can get no delay or get into a crash and get a 6 second delay

65
Q

What was seen in teens when it came to the eprcent of risky decision. make and the presence of a friend?

A

presence of friend led to riskies decisions and worse outcomes for teens than in young adults and adults
-friend was in the control room

66
Q

ACtivity in what region of the brain increases over development?

A

the lateral pfc increases over development irrespectuve of peers
-adolescents are less likely to activate this region at all during the task compared to young adults or adults

67
Q

In reward circuitry was there a change in adolecents in teh presence of peers?

A

yes for adolecents only the activity was greater in the presence of peers than when alone

68
Q

What are the effects of daily stress in the teenage brain?

A

teens and adults are equally stressed however better self control in adults whereas stress has a greater effect on teens self control abilities
-unde high stress adolescents are less likely too undergo successful inhibition and are more impulsive and the successful inhibition data is 1-impulsivity datar

69
Q

What is the extent of the engagement of the lateral pfc in teens versus adults under stress?

A

less engages in teens under stress for lataeral pfc than adults whcih is more engaged under stress

70
Q

What is the relevance for juvenile justice?

A

pfc cortex debelopment - teends are more vulnerbale to negatuve influences like peer pressure
-limbic circuitry development - heightened capapcity for change

71
Q

What is the relevance for mental health?

A

many mental health conditions have onset in adolesence and can be due to imbalance between subcortical and midline regions and the lateral pfc

72
Q

What does the neurobio of decision making involve?

A

-both reward driven pavlovian habit learning and goal directed valuation systems

73
Q

What does the relatuve timing of pavloviam and habit learning and goal directed habit systems inlfuence?

A

risky decision in making teens
-reward systems is u shaped function (peaks in adolescence) and pfc is linear with developemnt with age

74
Q
A

PSYC 440 (13 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions