lecture 3 Flashcards

1
Q

relative stimulus validity Wagner et al., 1968

A

Two groups receive the same number of exposures to the same things paired 50% with US.
The cues that accompany CS1 are manipulated:
True discrimination (TD) condition (AX+ BX-): CS2 perfectly anticipates when the US will occur
Pseudo-Discrimination (PD) condition (AX+/- BX+/-): CS2 is uncorrelated with when the US will occur
Results show that response to CS1 is greater in TD condition than PD condition which must be due to relative value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

implications of realtive value for RW 1972

A

More valid cues interfere with learning about less valid cues
There is some competition for association
Overexpectation A+ B+ ABC+
decline in responding to a pair of well established conditioned stimuli (CSs) that have been given further reinforced training in compound with each other.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

how is learning determined by the predicitve validity of cues

A

Training a cue as an inhibitor means that the expectation for an outcome is negative
Superconditioning occurs when the expectation difference is very large, for example when a stimulus is paired with something negative.
Inhibitors can be used to protect from extinction
The response is determined by what the animal already knows

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what factors of schizophrenia are linked to associative learning

A

Paranoia, interruption in the perceptual world.
Cognitive differences in learning relationships in their environment
Difficulty attending to stimuli on the basis of the meaning - learn about things that are not relevant
Amphetamine- Dopamine agonist produces symptoms
Dopamine (D2) Receptors common treatment target
They learn as well or worse in many standard situations, but with relative value they show ‘enhanced’ learning of cues that controls learn less about (ie Blocking)
Gray (1998) suggested that a failure to learn selectively may underlie disorders (e.g., psychosis, schizophrenia, anxiety).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

serra et al 2001

A

Diagnosed schizophrenics, genetic relatives or controls exposed to computer based learning tasks.
Given in a blocking group and non-blocking group stimuli
Asked to learn about different aspects of the setup
Predictiveness: regularity in blocking stream over trials (blue always followed by yellow)
When flankers are presented on blue trials they are blocked in normal individuals but not schizophrenics or relatives of schizophrenics
Demonstrating the symptoms of schizophrenia are accompanied by different learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

how can you increase learning in the case of latent inhibition according to RW

A

1)decrease the ΣV by removing cues that predict the CS or 2) increase the value of λ.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

latent inhibition

A

Once a stimulus has been learnt about as having no consequences, subsequent presentation of the stimulus having consequences results in interferences
Retardation in the learning in phase 2 if you’ve been preexposed with a different contingency
However people with schizophrenia do not show this effect
Dependent on position on schizoptipi
Low latent inhibition individuals may see relationships other people cannot see aiding creativity when it is not extreme

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Increasing the strength of the US (λ) Dickinson, Hall & Mackintosh (1976)

A

Design compares the traditional Kamin’s blocking procedure with an Unblocking procedure
Predicted that a change to the outcome should renew attention.
Whereas Rescorla-Wagner model only predicts unblocking if there is an increase in λ.
Found that blocking can be diminished by changing the salience of the outcome (by doubling or halving the outcome)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

A model of selective attention (Mackintosh 1977)

A

surprising events drive attention to CS
Suggested that alpha (α) increases if a CS predicts an otherwise unexpected event, while alpha should decrease if the CS predicts no change

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

neural evidence for a reward centre

A

Milner and Olds 1954

intracranial brain stimulation implicates dopamine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Dopmaine (Shultz 1988)

A

Shultz (1988) recorded extracellular dopamine levels and found that experience of reward or better than predicted outcome resulted in midbrain dopaminergic neurons exhibiting a phasic burst of firing
Shultz & Romo (1990) suggest two functions of the dopamine system
Phasic transmission of reward information
A tonic enabling of postsynaptic neurons (in striatum, frontal cortex and amygdala)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

where are the cell bodies of dopamine neurons located

A

mostly in the midbrain wiht axonal action in striatum and frontal cortex (Schultz, 1998)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

indiscriminative type of appetitive US

A

no prediction

reward occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

dependent on predictability: excitation A+

A

reward predicted

reward occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

depresssion of activity when no reward occurs: extinction A-

A

reward predicted

no reward occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

evidence for dopamine in learning

A

The earliest predictive cue acquires the response
Stimulus generalisation, such that training A+ and then testing AX shows a weaker dopamine signal
Novel A- exposure elicits a response as long as the animal behaviourally orients to the stimulus
With appetitive stimuli there is strong evidence of the Pavlovian ‘reward substitution’ account where it is the representation that triggers the response.

17
Q

blocking and dopamine response (Waelti, Dickinson & Shultz, 2001)

A

Used Kamin’s blocking procedure and studied single neuron responses in substantia nigra and ventral tegmental (VTA) areas
Two conditions:
Blocking: CS1 = A+ CS2 = AX+ Test X
Control : CS1 = B- CS2 = BY+ Test Y
Measure Error correction signal
X and y produce different responses suggesting dopamine is sensitive to the relative values of the cues
Evidence for blocking effect in dopamine some cell responding although some cells response is stronger than others

18
Q

inhibition and dopamine response

A

Experimental A+AX- Control BY-B- (Tobler et al., 2003)
Also picked up by reward signal
Learning and licking in response to cues
Use summation and retardation tests
Dopamine signalling shows the same effect

19
Q

optogenetics

A

Activate cells (in this case dopamine cells) in rats’ brains at certain points in time e.g during blocking procedure - expect learning when blocking design dictates that they should not be learning.

20
Q

Activated blocking in rats (Steinberg et al., 2013)

A

Single cue / compound cue / test
Single reinforced trial
Paired stimulation OR unpaired stimulation
Found effects for blocking and extinction

21
Q

Evaluation of dopamines role in learning

A

Blocking is related to learning; we have an associative theory for these effects and know (DA) neurons are involved.
However there are limitations to the account of a ‘learning signal’
Doesn’t explain negative reinforcement
Kutlu et al., 2021 argue that dopamine codes for perceived salience of alpha (α) rather than error correction (λ-ΣV).
Doesn’t explain the temporal course/ timing of activity
Redgrave & Gurney (2006_ suggest that dopamine is for preparing motor response rather than error correction
Moreover most of the effects we describe as error correction effects (e.g super-conditioning and over expectation) have not been tested.