PSY260 - 4. Classical Conditioning Flashcards

1
Q

Operant conditioning

A

animal learns to repeat a behaviour rewarding/avoid behaviour associated with punishment
response is the animal’s behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Discriminate conditioning

A

Animal taught to discriminate betw diff signals with great accuracy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Basis of conditioned reflex: Development of new connection in the nervous system

A

nonassociative learning: changes in neuron-capacity to accept + transfer information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Basis of conditioned reflex: Synaptic plasticity

A

short-term/long term changes in neuron structure so that it wil react differently to inputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Memory

A

ability to store what is learned or experienced + can be recalled in need

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Unconditioned reflex or inborn reflex

A

unconditioned - neurons stimulated, responding in certain way

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Memory systems: Declarative

A

easy to form and easily forgotten
facts, events
medial temporal lobe; diencephalon
declarative: picture in our mind of facts + events

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Memory systems: Nondeclarative

A

require repetition + practice over long period, but less likely to be forgotten
classical conditioning - skeletal musculature (cerebellum), emotional responses (amygdala), procedural memory - skills + habits (striatum)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

US

A

Produces natural response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

CS

A

predicts US, brain changes, triggering UR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

UR

A

natural response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

CR

A

response to CS

might become conscious reaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Appetitive

A

automatic/autonomic
When we see something we like, we associate it with time + environment conditions
US is a positive event
conditioning consist of learning to predict something that satisfies a desire/appetite

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

aversive

A

undesired stimulus
•Learning to avoid/minimize consequences of expected aversive event
•Skinners box: Administrating shocks to animals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Rescorla-Wagner model

A
V = current associative value of CS→US
Vnew = Vold + ∆V
∆V = αβ(λ – V)
α = salience of the CS 
β = strength of the US
λ = maximum associative value of the CS→how much can we associate it, to what extent is it desirable to have US
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Rescorla-Wagner model

A

Prediction error = Actual US – Expected US→Likelihoods of occurrence
Expected US - Vcs-us
if there’s predictive value of CS-US, then there is an increase in V
0 predictive value - 100 predictive value
as the # of trials increase, error reduces

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Latent inhibition

A

pre-exposure to CS with no pairing→ slower learning of CS-US relationship
easier to associate neutral stimulus if never been experienced
neutral stimulus presented randomly→ animal habituate + conditioning takes longer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Pavlovian Conditioning

A

Stimulus learning

classical: stimulus paired with natural stimulus comes to elicit response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Instrumental Conditioning

A

Response learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Instrumental behavior

A

behavior that occurs because it was instrumental in producing certain consequences
‘goal-directed’ behavior
behaviour creating association

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Skinner: Learned associations

A

-rat given stimulation: box activate when light comes on
has to press button when light is on to get food
classical: light linked with activation
operant: for it to work, has to press button

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

“Baby in a box” [crib]

A

complex behaviour made essentialy from learned associations from experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Conditioning Example

A

Injection UCS→nausea UCR
Conditioning - violence Neutral S + UCS → UCR
After conditioning: CS → CR Vomit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Fear conditioning

A

-high footshock paired with tone
tone - auditory stimulus (thalamus) - auditory cortex, both to LA in amygdala
footshock - somatosensory (thalamus) - somatosensory cortex, both to LA in amygdala
celular molecular level
high footshock paired with tone

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Fear conditioning

A

-LA (lateral) → CE (central nucleus):
→CG (freezing: encountering stimulus that predicts danger, stops to assess environment, what to do next, means hiding in wild)
→LH (blood pressure)
→PVN (Hormones)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Eye blink reflex

A

airpuff/touch with hypodermic needle

protective response difficult to habituate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Neural Model of Classical Conditioning

A

-puff of air to eye→neuron in somatosensory system - synapse P (strong) →blink
1000-Hz tone → neuron in auditory system - synapse T (weak) → blink

28
Q

Neural Model of Classical Conditioning - Eyeblink in Rabits

A

-tone predicts airpuff to eye, conditioned response that increases likelihood tone produce eyeblink
system that links two stimulus when conditioned with right timing
path through cerebella, doesn’t reach conscious level
circuit through trigeminal + inferior olive, interpositus

29
Q

Neural Model of Classical Conditioning - Eyeblink in Rabits

A

red nucleus*: traffic cop that allows autonomic response
pontine to interpositus nuclei, then trigger red nuclei
integration at interpositus + cerebella, leads to decrease in inhibition in interpositus

30
Q

Tail Shock

A

potentiation: same response to more/less neurotransmitter
continue to stimulate siphon, rapid decrease in withdrawal response - synaptic depression
presenting 2 tactile stimuli in rapid succession - stronger withdrawal response
interaction at intersection of sensory neuron
CS precedes US, augmentation of response

31
Q

Long-Term Potentiation

A

Type of synaptic learning – Synapses 1st stimulated at high frequency will subsequently exhibit increased excitability.
•Postsynaptic changes:
–Glutamate binds to NMDA + AMPA receptors
–Opens Ca2+ and Na+ channels
-more Ca + Na released in synapse
potentiation + faciliation

32
Q

Long-Term Potentiation

A

•Presynaptic changes:
–Ca2+ causes, release of NO from postsynaptic neuron.
–NO acts as a retrograde messenger, causing release of NT in bouton.

33
Q

Facilitation

A

releasable neurotransmitter pool is increased
sensitize siphonal gil withdrawal: tail stimulation is a large withdrawal
predict on coming of tail shock by touching it on siphon
habituated siphon touch paired with tail shock - sensory input on tail has effect on ability to siphon to produce large response
when timed right, change in presynaptic membrane, changes in number + readiness of ion channels to be opened

34
Q

Habituation (synaptic depression)

A

neurotransmitter pool is depleted

35
Q

Sensitization:

A

Larger neurotransmitter pool is replaced
more synaptic vesicles in position to be released
enzymatic

36
Q

Long Term Facilitation

A

-interneuron releases serotonin
get long term facilitation - presynaptic cell more neurotransmitter ready to be released
change that maintains the amount of neurotransmitter
tail shock changes nature of cell, so there is more neurotransmitter ready for a long time after association

37
Q

LONGER TERM CHANGES

A

•Changes in receptor senstivity/number, in gene transcription, in synapse number/neuron shape

38
Q

Eyeblink conditioning

A
  • Clark Hull of Yale taught his graduate students to blink in anticipation of a slap
  • tone was paired with an airpuff to the eye
  • Learned CR takes place during the warning period Provided by CS in advance of the US
39
Q

Conditioned compensatory response

A
  • Tolerance: decrease in reaction to a drug, so larger doses are required to achieve the original effect
  • Automatic compensatory responses occur primarily + body systems that have mechanism for homeostasis
  • environmental cues act like CS associated with the drug US
  • Intense craving in response to cues results from bodies conditioned compensatory response of lowering levels of brain chemicals enhanced by drug in anticipation of drugs arrival
40
Q

Extinction

A
  • combo of unlearning and learning of a new, opposing response to the CS
  • Spontaneous recovery: return of a CR after a delay, tendency of a previously learned association to reappear after a period of extinction
  • Association was dormant following extinction training, but not lost
41
Q

Kamin’s blocking effect

A

•CS must provide valuable new info that helps an animal predict the future
may not become associated if it’s usefulness has been blocked by a coworker in cue that has a longer history of predicting US
•Blocking: classical conditioning occurs only when cue is both useful + nonredundant predictor of the future

42
Q

Error correction learning

A

•Errors on each trial lead to small changes in performance that seek to reduce the error on the next trial

43
Q

The Rescorla-Wagner model

A
  • Positive prediction error: If no CS/novel CS presented followed by a US, US will be unexpected – more US than expected
  • CS-US association increase proportional to degree US is surprising: larger the error, greater the learning
  • Well-trained CS followed by expected US: no error in production, no new learning is expected
  • Negative error: if CS predicts US + US does not occur: Decrease in the CS to US Association
44
Q

The Rescorla-Wagner model

A
  1. Each CS has associative weight: value representing strength of association betw each cue + US
  2. Expectation of US based on sum of weights for all CSs
  3. Learning proportional to prediction error: actual US - expected US
    US 100 if US occurs + 0 if it does not
    We can compute amount that each cue weight will change on trial due to learning
    •If diff weight for cue for trial > zero⇒weight for cue up
    •If weight of cue < zero ⇒ weight of cue goes down
45
Q

Learning rate

A

Degree to which prediction error changes current association weights range from 0-1 + controls how much learning takes place after each trial
•Small learning rate = animal learns very slowly
•called error correction rule because over many trials of learning, reduces prediction errors

46
Q

rescorla-wagner model + blocking

A
  • By end of phase 1 - weight of light = 100 light always predicts US
  • no tone in phase 1 - weight of tone = 0
  • phase 2, tone CS + light CS presented together
  • Because weight of light = 100, prediction of US is perfect, so prediction error is 0
  • Therefore no further changes to any of the weights
47
Q

Latent inhibition

A

Rescorla Wagner model makes incorrect prediction that pre-expose group should be no different from control group at the start of phase 2, production clearly disconfirm by Lubow’s studies

48
Q

CS modulation theories

A

propose that way attention to different CSs modulated determines which of them become associated with the US
•Nicholas Mackintosh: animals limited capacity for processing incoming info⇒ paying attention to 1 stimulus diminishes ability to attend to other stimuli
•Previously conditioned stimulus derives salience from it’s past success as predictor of important events at expense of other cooccuring cues that don’t get access to limited pool of attention

49
Q

Delay conditioning

A

CS continues throughout trial + only ends once US has occurred
•delay from time of onset of CS to onset of US

50
Q

Trace conditioning

A

shorter CS that terminate sometime before onset of US, requiring animal to maintain memory trace of CS to associate with subsequently arriving US

51
Q

Interstimulus interval

A

Temporal gap betw onset of CS + onset of US

•Variations in ISI can have significant effects

52
Q

cerebellum + conditioning

A
  • Cerebellar cortex: large, drop-shaped, densely branching neurons called Purkinje cells
  • Beneath collection of cells - cerebellar deep nuclei – interpositus nucleus CS pathways from elsewhere in brain project first 2 areas + brainstem = Pontine nuclei
  • Pontine nuclei diff subregions for each kind of sensory stimulation
53
Q

cerebellum + conditioning

A
  • CS info up to deep nuclei of cerebellum along axon tracks - Mossy fibers
  • One branch makes contact with interpositus nucleus, other branch up toward cerebellar cortex, across parallel fibers + connects to dendrites of Purkinje cells
  • US pathway, air puff US activates neurons in the inferior olive – structure in lower part of brainstem – in turn activates interpositus nucleus
  • Second branch of pathway from inferior olive up to cerebellar cortex by means of climbing fibers
  • Each climbing fiber extends to + wraps around purkinje cell
54
Q

cerebellum + conditioning

A
  • Climbing Fibers have strong excitatory effect on Purkinje cells
  • To produce an eyeblink response, output from interpositus nuclear travels to muscles in the eyes to generate the eyeblink CR
55
Q

cerebellum + conditioning

A
  • 2 sites - CS + US info converge: purkinje cells in cerebellar cortex + interpositus nucleus
  • 2 sites of convergence intimately interconnected in output pathway: Purkinje cells project down to interpositus nucleus with strong inhibitory synapses
56
Q

Error correction through inhibitory feedback

A
  • Inhibitory feedback pathway projects from interpositus nucleus to inferior olive
  • Production of CR, through activation of interpositus nucleus ⇒ inhibit inferior olive from sending US info to Purkinje cells
  • Activity in the inferior oive will reflect actual US minus expected US
57
Q

Error correction through inhibitory feedback

A
  • expect inferior olive activity in response to US diminish the more the US is predicted by trained CS
  • Inferior olive activity starts off high early in training + gradually diminishes as conditioned response is acquired
  • blocking affect should depend on inhibitory pathway from interpositus to inferior Olive
  • Cerebellar to inferior oive circuit plays a role in execution of Rescorla-Wagner’s error correction rule
58
Q

hippocampus in CS modulation

A
  • Removing hippocampus eliminates latent inhibition effect in classical conditioning of rabbit eyeblink reflex
  • plays a role in determining how sensory cues processed before used by cerebellum to form long-term memory traces
59
Q

Brain rhythms and conditioning

A
  • theta state: waves of synchronized neural firing travel back-and-forth across hippocampus
  • Theta rhythm enhance learning
  • Buszsaki argues they play crucial role in communication betw Hippocampus, where memories first encoded + temporarily stored
  • hippocampus efficiently alternates between data collection [theta] + data archiving [sharp waves]
60
Q

Aplysia Conditioning

A
  • when touching siphon repeatedly paired with shocking tail ⇒ withdrawal in response to subsequent touches of siphon
  • enhanced siphon withdrawal response to touch CS following paired-training > sensitization that occurs from presentation of tail shock alone
  • Paired training produces increase in glutamate vesicles that released in siphon synapse on motor neuron
61
Q

Aplysia Conditioning

A

•Activity-dependent enhancement: Pairing specific enhancement of glutamate release + sensory neurons synapse
oDepends on activation of sensory neuron prior to administration of US
•Conditioning occurs only if siphon touch CS presented about half a second before tail shock US
•If US occurs much later or before CS, nothing other than nonspecific sensitization will occur

62
Q

Aplysia Conditioning: Activation of Aplysia’s sensory neuron

A

oCauses motor neurons to fire - release of neurotransmitter glutamate into synapse
oCauses short-term decrease in glutamate vesicles available for subsequent stimulation of sensory neuron⇒ habituation
oPrimes synapse through series of intracellular events lasting about half a second⇒ subsequent presentation of neurotransmitter serotonin creates increase in future glutamate release

63
Q

Long term structural changes and the creation of new synapses

A
  • Serotonin release by Aplysia’s interneurons launch cascade of intracellular molecular events for long term structural changes in neuron
  • Following multiple parings of CS and US, protein molecules + sensory neurons synapse travel back up axon of sensory neuron all the way to the cell body
  • They switch on genes inside nucleus of the neuron that intern set in motion the growth of new synapses
64
Q

Long term structural changes and the creation of new synapses

A
  • CREB-1: activates genes in neurons nucleus that initiate growth of new synapses
  • CREB-2: inhibiting the actions of CREB-1
  • CREB-1 impaired⇒ no long-lasting forms of associative learning
  • CREB-2 removal ⇒ long-lasting learning occurs rapidly at sensory neurons, after even a single exposure to serotonin
65
Q

Long term structural changes and the creation of new synapses

A
  • Short-term memory - temporary intracellular changes within existing anatomical pathways, including shifts in location, size/number of neurotransmitter vesicles, which alter synaptic transmission efficacy
  • Transition from short-term to long-term learning = shift from transmission-process-based changes within her on the structural changes with the neural circuits