Lecture 5 Flashcards

1
Q

Explain operant conditioning

A
  • S-R learning
  • stimulus that follows response
  • biologically significant stimulus which strengthens bond between S and R
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Can something be rewarding but not reinforcing?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the biologically significant stimulus associated with smoking?

A

the nicotine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are learned/conditioned reinforcers associated with smoking?

A

smell of smoke, tobacco

- not rewarding at beginning but become nice with time (associated with nicotine)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are primary reinforcers?

A

stimuli needed for survival = food, water, sex

  • sensory stimulation and novelty (novelty = reinforcing)
  • not learned (reinforcing from day 1)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are secondary reinforcers?

A
Also referred to conditioned reinforcers
- a previously neutral stimulus that acquired the capacity to strengthen S-R association because it was repeatedly paired with food, or with some other primary reinforcer
E.g. chimps pressing lever for token
token --> banana
- learned
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are social reinforcers?

A

stimuli whose reinforcing properties derive uniquely from the behaviour of other members of the same species - praise, affection, attention
- usually a blend of primary and secondary reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What type of learning is involved in shaping?

A

classical conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Explain shaping

A
  1. rat looks a lever –> click –> food (repeat)
  2. rat gets close to lever –> click –> food (repeat)
  3. rat presses lever –> click –> food
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

In shaping with rats, what is the conditioned reinforcer?

A

the click

  • happens immediately after the response
  • need a powerful stimulus to condition this reinforcer effectively
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Who created the law of effect?

A

Edward Thorndike

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Explain the law of effect

A

gradual modification of non-reflexive behaviour influenced by experience
- satisfaction “stamps in” the connection between S and R

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

In operant conditioning, a strengthened bond leads to?

A

increased frequency of behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Explain Law of effect proposed by Mark Bouton

A

Instrumental learning generally works so that organisms develop responses that maximize benefit (obtain stimuli with positive incentive value) and minimize cost (prevent stimuli with negative incentive value)

–> instrumental behaviour increases or decreases depending on the environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Obtain incentive stimulus leads to?

A

reward learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Obtain aversive stimulus leads to?

A

punishment learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Prevent incentive stimuli leads to?

A

omission learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Prevent aversive stimuli leads to?

A

avoidance learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Law of effect states:

A

A response will increase if it is followed by a satisfying outcome
- the only way we know whether the outcome is satisfying is if the response increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Explain the paradoxical reward effect

A

Removal of reward –> frequency of behaviour increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Is satisfaction a necessary component to learning?

A

No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the opposite of a positive reinforcement?

A

punishment

- decreases behaviour when presenting stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the most important aspect to learning?

A

Reinforcement

- makes a behaviour more frequent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Morphine injections - reinforcing vs. rewarding

A

No self report of pleasure but continue to respond

- therefore it isn’t rewarding but is reinforcing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is often the cause of frustration?

A

Expectation of an outcome

26
Q

What is the contiguity theory (Edwin Guthrie)?

A

operant conditioning when S, R and S* occur together in time

27
Q

Explain the stop action principle

A

any specific bodily position and muscle movements occurring when the S* is delivered will have a higher probability of occurring in the future = superstitious behaviour

28
Q

What are superstitious behaviours?

A
  • followed by a reinforcer
  • become very frequent
  • no link between behaviour and reinforcer
29
Q

What is the cognitive theory - Edward Tolman?

A

during operant conditioning, animals make S-S* associations

  • R’s are highly flexible
  • primary role of S* = motivate behaviour
30
Q

What is the reinforcement theory (B.F. Skinner)?

A

Involves a reinforcing stimulus

  • an event that enhances storage of information about situations in which it is encountered = “stamping in”
  • this increased storage increases the probability that the behaviour leading to the reinforcer will be repeated in the future (even in the absence of the reinforcer)
31
Q

What is the memory effect?

A

Explains why S is presented in the future and R is more likely to occur (strengthened bonds in brain between S and R)

32
Q

What is a reinforcer?

A

an event that follows a response and changes the probability that the response will be emitted in the future

33
Q

How can an event change behaviour when the new behaviour occurs in the absence of the event?

A

change in behaviour that outlast the reinforcer

  • memory was created
  • acting on basis of memory
34
Q

How in memory consolidation enhanced?

A

reinforcing events enhance the acquisition and storage of info in the brain

  • gives motivational value to surrounding stimuli
  • more stimuli in presence of reinforcer –> remember better
35
Q

What is learning?

A

the formation of representations of the relationships among objects and events

36
Q

What effect does a representation of a reinforcer have on behaviour?

A

it is motivating

37
Q

What is a memory trace?

A

a trace of what was just seen/performed in the brain

38
Q

When is a trace memory consolidated?

A

When it is still alive and experiences a reinforcers

  • acting on memory consolidation
  • fragile memory representation –> stable memory representation
39
Q

What factors inhibit memory consolidation?

A
  • learning other information
  • ECT
  • traumas
40
Q

What factors facilitate memory consolidation?

A
  • emotional events

- reinforcing stimuli

41
Q

Explain the Huston passive avoidance task

A

Group 1: fed in their home cage immediately after training
Group 2: fed in their home cage hours after training

  • -> Group 1 remained on the platform longer in test trial
  • food reinforcers influenced the animals behaviour by strengthening the representation of the contingent relationship between stepping down and shock
  • the animals learned nothing about the rewarding motivating properties of food
42
Q

Effect of electrical stimulation on memory consolidation

A
  • post training electrical stimulation of the reticular formation enhances retention of both appetitive/aversive tasks
  • stimulation of the MFB –> strong reinforcing properties (animals will self-stimulate these regions)
43
Q

Explain the effect of providing drugs of abuse following training

A
  • train rats on maze –> bring to a different room and induce intoxication (AFTER training)
  • wait a few days and re-test
  • post training drug –> better memory
  • dose dependent; small window for memory consolidation
44
Q

What is motivational salience?

A

importance

45
Q

Explain attribution of conditioned motivation

A

One effect of introducing a reinforcer into a learning situation is to confer motivating power (e.g. motivational salience) on previously non-motivating stimuli
- the stimulus acquires secondary reinforcing properties –> conditioned motivator

46
Q

When nicotine is removed, how long will smoking continue?

A

Cues maintain responding

  • something about the smoking behaviour, taste, smoke int he lungs –> reinforcing for a smoke
  • cues associated with nicotine become very strong reinforcers = conditioned reinforcers –> capable to maintain and attract behaviour over time
47
Q

What is the difference between wanting and liking?

A
Reward = liking 
Reinforcement = wanting (motivation - drive/energy that fuels action)
48
Q

How can liking be measured?

A

taste reactivity

  • sweet –> liking expression
  • bitter –> disliking expression
49
Q

How can wanting be measured?

A

Animal going toward something

50
Q

What is the effect of 6-hydroxydopamine lesions to the VTA (producing severe aphagia)

A

Dopamine depletion - as pathways degenerate, animal stops eating/drinking

  • stimulus is there, dopamine missing –> aren’t attracted (want is going, but liking is preserved)
  • dopamine involved in reinforcement
51
Q

Which of the following is false about operant conditioning?

  • it involves S-R associations
  • the response can be reflexive
  • it usually involves a reinforcer
  • it always involves reward
A

It always involves reward

52
Q

Which is the reinforcing stimulus in smoking?

A

nicotine

53
Q

Which of the following is true about operant conditioning?

A

stimuli are linked to responses

54
Q

Satisfaction?

A

has a questionable role in learning

55
Q

Which of the following is true about operant conditioning?

A

positive reinforcement increases behaviour

56
Q

which of the following is true?

A
  • drugs that stimulate dopamine enhance memory
  • electrical stimulation of brain dopamine is reinforcing
  • food enhances memory consolidation
57
Q

Salience

A

importance

58
Q

Conditioned

A

learned

59
Q

Attricution

A

Acquisition

60
Q

incentive stimulus

A

CS or US