Week 1: Behaviourism: Operant Learning

Question 1

Edward Lee Thorndike (1874 - 1949)

Answer 1

He believed much of behavior could be explained by reflexes and connections, and he also acknowledged the potential role of internal mental processes (mediators) in explaining human behavior.

Question 2

Thorndike’s Puzzle Box

Answer 2

A specific apparatus developed by Thorndike to measure aspects of animal intelligence.

Question 3

Mediation

Answer 3

Key to cognitive psychology.

Internal mental events influencing behavior.

Question 4

Connectionism

Answer 4

Trial and Error Learning

Question 5

Operant Conditioning VS Classical Conditioning

Answer 5

Operant learning differed from classical conditioning in that it was based on the association, the stimulus and a response, and the subsequent outcome or reward, rather than the simple pairing of a US and a CS.

Operant Conditioning = Contingency Learning
Classical Conditioning = Contiguity Learning

Question 6

Operant Conditioning

Answer 6

Sometimes seen as an example of contingency learning, or SR learning, when a specific response is made contingent upon a specific stimulus being present.

Question 7

Classical Conditioning

Answer 7

Sometimes called contiguity learning, based on the temporal contiguity or pairing of two stimuli.

Question 8

Thorndike’s Law of Effect (operant or
instrumental learning)

Answer 8

Individuals learn over time based on the consequences of their actions.

Behaviorism was no longer just looking to explain associations between a stimulus and a response but considering the critical role of the consequences of that response for the organism and its role in future behavior.

Question 9

Positive Effect

Answer 9

Where a response led to satisfaction/reward, the same behavior was more likely to be repeated on the next occasion.

Question 10

Negative Effect

Answer 10

While the behaviors that lead to dissatisfaction were correspondingly less likely to be repeated.

Question 11

Three Term Contingency

Answer 11

Fundamental behaviorism concept that describes how a behavior is influenced by the events that precede and follow it.

Stimulus / Situation / Discriminative Stimulus / Antecedent
Response / Response / Response / Behavios
Stimulus / Effect / Reinforcer / Consequence

Question 12

Discriminative Stimulus

Answer 12

A cue or signal that indicates whether a particular behavior will be reinforced.

Question 13

Burrhus Frederick Skinner (1904 - 1990)

Answer 13

An experimental psychologist who was a famous proponent of behaviorism.

He defined and codified both the conceptual and theoretical framework of behaviorism, standardized the tools to investigate it, and defined its language.

Question 14

Operant Conditioning

Answer 14

Skinner developed a detailed categorisation system to describe different types of consequences depending on 1) whether they increased or decreased behaviour
AND
2) whether they were positively added or they were something that was taken away.

Question 15

Reinforcement (Reward)

Answer 15

An outcome that increases future behaviour

Question 16

Punishment (Threat)

Answer 16

A consequence that decreases future behaviour

Question 17

Positive Reinforcement

Answer 17

Giving or obtaining a reinforcer to increase behaviour

Question 18

Negative Reinforcement

Answer 18

A negative outcome is removed or avoided as a consequence of that behaviour

Question 19

Positive Punishment

Answer 19

Something that is added and leads to a decrease in behaviour, typically something unpleasant

Question 20

Negative Punishment

Answer 20

Taking away something pleasant to reduce behavior

Question 21

Appetitive Stimuli

Answer 21

We have an appetite for them and a biological
drive to satisfy that appetite.

Question 22

Aversive Outcome / Aversive Stimuli

Answer 22

These are consequences, such as pain, loud noise, or bitter tastes, the animal will seek to either avoid or to withdraw from, that is, to escape.

Question 23

Reinforcer / Punisher

Answer 23

Things that seem to have the ability to influence and change behaviour.

Adding or taking away any of these is a powerful determinant of learning and future behaviour.

Question 24

Power of Reinforcers

Answer 24

The strength of the reinforcer is not absolute.

Their power depends on the state of the organism at the time (i.e., food will look good if hungry instead of when satiated).

Question 25

Primary Reinforcers

Answer 25

These are so-called primary, natural, or unconditioned reinforcers.

Question 26

Secondary Reinforcers

Answer 26

These stimuli acquire reinforcing properties through association with primary reinforcers (i.e., money, praise, or tokens).

Question 27

Approach Behavior

Answer 27

This refers to an organism’s actions towards obtaining a desired stimulus or reward. It’s the behavior that brings the organism closer to the reinforcer.

Question 28

Subsequent Behavior

Answer 28

This is the behavior that follows the delivery of the reinforcer.

It has no intrinsic biological or survival value, but we find it intensely pleasurable to receive even in small amounts. However, it also seems to have an intrinsic value in itself. We like having money even when we don’t spend it.

Question 29

Skinner’s Box

Answer 29

Features of Skinner’s Box:
- A means of providing a stimulus
- A means of the animal making a response,
- A means of delivering a reinforcer or punishment
- The box is linked to a controller/computer that determines the presentation of the stimuli, controls the delivery of the reward or punishment, and records the animal’s response.

Question 30

Reinforcement Schedules

Answer 30

Determine when a behavior is reinforced

Question 31

Continuous Reinforcement (CRF)

Answer 31

Reinforcement occurs after every response.

Question 32

Intermittent/Partial Reinforcement Schedule

Answer 32

Reinforcement occurs only after some responses.

Question 33

Parameters that define the main types of schedules

Answer 33

1) Timing or quantity of responses
2) Certainty or predictability that the response will lead to reinforcement

Question 34

Ratio Schedules

Answer 34

Based on the number of responses.

Question 35

Fixed Ratio (FR)

Answer 35

Reinforcement after a fixed number of responses.

Question 36

Variable Ratio (VR)

Answer 36

Reinforcement after an average number of responses.

Question 37

Interval Schedules

Answer 37

Based on the amount of time elapsed.

Question 38

Fixed Interval (FI)

Answer 38

Reinforcement after a fixed amount of time.

Question 39

Variable Interval (VI)

Answer 39

Reinforcement after an average amount of time.

Question 40

Extinction

Answer 40

The gradual decrease and eventual cessation of a previously reinforced behavior when reinforcement is withheld.

Question 41

Extinction Burst

Answer 41

A temporary increase in the frequency or intensity of a behavior before it eventually extinguishes.

Question 42

Partial Reinforcement Extinction Effect (PREE)

Answer 42

Behaviors acquired through intermittent reinforcement are more resistant to extinction than those acquired through continuous reinforcement.

Question 43

Learned Association

Answer 43

The association between the stimulus and response is not forgotten during extinction but becomes inactive.

Question 44

Chaining

Answer 44

Linking together a series of learned responses to form a complex behavior.