Chp 7.3: Operant Conditioning 1

Question 1

Throndike’s law of effect

Answer 1

Thorndike’s concept that a response followed by satisfying consequences will become more likely to occur, whereas a response followed by unsatisfying consequences will become less likely to occur

Question 2

Skinner’s law of effect (reinforcement)

Answer 2

Skinner’s concept that any consequences of a response that increases the probability of that response, is a reinforcer. (Unlike Throndike, Skinner avoids reference to mental states)

Question 3

Skinner’s law of effect (punishment)

Answer 3

Skinner’s concept that any consequences of a response that decreases the probability of that response, is a punisher.

Question 4

operant conditioning

Answer 4

a type of learning in which behaviour is modified by its consequences, such as by reinforcement, punishment, and extinction
-For example, we learn that smiling at others is followed by a friendly greeting.

Question 5

Reinforcement (operant conditioning)

Answer 5

the strengthening of a response by an outcome that follows it

Question 6

punishment (operant conditioning)

Answer 6

a response is weakened by an outcome that follows it

Question 7

ABCs of Operant Conditioning (contingencies)

Answer 7

• antecedents (A), which are stimuli that are present before a behaviour occurs
• behaviours (B) that the organism emits
• consequences (C) that follow the behaviours.

Question 8

Identify two key differences between classical and operant conditioning

Answer 8

• In classical conditioning, the organism learns an association between two stimuli—the CS and UCS (e.g., a tone and food)—that occurs before the behaviour (e.g., salivation).
• Classical conditioning focuses on elicited behaviours. The conditioned response is triggered involuntarily, almost like a reflex, by a stimulus that precedes it.
• In operant conditioning, the organism learns an association between behaviour and its consequences. Behaviour changes because of events that occur after it.
• Operant conditioning focuses on emitted behaviours: In a given situation, the organism generates responses (e.g., pressing a lever) that are under its physical control.

Question 9

discriminative stimulus

Answer 9

an antecedent stimulus that signals the likelihood of certain consequences if a response is made
Eg. Going on red light is punished by ticket/car crash

Question 10

positive reinforcement

Answer 10

a response is strengthened by the subsequent presentation (appearance) of a (positive) stimulus

Question 11

negative reinforcement

Answer 11

a response is strengthened by the subsequent removal of a (noxious) stimulus

Question 12

operant extinction

Answer 12

the weakening and eventual disappearance of a response because it is no longer reinforced

Question 13

positive punishment

Answer 13

occurs when a response is weakened by the subsequent presentation (appearance) of a (noxious) stimulus

Question 14

Describe some disadvantages of using positive punishment to control behaviour

Answer 14

• Punishment suppresses behaviour but does not cause the organism to forget how to make the response or provide a different more appropriate response.
• Unlike reinforcement, punishment arouses negative emotions, such as fear and anger, which can produce dislike and avoidance of the person delivering the punishment.

Question 15

negative punishment

Answer 15

the removal of a (positive) stimulus following an undesired response to weaken it

(e.g., TV privileges are taken away from a misbehaving child who wants attention)

Question 16

Describe some advantages of using negative punishment to control behaviour

Answer 16

• First, although it may arouse temporary frustration or anger, it is less likely to create strong fear or even hatred of the punishing agent
• Second, physical aggression is not being modelled, so there is less opportunity for learning of aggression through observational learning

Question 17

primary reinforcers

Answer 17

positive reinforcers that satisfy biological needs, such as food and water

Question 18

secondary (conditioned) reinforcer

Answer 18

a stimulus that acquires reinforcing qualities by being associated with primary reinforcers (eg. Money)

Question 19

delay of gratification

Answer 19

the ability to forgo immediate rewards for delayed but more satisfying outcomes

Question 20

shaping

Answer 20

an operant conditioning procedure in which reinforcement begins with a behaviour that the organism can already perform, and then is made contingent (dependent) on behaviours that increasingly approximate the final desired behaviour

Question 21

chaining

Answer 21

an operant conditioning procedure used to develop a sequence (chain) of responses by reinforcing each response with the opportunity to perform the next response

Question 22

operant generalization

Answer 22

an operant response occurs to a new antecedent stimulus that is similar to the original antecedent stimulus

Question 23

operant discrimination

Answer 23

an operant response that occurs when a particular antecedent stimulus is present, but not when another antecedent stimulus is present

Question 24

Ratio schedules

Answer 24

• Number of responses determine reinforcement

- Leads to high rates of response if ratio is not too big

Question 25

Interval schedules

Answer 25

• The first response, after a time interval, produces reinforcement
• Produce moderate response rate

Question 26

continuous reinforcement schedule

Answer 26

a reinforcement schedule in which each correct response is followed by reinforcement

Question 27

partial reinforcement schedule

Answer 27

a schedule in which reinforcement follows some correct responses but not others

Question 28

fixed-ratio (FR) schedule

Answer 28

a reinforcement schedule in which reinforcement is given after a constant number of correct responses

Smallish FR produce:

• High response rates
• Little pausing

Large FR produce:
- long pauses before responding

e.g., receiving a free coffee after having your loyalty card stamped 10 times

Question 29

variable-ratio (VR) schedule

Answer 29

• Unpredictable numbers of responses required for reinforcement

Smallish VR produce:

• very high response rates
• little or no pausing

e.g., a variable and unpredictable number of responses need to occur before the slot machine pays off

Question 30

fixed-interval (FI) schedule

Answer 30

• reinforcement is available after a constant length of time
• creates graduallly-increasing response rate as time passes
  e. g., relatively little studying during the period immediately following each exam, and an increasing amount of studying as the next scheduled exam approaches

Question 31

variable-interval (VI) schedule

Answer 31

• Reinforcement is available after a changing length of time
• VI tends to produce very steady, but lowish rates of response
  eg. A course might average a quiz every two weeks, but they can occur anytime. Their unpredictable timing will produce a steadier approach to studying than regularly scheduled quizzes.