Chapter 6: Operant Conditioning

Question 1

Operant behaviours

Answer 1

behaviours that are influenced by their consequences, the effects of these consequences on behaviour are called operant conditioning.

Question 2

Elicited behavior is a function of what (precedes/follows) it; operant behavior is a function of what (precedes/follows) it

Answer 2

precedes, follows

Question 3

Thorndike’s law of effect

Answer 3

the proposition that behaviours that lead to a satisfying outcome are strengthened or “stamped in”, while behaviours that lead to an unsatisfying/annoying outcome are weakened or “stamped out”

Question 4

Operant conditioning

Answer 4

the type of learning in which future frequency (or possibility) of behaviour is affected by its consequences.

Question 5

Skinner believed that behaviours can be divided into 2 categories

Answer 5

Involuntary “respondent” or Voluntary “operant”

Question 6

Involuntary (reflexive) behaviour

Answer 6

Behaviours that happen automatically/naturally. Can be classically conditioned to occur in new situations.

Question 7

Voluntary “operant” behaviour

Answer 7

Behaviours that we choose. Controlled by their consequences rather than the stimuli that precede them

Question 8

3 components of operant conditioning process

Answer 8

1. A behaviour that produces a certain consequence (ex. Lever pressing produces a food pellet)
2. The consequence that increases/decreases the probability of the behaviour that precedes it (ex. The consequence of a food pellet increases probability of rat pressing lever)
3. A discriminative stimulus that precedes the behaviour and signals that a certain consequence is now available (ex. A tone that signals the rat that a lever press will now produce food)

Question 9

Reinforcers

Answer 9

consequences that strengthen behaviour (make it more frequent)

Question 10

Punishers

Answer 10

consequences that weaken behaviour (make it less frequent)

Question 11

Example operant conditioning diagrams

Answer 11

➤ Tell a joke (R) → person frowns (SP)
➤ Lever press (R) → food pellet (SR)

Question 12

the weakening of a behaviour through nonreinforcement of a previously reinforced behaviour is called _____.

Answer 12

extinction

Question 13

what’s an example of extinction?

Answer 13

a child who has learned to whine for candy in the supermarket will eventually cease whining when behaving that way no longer results in candy

Question 14

What type of behaviour does a rat display in a Skinner box?

Answer 14

“free operant” because the rat freely responds with a particular behaviour (like pressing a lever) for food, and it may do so at any rate.

Question 15

Discriminative stimulus (SD)

Answer 15

A stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced. (A stimulus that signals the availability of reinforcement.) (ex. tone paired with food)

Question 16

three-term contingency

Answer 16

The relationship between a discriminative stimulus, an operant behaviour, and a consequence (reinforcer or punisher).

Question 17

ABC’s of the three-term contingency

Answer 17

A: antecedent event (an antecedent event is a preceding event)
B: behaviour
C: consequence

Question 18

Discriminative stimulus for punishment

Answer 18

A stimulus that signals that a response will be punished
ex: Water bottle (SDP) : Meow (R) → Get sprayed (SP)
soon cat will be scared of bottle

Question 19

discriminative stimulus for extinction

Answer 19

A stimulus that signals the absence of reinforcement

Question 20

Four types of contingencies (response-consequence behaviours)

Answer 20

positive reinforcement, negative reinforcement, positive punishment, and negative punishment.

Question 21

positive punishment

Answer 21

adding a punishment
(yelling at you)

Question 22

positive reinforcement

Answer 22

adding reinforcement
(giving you food)

Question 23

negative punishment

Answer 23

removal of certainevent following a response (considered good)
(no dessert for bad behaviour)

Question 24

negative reinforcement

Answer 24

removal of an aversive stimulus following response

Question 25

Primary reinforcer

Answer 25

An event that is innately reinforcing (like getting food)

Question 26

secondary reinforcer

Answer 26

An event that is reinforcing because it has been associated with some other reinforcer (ex. seeing a teacher who has given you lots of praise)

Question 27

Generalized reinforcer

Answer 27

A type of secondary reinforcer that has been associated with several other reinforcers. Also called a generalized secondary reinforcer
ex. money

Question 28

Intrinsic reinforcement

Answer 28

Reinforcement provided by the mere act of performing the behaviour; engaging in the behaviour is itself a reinforcer
Ex. exercise

Question 29

Extrinsic reinforcement

Answer 29

The reinforcement provided by a consequence that is external to, or additional to, the behaviour. Engaging in the behaviour does not itself function as a reinforcer for the behaviour
ex. passing an exam

Question 30

Natural reinforcers

Answer 30

Reinforcers that are typically provided for a certain behavior; that is, they are an expected consequence of the behavior within that setting.
Ex. money is a natural reinforcer for selling merchandise

Question 31

Contrived (artificial) reinforcers

Answer 31

reinforcers that have been deliberately arranged to modify a behavior; they are not a typical consequence of the behavior within that setting.
Ex. getting ice cream after studing

Question 32

Shaping

Answer 32

The gradual creation of new behavior through reinforcement of successively closer approximations to that behavior
ex. providing rat with reinforcement as he “gets closer” to pressing the lever (standing near it, facing it)
- fundamental for teaching animals tricks