CHP 8 PRIMARY AND CONDITIONED REINFORCEMENT AND SHAPING

Question 1

Primary reinforcers

Answer 1

a consequence that functions as a reinforcer because it’s important in sustaining the life of the individual or the continuation of the species (helps us survive)

Question 2

Conditioned reinforcers

Answer 2

consequences that function as reinforcers only after learning occurs (Pavlovian learning)

Question 3

Why is Pavlovian learning essential to operant conditioning?

Answer 3

Pavlovian learning is necessary to transform a neutral consequence into a conditioned reinforcement

Question 4

Two kinds of contingent reinforcement learning

Answer 4

Pavlovian learning and verbal learning

Question 5

Token economy

Answer 5

created by Maxine Stitzer
a set of rules governing the deliver of response-contingent conditioned reinforcers (tokens, points, etc.) that may be later exchanged for 1+ backup reinforcers

Question 6

Pros of token economies

Answer 6

1) motivationally robust (motivation to earn tokens remains fairly constant)
2) nondisruptive (reinforcing ongoing behaviors with a token is less disruptive than a reinforcer that disrupts the performance)
3) fair compensation (easy to assign different values to different behaviors)
4) portability (tokens are portable and inc the probability that appropriate behavior will be reinforced)
5) delay-bridging (tokens given immediately bridge the delay/gap between good behavior and the backup reinforcer)

Question 7

Backup reinforcer

Answer 7

the reinforcer that is provided after the conditioned reinforcer signals the delay reduction to its delivery

Question 8

Principles of Effective Conditioned Reinforcers

Answer 8

1: Use an effective backup reinforcer (either a highly valued one, or use a token that can be exchanged for lots of different backup reinforcers)
2: Use a salient (noticeable) conditioned reinforcer
3: Use a conditioned reinforcer that signals a large delay reduction to the backup reinforcer
4: Make sure the conditioned reinforcer is not redundant

Question 9

Generalized conditioned reinforcer

Answer 9

a conditioned reinforcer that signals a delay reduction to more than one backup reinforcer

Question 10

Clickers and marking

Answer 10

Clickers use a clicking sound (a marker) that is engaged immediately following the behavior so the target behavior is more easily recognizable

Question 11

Shaping

Answer 11

differential reinforcement of successive approximations to a terminal behavior (end behavior)

Question 12

Flow

Answer 12

a state in which one feels immersed in a rewarding activity and in which we lose track of time and self

Question 13

3 response-reinforcer contingencies for flow to occur

Answer 13

1) “Goldilocks zone”
2) “proximal goals”
3) immediate task-relevant consequences

Question 14

6 principles of effective shaping

Answer 14

1) objectively define the terminal behavior
2) determine along which dimension the learner’s current behavior falls short of the terminal behavior
3) when mapping out the sequence of successive approximations, ensure that each one is neither too easy nor too difficult
4) differential reinforcement: reinforce the current response approximation and extinguish everything else, including old response approximations
5) be sure the learner has mastered each response approximation before advancing to the next one
6) if the next approximation proves too difficult (extinction occurs), lower the reinforcement criterion until responding is earning reinforcers again

Question 15

Percentile schedule of reinforcement

Answer 15

simple automated training technique incorporating the 6 principles of effective shaping (make approximation #2 60% harder than the 1st, the following approximations are calculated by discarding the oldest data points and including the new data points)

Question 16

Conditional cash transfers

Answer 16

credits signal delay reduction to all that money can buy. credits are conditional on caring for kids