Operant Conditioning

Question 1

Key People

Answer 1

Thorndike (puzzle box, cat, cause & effect)

Skinner (skinner box, pigeon)

Question 2

Contingencies

Answer 2

Follow a behavior and affect the likelihood of the behavior recurring

• Reinforcement: increase frequency of behavior
• Punishment: decrease frequency of behavior

Each come in two forms:
Positive—Stimulus is added
Negative—stimulus is taken away

Question 3

Operant Conditioning Theory

Answer 3

Classical conditioning was too limiting, left no room for volitional behaviors or learning from reinforcement and punishment

Question 4

Discrimination

Answer 4

Recognizing that in some situations, the same behavior will not be reinforced

Question 5

Thorndike’s Law of Effect

Answer 5

Behaviors are initially emitted in a random trial and error fashion
Random behaviors that are followed by pleasurable, beneficial consequences become stronger while behaviors followed by unpleasant consequences become weaker
Theory later revised–stopped believing that punishment would work

Question 6

All species react ________ to learning environments

Answer 6

the same

Question 7

Positive Reinforcement

Answer 7

Reward; dessert for doing your dishes after dinner

Question 8

Negative Reinforcement

Answer 8

Associated with relief, escape; you don’t have to sweep the kitchen if you do your dishes after dinner

Question 9

Positive Punishment

Answer 9

Associated with pain, something negative is introduced following behavior; you get a spanking if you do not do your dishes

Question 10

Negative Punishment

Answer 10

Associated with loss, something pleasurable is taken away following the behavior; you do not get to go to your friend’s house if you do not do your dishes

Question 11

Decoding Contingencies

Answer 11

1. Define target behavior
2. Determine what occurs after the behavior
3. Discern if the behavior is likely to increase or decrease in recurrence over time.

Question 12

Reinforcement schedule

Answer 12

Frequency with which a behavior is reinforced
A. Continuous, 1.1, type of fixed ratio; good during acquisition. Risk of satiation
B. Intermittent Reinforcement

Question 13

Reinforcement Window

Answer 13

Behavior must be reinforced within window of time between foresight and hindsight, hill example—must be able to see the reward

Question 14

Phases of New Behavior

Answer 14

1. Acquisition
2. Maintenance
3. Extinction

Question 15

Operant Strength

Answer 15

how powerful the conditioning is, strength of behavior; judged by how easily it can be extinguished

Question 16

Criteria for Intermittent Reinforcement Schedule

Answer 16

Four intermittent schedules based on two criteria

1. Predictable or not predictable (fixed vs. variable) *unpredictable is strongest
2. Occurrence of behavior or passage of time (ratio vs. Interval) *behavior occurrences is strongest

Question 17

Intermittent Reinforcement Schedules

Answer 17

1. Fixed Ratio: free cup of coffee for every five you purchase
2. Variable Ratio: slot machine (strongest)
3. Fixed Interval: Paycheck every two weeks (weakest)
4. Variable Interval: Checking your email

Question 18

Extinction in Operant Conditioning

Answer 18

Stop providing reinforcement
Length of time for extinction depends on reinforcement schedule
Response burst will be observed before extinction

Question 19

Stimulus Generalization

Answer 19

Will and Alleks (stimulus) come over and like my buffalo chicken (response) so I, MYSELF, GENERALIZE their enjoyment to ALL PEOPLE (stimulus) who come over

Question 20

Response Generalization

Answer 20

Alleks (stimulus) likes Chocolate Torte (response) so I, MYSELF, GENERALIZE the response to chocolate, and make brownies the next time she comes over

Question 21

Discrimination Learning

Answer 21

Process by which subjects learn to respond differently to different stimuli (dogs learn difference between different tones or bells)

Question 22

Prompting

Answer 22

Giving subject a cue so they can get reinforced. Prompts are slowly reduced or “faded”
Child prompted to do behavior, are reinforced; e.g. “say thank you”, “what do you say”, certain look at child

Question 23

Shaping (by successive approximations)

Answer 23

Shaping by Successive Approximation—small portions of the goal behavior are reinforced, one at a time; baby steps toward target behavior

Question 24

Chaining

Answer 24

Stringing together complex sequenced behaviors with small rewards after each step with major reinforcement reserved until final result
Classes, semesters, practicums, graduation, licensing exams,

Question 25

Superstitious Behavior

Answer 25

accidentally reinforced behaviors that are not related to successful results

Question 26

Avoidance Behavior

Answer 26

behavior that occurs before an aversive stimulus is presented and therefore prevents its delivery, e.g. turn on TV when wife gets home to avoid talking to her

Question 27

Premack Principle

Answer 27

Premack Principle—recognizes reinforcement relativity and uses high frequency behaviors to reinforce low frequency behaviors
*Easy to cheat