Stimulus Control

Question 1

The Three-Term Contingency

Answer 1

A (antecedent) : B (behavior, response) -> C (outcome, either reinforced or punished)

Question 2

Antecedent

Answer 2

stimuli, events, situations, or circumstances that are present when it occurs or were preset immediately before the behavior

Question 3

• Antecedents (aka controlling stimuli)

- Controlling Stimulus (S):

Answer 3

• any type or events that changes the probability of an operant behavior
• two types of consequents controlling stimuli: reinforcers and punishers

Three types of antecedent controlling stimuli: S^D, S^(delta), S^(ave)

Question 4

-Discriminative Stimulus (S^D)

Answer 4

-a stimulus that precedes an operant and sets the occasions for its reinforcement

Question 5

-Extinction Stimulus (S^(delta))

Answer 5

• a stimulus that precedes an operant and sets the occasion for its non-reinforcement
• Pronounced S-Delta

Question 6

-Discrimination occurs when

Answer 6

the presence (or absence) of stimuli is the occasion on which a response will be followed by reinforcement

• note: “setting the occasion for reinforcement” is a description of a environmental contingency
• e.g., key pecking reinforced when the green light is on. The green light IS the occasion when pecking will be reinforced

Question 7

-discrimination refers to

Answer 7

the effect an occasion setting contingency has on behavior

i. e., refers to the effect of the response being more likely to occur in the presence of the S^D than its absence
- e.g., the bird eventually only pecks the hey when the green light is on

Question 8

Controlling Stimuli

-stimulus control:

Answer 8

• a change in operant behavior that occurs when either a S^D or S^delta is presented
• we might is say:
• the light is functioning as a discriminative stimulus
• the pigeon is discriminating the two situations
• the light has acquired stimulus control over the pigeon’s behavior

Question 9

Controlling Stimuli can be Complex

Answer 9

-hockey defenseman making the decision of who to pass to, speed of pass, who can he pass to, who is covered

Question 10

The Stroop Effect

Answer 10

-saying the font color of the word (which is the name of a color)

Question 11

The Discrimination Index

Answer 11

a measure of the stimulus control exerted by a S^D or S^DELTA

Question 12

the larger the difference between he stimuli

Answer 12

the easier it is to discriminate

Question 13

Differential Outcomes Effect (DOE)

Answer 13

• discrimination training proceeds more rapidly when different behaviors produce different reinforcers
• tone click signaled which lever to press for food

Question 14

Stimulus Generalization

Answer 14

“The tendency for behavior to occur in situations different than the one on which the behavior was learned” (Paul Chance)

• generalization and discrimination refer to the precision of stimulus control
• discrimination is precise control
• generalization is less precise control
• generalization is obtained by training in a wide array of settings/stimuli

Question 15

Concept Formation

Answer 15

• teaching Pigeons the “concept” of human
• Concept Formation is the:
• the generalization within classes of the stimuli
• the discrimination between classes stimuli
• “Strictly speaking, one doesn’t have a concept, just as one does not have extinction – rather, one demonstrates conceptual behavior by acting in a certain way”

Question 16

-Natural Selection:

Answer 16

here’s always variation within species, making survival more likely depending on location and environment

Question 17

-Artificial Selection (selective breeding)

Answer 17

-domestic animals, fish, livestock. Breeding animals on characteristics in which they find favorable

Question 18

-Shaping (behavioral shaping)

Answer 18

• differential reinforcement of successive approximations of a target behavior
• e.g., Training a rat’s lever press
• reinforce when it approaches lever
• reinforce sniffing lever
• reinforce when paw touches
• reinforce a full depression of the elver
• Note: extinction of earlier steps can aid shaping because of the increased variability extinction produces

Question 19

Marking the Behavior

Answer 19

“clickers” are sued so that an immediate conditionally reinforcing consequence is provided

Aids learning by providing immediate reinforcement and preventing accidental reinforcement of other behaviors

Question 20

Tips for Shaping

Answer 20

• reinforce in small steps
• using continuous reinforcement
• immediately reinforce
• provide small (or conditional) reinforcers
• prevents satiation
• keeps focus on task
• skip ahead when possible
• back up when necessary
• following successful; shaping, move to intermittent schedules of reinforcement

Question 21

Shaping of Motor Conditioning

Answer 21

• like shooting a basketball, we can shape our technique to increase our skill
• sensory and motor processes and constantly being shaped
• pairs of kittens raised in darkness
• apparatus was their first visual experience
• only the active (moving) kitten was able to pass visual-motor coordination tests despite both being exposed to the same stimuli

Question 22

Shaping of Motor Conditioning

Answer 22

• like shooting a basketball, we can shape our technique to increase our skill
• sensory and motor processes and constantly being shaped
• pairs of kittens raised in darkness
• apparatus was their first visual experience
• only the active (moving) kitten was able to pass visual-motor coordination tests despite both being exposed to the same stimuli

Question 23

Superstitious Behavior

Answer 23

• behavior that occurs even though it does not produce the consequence
• by-product of accidental reinforcement
• negatively reinforcing escape behaviors
• Human laboratory examples
• Catania and Cutts (1963)
• Wagner and Mirris
• Bruner and Revusky (1961)

Question 24

Insightful Problem Solving

Answer 24

-some believe that behaviorism cannot account for the “eureka” moment

Question 25

Insight of History of Reinforcement?

-Epstein, Kirshnit, Lanza and Rubin (1984)

Answer 25

• behavior emerged only when trained to
  1. push box to various locations when trained to
• pushing was extinguished in absence of green spot
  2. climb box and peck

Note: the birds were not trained to push the box towards to banana

-Four other training variations resulted in the bird not completing the task

Question 26

Self-Concept

Answer 26

-can we show the proof of a self-concept, how do we define

Question 27

Creativity (i.e., Behavioral Variability)

Answer 27

• some researchers have argued that reinforcement produces response stereotypy
• original task (scawartz, 1982)
• get the red square to tithe bottom right corner
• only allowed to press each key for times
• problems with the original task
• the task is constrained by 4 responses on each key
• 5 presses resulted in a time-out from reinforcement (negative punishment)

Question 28

-Page and Neuringer (1985)

Answer 28

• Conditions
• reinforcement was contingent on a novel pattern
• reinforcement was not contingent on novel patterns
• Result
• when reinforcement was contingent on novel responding, behavioral variability was substantially high
• Conclusion
• variability is a dimension of behavior that can be reinforced
• reinforce creative behavior and not just performance of a task
• Caution
• some studies claim to reinforce creativity but haven’t actually made the reinforcement contingent on the creative novel behavior
• they just reward performing the task and claim they have rewarded creativity
• often used as “evidence” that reinforcement inhibits creativity

Question 29

Verbal Behavior

Answer 29

-function of language vs the from it takes, objectives conditions that influence a speaker and listener in their environment