Chapter 6: Operant Conditioning - Introduction Flashcards

1
Q

Operant Behaviors

A

Behaviors that are influenced by their consequences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Operant Conditioning

A

A type of learning in which the future probability of a behavior is affected by it’s consequences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Operant Conditioning is also known as…

A

Instrumental conditioning, because the response is instrumental in producing the consequence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Who founded the “Law of Effect”?

A

Edwin L. Thorndlike

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the “Law of Effect”?

A

The law of effect indicates that behavior leading to a satisfying state of affairs are strengthened, while unsatisfying state of affairs are weakened.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

According to Thorndlike and his Law of Effect, behaviors that worked were…

A

stamped in.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

According to Thorndlike and his Law of Effect, behaviors that did not work were…

A

stamped out.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does Skinner’s theory of operant conditioning compare to evolution?

A

In evolution, genes are passed down to future generations if the the organism determines the genetic trait will help the organism live longer. In operant conditioning, favorable behaviors will continue and unfavorable behaviors will not.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

“Free Operant” Procedure

A

Subjects feely responds with a particular behavior for consequences and may do so at any rate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Operant behaviors are influenced by their _________

A

consequences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Elicited behavior is a function of what (precedes/follows) it; operant behavior is a function of what (precedes/follows) it.

A

precedes

follows

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Respondent behavior is ________ in nature and controlled by ____.

A

involuntary

stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Operant behavior is _______ in nature and controlled by _____.

A

voluntary

consequences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Who founded the Free Operant procedure?

A

B. F. Skinner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the components of operant conditioning?

A
  1. A response the produces a certain consequence.
  2. A consequence that serves to either increase or decrease the probability of a response that preceded it.
  3. A discriminative stimulus that precedes the response and signals that a certain consequence is now available.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Why is operant behavior defined as a class of responses and what does that mean?

A

Operant behaviors are not defined by specific responses, rather, operant behaviors are defined by all responses that are effective in reaching the consequence.
A rat can press a lever many times to get food; operant behavior does not determine how much pressure or which paw triggers the lever.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Classically conditioned behaviors are _____ by stimulus, where as operant behaviors are ____ by organisms.

A

elicited

emitted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the difference between Thorndlike’s Law of Effect compared to Skinner’s Operant Conditioning?

A

Skinner’s concept of operant conditioning avoid the speculation of internal state of affairs. Rather, Skinner emphasizes the effect of the consequence on the future probability of the behavior increasing or decreasing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Operant responses are also called…

A

operants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is a reinforcer?

A

A reinforcer is a consequence that strengthens a behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is a punisher?

A

A punisher is a consequence that weakens a behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

A reinforcer (follows/precedes) a behavior and (increases/decreases) the future probability of that behavior.

A

follows

increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

A punisher (follows/precedes) a behavior and (increases/decreases) the future probability of that behavior.

A

follows

decreases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the abbreviation for reinforcer?

A

S^r

Which means reinforcing stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the abbreviation for punisher?

A

S^p

Which means punishing stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Are animals and humans reinforced or punished, or are there behaviors?

A

The BEHAVIOR of animals and humans are reinforced/punished.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the difference between reinforcer/punisher and reinforcement/punishment?

A

Reinforcers and punishers are the specific consequence used to strengthen or weaken a behavior.

Reinforcement and punishment refer to the process/procedure by which a certain consequence changes the behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Reinforcers and punishers are defined by their _____ on behavior.

A

effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is the importance of defining a consequence by their effect on behavior?

A

The definition of pleasant and unpleasant can vary for each subject. A punisher for one subject can be a reinforcer for a different subject.

30
Q

What is extinction in regards to operant conditioning?

A

Extinction is the weakening of a behavior through non-reinforcement of a previously reinforced behavior.

31
Q

_____ tends to be (fast/slow) compared to punishment.

A

Extinction

slow

32
Q

Discriminative Stimulus

A

A stimulus in the presence of which responses are reinforced and in the absence of which they are not reinforced.

33
Q

What is the abbreviation for discriminative stimulus?

A

S^d

34
Q

Discriminative stimuli is said to “_____ the _______” for the behavior, meaning that it’s presence makes the behavior (more/less) likely.

A

Set the occasion

more

35
Q

What is the three-term contingency?

A

Discriminative stimulus + Operant behavior + Consequences

36
Q

What is the A-B-C sequence of the three-term contingency?

A

Antecedent - Behavior - Consequence

37
Q

Another way to think about the three-term contingency is to ______ something, ______ something, and ______ something.

A

notice

do

get

38
Q

Discriminative Stimulus for Punishment (S^dp)

A

A stimulus that signals that a response will be punished.

39
Q

Discriminative Stimulus for Extinction (S^delta)

A

A stimulus that signals the absence of reinforcement.

40
Q

What are the similarities between operant and classical conditioning?

A

Operant conditioning and classical conditioning can overlap that a particular stimulus can act as both a discriminative stimulus and a conditioned stimulus.

41
Q

What is the conditioning sequence for classical conditioning?

A

Stimulus-stimulus-response (SSR)

42
Q

What is the conditioning sequence for operant conditioning?

A

Stimulus-response-stimulus (SRS)

43
Q

What are the four types of contingencies?

A
  1. Positive Reinforcement
  2. Negative Reinforcement
  3. Positive Punishment
  4. Negative Punishment
44
Q

What does the term “positive” regard when paired with reinforcement or punishment?

A

Positive indicates when something has been added or presented.

Pleasant example - Receiving a compliment
Unpleasant example - Being yelled at

45
Q

What does the term “negative” regard when paired with reinforcement or punishment?

A

Negative indicates when something has been removed.

Pleasant example - Dessert is taken away
Unpleasant example - Person stops yelling

46
Q

Positive Reinforcement

A

Presentation of a stimulus following a response, which then leads to an increase in the future strength of that response.

47
Q

Negative Reinfocement

A

Removal of a stimulus following a response, which then leads to a decrease in the future strength of that response.

48
Q

What is an example of escape behavior?

A

Turning the heat off when you get too hot

49
Q

What is an example of avoidance behavior?

A

Using an umbrella before it starts to rain.

50
Q

Escape Behavior

A

The termination (stopping) of an aversive stimulus.

51
Q

Avoidance Behavior

A

Occurs before the aversive stimulus is presented and prevents it’s delivery.

52
Q

Positive Punishment

A

Presentation of a stimulus following a response, which leads to a decrease in the future strength of that response.

53
Q

Negative Punishment

A

Removal of a stimulus following a response, which leads to a decrease in the future strength of that response.

54
Q

The more (immediate/delayed) the reinforcer, the stronger it’s effects on the behavior.

A

immediate

55
Q

Define this behavior contingency.
Molly loses her glasses while playing at the park. Her parents spank her for being careless. Molly is less likely to lose her glasses in the future.

A

Positive punishment

56
Q

Define this contingency.
When getting a shot at the doctor’s office, Sean is asked to stay still. After staying still for the shot, Sean is given a lollipop for good behavior. Sean will most likely stay still for shoots in the future.

A

Positive reinforcement

57
Q
Define this contingency.
A teacher tells her bored class that if everyone participates during the discussion, she will let them out early for recess. The children happily participate in order to get out of the boring class early.
A

Negative reinforcement

58
Q

Define this contingency.
Jessica used to tease Gabrielle, making her cry. Lately Gabrielle has not been affected by Jessica’s teasing and she no longer responds with tears. Jessica is less likely to tease Gabrielle in the future.

A

Extinction

59
Q

Define this contingency.
Mitch plays roller hockey in front of his neighbor’s house. In a goal attempt, his hockey puck breaks the neighbor’s window. His father yells at him and demands that he take on an afterschool job to earn the money to replace the neighbor’s window. Mitch is less likely to play hockey in front of the neighbor’s house in the future.

A

Negative punishment

60
Q

The effectiveness of delayed reinforcers in humans largely depends on _____ or ________ to bridge the gap between the behavior and the delay.

A

rules

instructions

61
Q

It has been suggested that delayed reinforcers (do/do not) function in the same manner as immediate reinforcers.

A

do not

62
Q

Primary Reinforcer (aka Unconditioned Reinforcer)

A

An event that is innately reinforcing.

Born to like; i.e. food, water, etc.

63
Q

Secondary Reinforcer (aka Conditioned Reinforcer)

A

An event that is reinforcing because it has been associated with some other reinforcer.

Learn to like; fine clothes, nice car, etc.

64
Q

A (CS/US) that has been associated with an appetitive (CS/US) can serve as a secondary reinforcer for an operant response. As well, a stimulus that serves as a(n) _________ for an operant response can also serve as a secondary reinforcer for some other response.

A

CS

US

discriminative

65
Q

Intrinsic Reinforcement

A

Reinforcement provided by the mere act of performing the behavior.

66
Q

Extrinsic Reinforcement

A

Reinforcement provided by some consequence that is external to the behavior.

67
Q

In what ways can an external rewards negatively impact intrinsic motivation?

A

The the reward is expected, tangible and given for performance rather than quality.

68
Q

Natural Reinforcers

A

An expected consequence of the behavior such as money from selling something or the light turning on after flipping a switch.

69
Q

Contrived (or Artificial) Reinforcers

A

Reinforcers that have been deliberately arranged to modify a behavior.

70
Q

In applied behavior analysis, although one might initially use (contrived/natural) consequences to first develop a behavior, the hope is that the behavior will become “trapped” by the ________ consequences associated with that behavior.

A

contrived

natural

71
Q

What is shaping?

A

Shaping is the gradual creation of new behavior through reinforcement of successive approximation to the ideal behavior.