Exam 3 Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Edward Lee Thorndike

A
  • American
  • interested in animal intelligence at end of 19th century
  • studied animal intelligence by studying animal learning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

the statement that that behavior is a function of its consequences. So called b/c the strength of a behavior depends on its past effects on the environment

A

Law of Effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does this demonstrate: a chick in a maze goes down a wrong alley (this is followed by continued hunger). If the chick goes down the right alley, it finds food.

A

Law of Effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Who was the first person to show that behavior is systematically strengthened or weakened by its consequences?

A

Thorndike

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

According to Thorndike’s Law of Effect, the strength of a behavior depends on its __________.

A

consequences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

experiences whereby behavior is strengthened or weakened by its consequences

A

operant learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Who was nicknamed the Darwin of Behavior Science?

A

B.F. Skinner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

an increase in the strength of behavior due to its consequence

A

reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

3 characteristics to qualify as reinforcement:

A
  1. a behavior must have a consequence
  2. the behavior must increase in strength (occur more often)
  3. the increase in strength must be a result of the consequence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

a reinforcement procedure in which a behavior is followed by the presentation of, or an increase in the intensity of, a stimulus

A

positive reinforcement (sometimes called reward training)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

any stimulus that, when presented following a behavior, increases or maintains the strength of that behavior

A

positive reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

a behavior is strengthened by the removal of, or a decrease in the intensity of, a stimulus

A

negative reinforcement (sometimes called escape-avoidance learning)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

any stimulus, that, when removed following a behavior, increases or maintains the strength of that behavior

A

negative reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Reinforcement _________ behavior

A

increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Positive=stimulus is _______

A

presented

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Negative=stimulus is _______

A

removed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

an operant training procedure in which performance of a behavior defines the end of the trial

A

discrete trial procedure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Thorndike used ___________ to study operant learning

A

discrete trial procedure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

an operant training procedure in which a behavior may be repeated any number of times

A

free operant procedure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Skinner used _____________ to study operant learning

A

free operant procedure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Pavlovian conditioning is sometimes called _______ learning

A

S-S

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Operant learning is sometimes called _______ learning

A

S-R-S

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

the essential elements of all operant learning, often represented by the letter ABC, for antecedent, behavior, and consequences

A

three-term contingency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Pavlovian usually includes _____ behavior, while operant usually contains _________ behavior

A

involuntary; voluntary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Overmier & Seligman study

A

Strapped dog into harness and presented a tone followed by a shock. When they put the dog in a box divided by a barrier and delivered the shock, the dog made no effort to escape. They called this learned helplessness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

any reinforcer that is not dependent on another reinforcer for its reinforcing properties

A

primary reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

a reduction in the effectiveness of a reinforcer due to exposure to or consumption of the reinforcer

A

satiation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

any reinforcer that has acquired its reinforcing properties through its association with other reinforcers (dependent of their association with other reinforcers)

A

secondary reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

any secondary reinforcer that has been paired with several different reinforcers

A

generalized reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

events that have been arranged by someone usually for the purpose of modifying behavior

A

contrived reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

events that follow automatically or naturally from the behavior

A

natural reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

when a behavior is decreased bc you got something “bad”

A

positive punishment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

when a behavior is decreased because something good was taken away

A

negative punishment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

behavior increases because you got something good

A

positive reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

behavior increases because you got rid of something bad

A

negative reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

a series of related behaviors, the last of which produces reinforcement

A

behavior chain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

in operant training, the procedure of establishing a behavior chain

A

chaining

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

the procedure of identifying the component elements of a behavior chain

A

task analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

the trainer begins by reinforcing performance of the first link in the chain

A

forward chaining

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

a chaining procedure in which training begins with the last link in the chain and adds preceding links in reverse order

A

backward chaining

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

a procedure in which a stimulus is followed by a reinforcer regardless of what the organism does. this procedure often result in the “shaping” of behavior without reinforcement

A

autoshaping

42
Q

anything that establishes conditions that improve the effectiveness of a reinforcer

A

motivating operation

43
Q

formerly reward center, the neural pathways believed to be associated with positive reinforcement. It is thought to be an area in the septal region, the area separating the two cerebral hemispheres and running from the middle of the brain to the frontal cortex (part of the thinking area of the brain)

A

reward pathway

44
Q

one of the brain’s major neurotransmitters and one source of a natural “high”. It is thought to play an important role in reinforcement

A

Dopamine

45
Q

an important neurotransmitter that is thought to be important in reinforcement

A

epinephrine

46
Q

the reappearance during extinction of a previously reinforced behavior

A

resurgence

47
Q

in Pavlovian conditioning, the procedure of repeatedly presenting a CS without the US; in operant conditioning, the procedure of withholding the reinforcers that maintain a behavior

A

extinction

48
Q

a sudden increase in the rate of behavior during the early stages of extinction

A

extinction burst

49
Q

In Hull’s theory of reinforcement, a motivational state (such as hunger) caused by a period of deprivation (as of food)

A

drives

50
Q

the theory of reinforcement that attributes a reinforcer’s effectiveness to the reduction of a drive

A

drive-reduction theory

51
Q

the observation that high-probability behavior reinforces low-probability behavior

A

Premack principle

52
Q

theory of reinforcement that considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors

A

relative value theory

53
Q

the theory of reinforcement that says a behavior is reinforcing to the extent that the organism has been deprived (relative to is baseline frequency) of performing that behavior

A

response deprivation theory

54
Q

the view that avoidance and punishment involve two procedures–Pavlovian and operant learning

A

two-process theory

55
Q

an escape avoidance training procedure in which no stimulus regularly precedes the aversive stimulus

A

Sidman avoidance procedure

56
Q

the view that avoidance and punishment involve only one procedure–operant learning

A

one-process theory

57
Q

Thorndike studied animal learning as a way of measuring animal _______.

A

intelligence

58
Q

Positive and negative reinforcement both ______ behavior

A

strengthen

59
Q

In the ______ _______ procedure, the behavior ends the trial

A

discrete trial

60
Q

The fact that Albert reached for the rat just before the loud noise occurred meant that ______ learning was involved.

A

operant

61
Q

Shaping is the reinforcement of successive ___________ of a desired behavior

A

approximations

62
Q

Weil wanted to separate the effects of ______ of reinforcement and _____ of reinforcements.

A

delay; number

63
Q

In general, the more you increase the amount of a reinforcer, the ____ benefit you get from the increase.

A

less

64
Q

Positive reinforcement is associated with the release of _____ in the brain.

A

dopamine

65
Q

The two processes in two-process theory are:

A

Pavlovian conditioning and operant learning

66
Q

a reinforcement schedule in which a behavior is reinforced each time it occurs

A

continuous reinforcement

67
Q

any of several reinforcement schedules in which a behavior is sometimes reinforced

A

intermittent schedule

68
Q

a reinforcement schedule in which reinforcement is delivered independently of behavior at fixed intervals

A

fixed ratio schedule

69
Q

a pause in responding following reinforcement; associated primarily with FI and FR schedules

A

post reinforcement pauses

70
Q

a puse that occurs following reinforcement and before a response run

A

preratio pauses

71
Q

the rate at which a behavior occurs once it has resumed following reinforcement

A

run rate

72
Q

a reinforcement schedule in which, on average, every nth performance of a behavior is reinforced

A

variable ratio schedule

73
Q

a reinforcement schedule in which a behavior is reinforced the first time it occurs following a specified interval since the last reinforcement

A

fixed interval schedules

74
Q

a reinforcement schedule in which a behavior is reinforced the first time it occurs following an interval since the law reinforcement, with the interval carrying around a specified average

A

variable interval schedules

75
Q

a reinforcement schedule in which reinforcement is contingent on the continuous performance of a behavior for a fixed period of time

A

fixed duration schedule

76
Q

a reinforcement schedule in which a behavior is reinforced the first time it occurs following an interval since the last reinforcement, with the interval varying around a specified average

A

variable duration schedule

77
Q

a form of differential reinforcement in which a behavior is reinforced only if it occurs no more than a specified number of times in a given period

A

differential reinforcement of low rate

78
Q

a form of differential reinforcement in which a behavior is reinforced only if it occurs at least a specified number of times in a given period

A

differential reinforcement of high rate

79
Q

the procedure of providing reinforcers independently of behavior

A

noncontingent reinforcement

80
Q

a reinforcement schedule in which reinforcement is delivered independently of behavior at fixed intervals

A

fixed time schedule

81
Q

a reinforcement schedule in which reinforcement is delivered at varying intervals regardless of what the organism does

A

variable time schedules

82
Q

the procedure of gradually increasing the number of responses required for reinforcement

A

stretching the ratio

83
Q

disruption of the pattern of responding due to stretching the ratio of reinforcement too abruptly or too far

A

ratio strain

84
Q

the tendency of a behavior to be more resistant to extinction following partial reinforcement than following continuous reinforcement

A

partial reinforcement effect

85
Q

the proposal that the PRE occurs because it is harder to discriminate between intermittent reinforcement and extinction than between continuous reinforcement and extinction

A

discrimination hypothesis

86
Q

the proposal that the PRE occurs because nonreinforcement frustration becomes an S+ for repsonding

A

frustration hypothesis

87
Q

the proposal that the PRE occurs because the sequence of reinforced and nonreinforced behaviors during intermittent reinforcement becomes an S+ for responding during extinction

A

sequential hypothesis

88
Q

the proposal that the PRE is due to differences in the definition of a behavior during intermittent and continuous reinforcement

A

response unit hypothesis

89
Q

a complex reinforcement schedule in which two or more simple schedules alternate, with each schedule associated with a particular stimulus

A

multiple schedule

90
Q

a complex reinforcement schedule in which two or more simple schedules, neither associated with a particular sense, alternate

A

mixed schedule

91
Q

a complex reinforcement schedule that consists of a series of simple schedules, each of which os associated with a particular stimulus, with reinforcement delivered only on completion of the last schedule in the series

A

chain schedule

92
Q

a complex reinforcement schedule that consists of a series of simple schedules, with reinforcements delivered only on completion of the last schedule in the series. The simple schedules are not associated with different stimuli

A

tandem schedule

93
Q

a complex reinforcement schedule in which reinforcement is contingent on the behavior of two or more individuals d

A

cooperative schedules

94
Q

a complex reinforcement schedule in which two or more simple schedules are available at the same time

A

concurrent schedules

95
Q

the principle that, given the opportunity to respond to two or more reinforcement schedules, the rate of responding on each schedule will match the reinforcement available on each schedule

A

matching law

96
Q

The term _____ _______ refers to the pattern and rate of performance produced by a particular reinforcement schedule.

A

schedule effects

97
Q

The rate at which a behavior occurs once it has begun is called the ___ rate.

A

run

98
Q

In ratio schedules, reinforcement is contingent on:

A

the number of times the behavior occurs

99
Q

In interval schedules, reinforcement is contingent on:

A

the behavior occurring after a given interval

100
Q

In FT and VT schedules, reinforcement in contingent on ____ rather than _____.

A

time; behavior

101
Q

The difference between multiple and mixed schedules is that in ____ schedules there is a signal that the schedule has changed.

A

multiple

102
Q

What does PRE stand for?

A

partial reinforcement effect