chapter test 5 6 & 7 Flashcards

1
Q

Behavior causation

A

ultimate causes
(evolutionary history); (learning history)

proximate causes
(current stimuli) ; (CNS)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Proximate causes

A

close in time to behavior (stimulus)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

ultimate causes

A

distant in time

(learning history)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

two types of learning histories

A

pavlovian conditioning

operant conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

learning

A

relatively permanent changes in environment behavior relations to certain types of experiences.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

classical conditioning is….

A

the conditioning of reflexes

two (or more) stimuli are paired
NS—–association— + –> UR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Any behavior that is followed by pleasant is likely to be repeated, and any behavior followed by unpleasant consequences is likely to be stopped

A

the law of Effect (Thorndike’s Law)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The Law of Effect

A

Behavior is determines its consequences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Thorndikes experiment is can be regarded as a….

A

discrete trials

trial & error vs trial & success

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

B.F Skinner

A

Operant conditioning

free operant experiment—-measuring behavior over time in restricted environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

two term contingency operant conditioning

A

R——————–S
Response——–Stimulus (consequence)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

operant behavior

A

operates on the environment, changes the environment, and is changed as a result of the environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

environment

A

all stimuli that affect behavior at any given moment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

a stimulus that follows a response and increases the probability of similar responses under similar circumstances

A

reinforcement procedure and process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

reinforcement (procedure and process)

A

a stimulus change follows a response and increases the probability of similar responses under similar circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

the procedure of reinforcement…

A

Stimulus change follows a response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

the process of reinforcement

A

increases the probability of similar responses under similar circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

one instance of behavior

A

response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

response

A

one instance of behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

increases the probability (rate or frequency, duration, magnitude etc), of similar responses (response class)

A

reinforcement process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

the reinforcer is added after the response (+)

A

positive reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

reinforcer is subtracted after the response (-)

A

negative reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

three characteristics to be called reinforcement

A

the behavior must be a consequence

the behavior must increase in strength

the consequence must be the reason it increases in strength

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

negative reinforcement is also called…

A

escape learning

avoidance learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

when the aversive stimulus is present and you do something to get rid of it

A

escape learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

when the aversive stimulus is not present yet, and you do something to avoid it

A

avoidance learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

operant conditioning association example chart

A

Kids Behavior
S(d)—-R——–S(R+)

parent’s behavior
EO/S(d)——-R—–S(R-)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

response dimension that can be reinforced

A

response rate (# of responses over time)

response magnitude (or intensity)

response duration (how long the response lasts)

response topography (form)

latency - the time a stimulus is presented and a total response occurs

reinforce randomness/variability/creativity of response (responding differently each time)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

terminology

A

reinforcement vs. reinforcer vs. reward

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

the actual consequence

–in positive reinforcement was added

–in negative reinforcement what is subtracted

A

reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

something to give to someone for a job well done

A

reward

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Unconditioned (primary) reinforcers

A

food

water

sexual arousal

sleep

warmth/coolth

pain removal

control of environment

sensory stimulation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

some_______reinforcers lose their effectiveness temporarily through_______

A

unconditioned

satiation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

conditioned (secondary) reinforcers vs generalized conditioned reinforcers

A

Conditioned reinforcers- Depends on pairing with primary reinforcers

generalized conditioned reinforcers - depend on pairing with many other reinforcers.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

3 practical advantages of conditioned (or generalized) reinforcers

A

satiation doesn’t occur

easier to reinforce immediately

less disruptive than primary reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

events that naturally follow a response

are usually not deliberately mediated by other individuals

A

automatic reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

variables that affect operant conditioning

A

contingency

temporal contiguity

reinforcer magnitude

motivating operations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

all things equal, the greater the _____________between responses and their consequences, the quicker and stronger the conditioning

A

contingency

temporal contiguity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

all things equal, the greater ___________, the quicker and stronger the conditioning (reinforcer characteristics)

A

reinforcer magnitude

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

all things equal, the lower the ____________, the quicker and stronger the conditioning (behavior characteristics)

A

response effort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

operates on the environment, changes the environment, and is changed as a result

A

operant behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

reinforcer

A

increases the probability of similar responses under similar circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

reinforcement

A

a stimulus change following a response with a consequence that results in an increase in the probability of similar responses under similar circumstances

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Conditioned reinforcers- Depends on pairing with primary reinforcers

generalized conditioned reinforcers - depend on pairing with many other reinforcers.

A

conditioned (secondary) reinforcers vs generalized conditioned reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

_______ is an equal opportunity consequence

A

reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

motivating operations

A

establishing operations
–alter the effectiveness of a reinforcer
—evoke behavior that has produced that reinforcer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

3 term contingency motivating operations

A

EO—-R—–S(R+)

EO—-R—–S(R-)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

(EO) Establishing operations

alter the effectiveness of a reinforcer

evoke behavior that has produced that reinforcer

A

motivating operations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

high probability behaviors reinforce low probability behaviors

A

Premacks’ Principle

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

considers reinforcers to be behaviors rather than stimuli and that attributes a reinforcer’s effectiveness to its probability relative to other behaviors.

A

Premack’s relative value theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

when deprived from engaging in a behavior below the baseline, engaging in it back to baseline becomes reinforcing to other behaviors

A

response-deprivation theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

selection by consequences

A

behavior like species evolves

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

reinforcement is like natural selection

A

Behavior evolves over time

behavior is inherently variable

Environment selects behavior

Behavior retention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

a procedure

the differential reinforcement of successive approximation towards a final or target behavior

A

shaping

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

shaping:

the differential reinforcement of (2 words)__________ towards or target behavior

A

successive approximation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

events that follow spontaneously from a behavior.

A

Natural reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

events that are provided by someone for the purpose of modifying behavior.

A

Contrived reinforcers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

the degree of correlation between a behavior and its consequence

A

Contingency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

A term used to refer to the strength of a reinforced behavior.

A

Behavioral momentum

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

the gap in time between a behavior and its reinforcing consequence

A

Temporal contiguity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

anything that changes the effectiveness of a con- sequence

A

Motivating operation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

The reward center of the brain, in particular, an area in the septal region running from the middle of the brain to the frontal cortex where dopamine is the most important neurotransmitter

A

Reward pathway/dopamine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

attributes a reinforcer’s effectiveness to the reduction of a drive.

A

Hull’s drive reduction theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

High-probability behavior reinforces low-probability behavior.

A

Premack principle

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

behavior becomes reinforcing when the individual is prevented from engaging in the behavior at its normal frequency.

A

Response deprivation theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

the reinforcement of successive approximations of a target (desired) behavior

A

Shaping

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

the process of reinforcing each of a series of related behaviors to form a behavior chain

A

Chaining

67
Q

procedure of breaking a task down into its component elements

A

Task analysis

68
Q

begin chaining by reinforcing performance of the first link in the chain

A

Forward chaining

69
Q

begin chaining with the last link in the chain and work backward toward the first component (link)

A

Backward chaining

70
Q

A series of related behaviors, the last of which produces reinforcement

A

Behavior chain –

71
Q

a situation in which reinforcement is available but the behavior necessary to produce it is not

A

Problem

72
Q

the response that produces reinforcement

A

solution

73
Q

a sudden appearance of the solution (in the mind?)

A

Insight

74
Q

novelty

A

Common feature (of creativity)

75
Q

Common feature (of creativity)

A

novelty

76
Q

any behavior that occurs repeatedly even though it does not produce the reinforcers that maintain it

A

Superstitious behavior

77
Q

The tendency to give up on a problem as a result of previous exposure to insoluble problems

A

Learned helplessness

78
Q

The tendency to persist at a problem as a result of previous reinforcement of persistence at difficult problems

A

Learned industriousness

79
Q

a procedure in which a sequence of responses that make up a more complex chain is reinforced

A

chaining

80
Q

a series of responses that occur consecutively

A

behavior chain

81
Q

Behavior chain example chart

A

conditioned reinforcement S(D)——R—->S(r+)

Unconditioned reinforcement
S(D)——-R——–S(R+)

82
Q

Chaining

A
  1. construct a task analysis (TA): breakdown all steps of behavior chain
  2. reinforce one response in the chain at a time until it occurs, then reinforce when two responses occur, then when three

Two chaining procedures
—forward chaining
—backward chaining

83
Q

when there is a reinforcer available but no behavior available to produce the reinforcer

A

problem

84
Q

the response that produces the reinforcement

A

solution

85
Q

the use of imaginations or orignal ideas

reification–making something abstract concrete or real

A

creativity

86
Q

randomness (a dimension of behavior)–can be reinforced

A

novelty

87
Q

based on the definition of (reinforcement),

why does it seem absurd that reinforcement can increase novel behavior?

A

similarity is random

88
Q

as acquisition of behavior

A

Most people use the term learning

89
Q

changes in which no new behavior occurs

changes in the pattern of behavior

A

Learning includes

90
Q

rules describing the contingency between behavior and reinforcement

A

Schedule of reinforcement

91
Q

distinctive patterns of behavior (produced by different schedules)

A

Schedule effects

92
Q

a behavior is reinforced every time it occurs (or every response produces a reinforcer)

A

Continuous schedule (of reinforcement

93
Q

reinforcement occurs for some responses but not others.

A

Intermittent schedule

94
Q

Four simple schedules of reinforcement

A

FR - Fixed Ratio

VR - variable ratio

FI - Fixed interval

VI - variable interval

95
Q

reinforcement occurs after a set (or fixed) number of responses.

A

Fixed ratio

96
Q

reinforcement occurs after an average number of responses

A

Variable ratio

97
Q

reinforcement occurs after the first response after a set (or fixed) amount of time.

A

Fixed interval

98
Q

a pause after reinforcement

A

Post-reinforcement pause

99
Q

reinforcement occurs after the first response after an average amount of time.

A

Variable interval

100
Q

the rate at which behavior occurs once it has resumed following reinforcement

A

Run rate

101
Q

reinforcement is withheld from a previously reinforced behavior (or a schedule which no responses are reinforced)

A

Extinction

102
Q

a sudden increase in the response dimensions of a behavior when reinforcement is withheld

A

Extinction burst –

103
Q

the reappearance of previously reinforced behavior

A

Resurgence

104
Q

the sudden reappearance of behavior following extinction and a period of time

A

Spontaneous recovery

105
Q

other simple schedules

A

FT - fixed time

VT - variable time

FD - fixed duration

VD - variable duration

progressive ratio schedule

break point

106
Q

reinforcement is delivered after a fixed amount of time regardless of what behavior occurs

A

fixed time

107
Q

reinforcement is delivered after an average amount of time regardless of what behavior occurs

A

Variable time

108
Q

reinforcement is contingent on the continuous performance of a behavior for a fixed period of time

A

Fixed duration

109
Q

reinforcement is contingent on the continuous performance of a behavior for an average period of time

A

Variable duration

110
Q

the requirement for reinforcement increases in a predetermined way following each reinforcer

A

Progressive ratio schedule –

111
Q

the point which behavior stops on a progressive schedule

A

Break point

112
Q

the procedure of gradually increasing the number of responses required to reinforcement

A

Stretching the ratio

113
Q

the disruption of the pattern of responding due to stretching the ratio too abruptly

A

Ratio strain

114
Q

6 types of complex schedules

A

multiple schedules

mixed schedules

chain schedule

tandem schedule

cooperative schedule

concurrent schedule

115
Q

two or more simple schedules alternate each associated with a particular stimulus

A

Multiple schedule

116
Q

two or more simple schedules alternate with neither associated with a particular stimulus

A

Mixed schedule

117
Q

reinforcement is delivered contingent on the completion of the last in a series of schedules each associated with a different stimulus

A

Chain schedule

118
Q

Reinforcement is contingent on the completion of a last in a series of schedules none of which is associated with a particular stimulus

A

Tandem schedule

119
Q

reinforcement is dependent on the behavior of two or more individuals

A

Cooperative schedule

120
Q

two or more schedules are available simultaneously

A

Concurrent schedule

121
Q

the tendency of behavior to be more resistant to extinction following intermittent reinforcement than continuous reinforcemen

A

Partial reinforcement effect

122
Q

the principle that the rate of responding on two or more reinforcement schedules will match the rate of reinforcement on each schedule

A

Matching law –

123
Q

the rules describing the contingencies change systematically

A

progressive schedules

124
Q

schedules in which the requirement for reinforcement increases in a predetermined way

A

progressive ratio schedule

125
Q

the rate of responding (# response/times)

the pattern of responding

A

schedule effects

126
Q

five schedules of reinforcment

A

Continuous schedule
1.CRF (FR1) - continuous reinforcement

Intermittent schedules
2. FR - fixed ration
3. VR - variable ratio

interval schedules
4. FI - fixed interval
5. VI - variable interval

127
Q

leads to fast aquisition of response

high response rate

good to use when shaping/teaching new behavior

A

CRF characteristics

128
Q

CRF is the same as….

A

FR- 1 (fixed ratio of 1)

129
Q

a fixed or set number of response is reinforced

A

fixed ratio

130
Q

the two effects of schedules that we are going to look at…

A

rate and pattern of responding

131
Q

characteristics of FR schedules

A

high response rate
–overall rate
–run rate

break and run pattern of responding

132
Q

break and run =…..

A

pause and respond

133
Q

why is there a pause____

A

there is a relationship to amount of effort and the lenght of the pause

pre-ratio pause

post reinforcement pause

134
Q

the rate of response which includes the pauses -r/t

A

overall rate

135
Q

the rate minus the pauses -r/t-prp

A

run rate

136
Q

an average number of responses is reinforced

A

variable ratio

137
Q

total responses divided by number of total reinforcers, (or)

sum of individual FR values divided by the total FR schedules

A

VR - variable ratio

138
Q

characteristics of VR schedules

A

high, steady response rate

no PRP, except when there is no low FR in the series

139
Q

high, steady response rate

no PRP, except when there is a low FR in the series

A

characteristics of VR schedules

140
Q

generates persistent behavior

A

VR Schedules

141
Q

the first response that occurs after a specific interval produces reinforcement

A

FI - fixed interval schedules

142
Q

After every minute minute, the first response is reinforced

A

FI - 1 min

143
Q

Moderately high response rate

A scalloped shaped curve pattern

A

FI - characteristics

144
Q

FI - characteristics

A

Moderately high response rate

Scallop-shape curve pattern

145
Q

the number of response over time

A

rate

146
Q

the first response after an average amount of time produces reinforcement

A

VI - variable interval

147
Q

characteristics of VI - variable interval schedule

A

low, steady rate of responding

consistent responding with few or very short pauses

148
Q

VR schedule examples

A

sales person working on commission

gambling

pick up lines

applying for jobs

149
Q

VI - variable interval real-life examples

A

refreshing your new social media app

checking emails

fishing

150
Q

FR schedule real life examples

A

assemble 10 beams for fence and your done for the day and get paid

passcode on phone: FR 4/6 for 4/6 code password an so on

151
Q

a schedule in which 0 reinforcers are delivered for responding

a schedule in which no response produces a reinforcer

witholding ____________( from a previously_________ behavior

A

extinction

reinforcement

reinforced

152
Q

extinction Burts

decrease in the probability of similar responses under similar circumstances

A

extinction effects

153
Q

momentary (immediate) increase in..

response rate

magnitude

duration

variability - shaping

emotional responding

A

extinction burst characteristics

154
Q

the _______ of extinction depends on the _________ of reinforcement for the ___________ behavior

A

rate

history

extinguished

155
Q

the rate of extinction depenents on the history of reinforcement for the extinguished behavior

A

frequency of reinforcement

magnitude of reinforcement

response effort

schedule of reinforcement

156
Q

extinction will proceed faster if….

A

the frequency and magnitude of reinforcement and a response effort are low, and the schedulee is a CRF

157
Q

behavior on an intermitten schedule is more diffiuclt to extinguishe than one on CRF

A

PRE - partial reinforcement extinction effect

158
Q

response-independent schedules

A

FT - fixed time schedule

VT - variable time schedule

159
Q

stimulus that has been shown to be a reinforcer is delivered after a fixed amount of time

A

Fixed time (FT)

160
Q

A stimulus that has been shown to be a reinforcer is delivered after an average amount of time

A

Variable time

161
Q

Two or more simple schedules are combined.

A

Compound Schedules

161
Q

Two or more simple schedules, each associated with a different stimulus, are completed sequentially

A

Chain Schedule

162
Q

Two or more simple schedules, not associated with different stimuli, are completed sequentially.

A

Tandem schedule

163
Q

Spontaneous_____ after ________ and a period of _________, the extinguished behavior__________ under similar circumstances

A

recovery

extinction

time

recovers

164
Q

gradually increasing the number of responses required for reinforcement (shaping response rate)

A

stretching the ratio

165
Q

rapid increase in the response requirement

A

ratio strain