Chapter 4, Exam #2

Question 1

operant (emitted) behavior

Answer 1

behavior that operate on the environment, producing consequences. is controllable by the individual (pavlova dog if it came when it called it would receive a treat)

Question 2

trial and error/success

Answer 2

in pavlonian conditioning, a test trial is the procedure of presenting the conditioned stimulus on some occasions without the unconditioned stimulus to see if learning has occurred (ringing bell without food to see if salivates)

Question 3

positive reinforcement

Answer 3

increasing behaviors by presenting stimulus (food)

Question 4

positive reinforcer

Answer 4

any stimulus that, when presented after a response, strengthens that response

Question 5

primary reinforcer

Answer 5

naturally or innately reinforcing stimuli (food water sex)

Question 6

secondary reinforcer

Answer 6

reinforcers that are dependent on their association with other reinforcers (praise, recognition, money)

Question 7

generalized reinforcer

Answer 7

secondary reinforcers that have been paired with a wide variety of primary reinforcers (money, praise)

Question 8

successive approximation

Answer 8

is a series of rewards that provide positive reinforcement for behavior changes that are successive steps towards the final desired behavior

Question 9

acquisition

Answer 9

gradual increase in responding when reinforcing stimulus follows the behavior (toilet training, pet tricks)

Question 10

spontaneous recovery

Answer 10

recurrence of an extinguished conditioned response, following a rest period

Question 11

primary drives

Answer 11

reinforcers that appeal to an animals direct physiological needs like hunger, thirst, sex, or shelter

Question 12

drive

Answer 12

motivational force, tension from unfulfilled needs

Question 13

escape conditioning

Answer 13

a type of negative reinforcement in which the animal tries to escape the noxious stimuli by performing the desired behavior after the noxious stimuli has been introduced

Question 14

reflexive behavior

Answer 14

autonomic, involuntary responses to stimuli

Question 15

law of effect

Answer 15

tany behavior that is followed by pleasant consequences is likely to be repeated, and any behavior followed by unpleasant consequences is likely to be stopped.

Question 16

negative reinforcement

Answer 16

increasing behaviors by stopping or reducing negative stimuli

Question 17

negative reinforcer

Answer 17

any stimulus that, when removed after a response, strengthens the response

Question 18

superstitious behavior

Answer 18

a form of acquisition where any increase in strength of behavior that is due to coincidental reinforcement, we may not be conscious of behavior

Question 19

chaining

Answer 19

performing behaviors in a sequence

Question 20

forward chaining

Answer 20

training first to last

Question 21

backward chaining

Answer 21

training last to first

Question 22

extinction

Answer 22

a procedure in which he reinforcement of a previously reinforced behavior is discontinued. also may be used to describe the process by which a previously learned behavior disappears as a result of non-reinforcement

Question 23

resurgence

Answer 23

return of a behavior previously extinguished following the extinction of another behavior, its not always a return to primary behavior

Question 24

secondary drives

Answer 24

reinforcers that gain their rewarding properties by being associated with primary reinforcers ( money is associated with buying food thus is a reward; food is associated with hunger)

Question 25

avoidance conditioning

Answer 25

training of an organism to withdraw from an unpleasant stimulus before it starts

Question 26

sequence of events that leads to reinforcement or punishment

Answer 26

basic UCS-UCR-CS-CR

Question 27

Why is classical conditioning termed S-S and operant conditioning termed S-R-S

Answer 27

classical conditioning is pairing 2 stimulus. operant conditioning is based upon stimulus and response

Question 28

positive reinforcement ex

Answer 28

give candy when child does chores, more likely to do chores

Question 29

negative reinforcement ex

Answer 29

remove hand from stove

Question 30

primary reinforcer ex

Answer 30

sex, food, water

Question 31

secondary reinforcer ex

Answer 31

praise, recognition, money

Question 32

positive punishment ex

Answer 32

scolding decreases fowl language use

Question 33

negative punishment ex

Answer 33

after getting in a fight with his sister over who gets to play with the new toy, the mother takes the toy away

Question 34

shaping ex

Answer 34

maria used shaping to help ally learn to feed her self independently, starting by using the spoon hand over hand, moving to touching the wrist, until ally could pick up the spoon on her own

Question 35

chaining ex

Answer 35

pilot learning hoe to land an air plain

Question 36

superstitious behavior ex

Answer 36

athletes rituals before a game

Question 37

extinction ex

Answer 37

you keep getting your dog to sit on command but you stop giving him treats so he stops listening

Question 38

spontaneous recovery ex

Answer 38

A dog responds to the command “lay down.” One day, he stops listening when told to lay down. Days later, he begins to lay down again.

Question 39

escape conditioning ex

Answer 39

you feel hot water in the shower, experience pain reaction, turn nozzle cold, remove hot water.

Question 40

avoidance conditioning

Answer 40

hear a toilet flush, turn nozzle cold in shower right away, effectively avoid the hot water

Question 41

effect on acquisition: amount of reward

Answer 41

bigger is better in terms of response speed and strength. More frequent small rewards are better than one big reward

Question 42

effect on acquisition: type of reward

Answer 42

reward preference has an impact on strength of response

Question 43

effect on acquisition: delay of reward

Answer 43

decrease speed and strength of response

Question 44

effect on acquisition: Conditioning somatic (voluntary) behavior versus autonomic (involuntary) behaviors

Answer 44

voluntary is much easier to condition than autonomic

Question 45

effect on acquisition: motivation level

Answer 45

really hungry animal learns faster than animal that isn’t hungry because they are more motivated for reward

Question 46

effect on acquisition: competing rewards

Answer 46

decrease effectiveness of a particular reward. (drug dealers rewards for selling drugs are competing with society’s reward for not selling drugs, making society’s conditioning slow and weak)

Question 47

effect on acquisition: reward contingency

Answer 47

I know its coming. Increase speed and strength of response, predictability is good. You will cut the lawn every week if you know you will get $20 rather than if you only sometimes get paid you will cut the grass less

Question 48

effect on acquisition: awareness of reward

Answer 48

not necessary for conditioning, but leads to faster conditioning. (if you know at work you are going to get a bonus when you finish a project, you might work to complete it faster)

Question 49

effect on extinction: extinction burst

Answer 49

behavior may get worse at first, but then eventually dies down

Question 50

effect on extinction: reinforcement variability

Answer 50

produces resistance to extinction

Question 51

effect on extinction: stimulus variability

Answer 51

produces resistance to extinction (extinguishing smoking habit)

Question 52

effect on extinction: response variability

Answer 52

produces resistance to extinction (extinguishing athletic skills)

Question 53

Hedonic theory

Answer 53

reinforcement strengthen behavior because it produces pleasure
problems: doesn’t adequately explain negative reinforcement and people have different ways to describe pleasure

Question 54

Drive reduction theory

Answer 54

theory says it reinforces anything that reinforces a drive (hunger, thirst, sex)
problems: reinforces do not reduce the drive, the motivation does not create states of tension, and some motivations include tension (exploration-drive) doesn’t work well in psychological states Doesn’t work in situations where drive reduction is highly unlikely

Question 55

relative value theory

Answer 55

which behavior is preferred over another, example: studying vs. getting drinks with friends? solution: study first, then go drink with friends. going to the bar acts as a reinforcement to study high value prior to the lower value
problems: how to explain some secondary reinforcers & how value is placed on something
Relative Value Theory is the best theory we have of how and why reinforcement works!

Question 56

two process theory

Answer 56

reduces the avoidance situation to an escape situation- we escape from the CS (hot water) Problems: when the CS is no longer unpleasant, the animals continue to respond with no signs of extinction.

Question 57

one process theory

Answer 57

Negative reinforcement maintains the escape behavior, and it maintains the avoidance behavior. The operant response that removes the hot water in escape conditioning also reduces the number of exposures and level of aversive stimulus. Problems: the best way to get an animal to stop avoiding situations that are no longer harmful is to prevent the behavior