Unit 3 (Ch. 5)

Question 1

Another name for negative reinforcement

Answer 1

escape training

Question 2

Shaping

Answer 2

Shaping is the reinforcement of successively closer approximations of a desired behaviour.
In shaping, it is sometimes a good idea to back up– ie, to reinforce earlier approximations of the desired behaviour.

Question 3

Discrete training

Answer 3

Performance of a behaviour defines the end of a trial.
Operant training procedure.
The training procedure Thorndike used in his famous experiment with cats is best described as a discrete trial.
The dependent variable is usually related to how long it takes a participant to reach the end, the number of errors before getting there, or the number of times a behaviour was performed within the time frame.

Question 4

Positive reinforcement is also called

Answer 4

reward training

Question 5

Response deprivation theory

Answer 5

A behaviour becomes reinforcing for an organism when the organism is prevented from engaging in that behaviour at its normal frequency.
Schoolchildren are eager to go to recess because they have been deprived of the opportunity to exercise.

Question 6

Law of effect

Answer 6

The law of effect says that behaviour is a function of its consequences (behaviour changes in relation to how the consequences change)

Question 7

Notation for reinforcement

Answer 7

B–>SR

Question 8

Relative value theory

Answer 8

The reinforcement properties of an event depend on the extent to which the event provides access to high probability behaviour.
High probability behaviour can be used to reinforce low probability behaviour.
Limitation: low can be favoured if it’s what you’ve been deprived of.
Premack’s name is most logically associated with relative value theory.

Question 9

John Nevin says reinforcement gives behaviour

Answer 9

momentum

Question 10

Premack is associated with

Answer 10

Relative value theory

Question 11

Chaining

Answer 11

A chaining procedure is a series of steps to reinforce a behaviour chain. The first step is called task analysis: you break down the task into its component elements, identifying each link in the chain.
Chaining is a useful procedure for shaping behaviour in laboratory animals, and it is important in shaping the behaviour of wildlife

Question 12

Extinction procedure leads to:

Answer 12

increase in variability of behaviour, increase in irritability, short-term extinction burst increase in behaviour

Question 13

Another word for operant

Answer 13

Instrumental.

Another word for operant is instrumental (the behaviour is instrumental in producing the consequences)

Question 14

Resurgence

Answer 14

The reappearance of previously reinforced behaviour during extinction is called resurgence. (reintroduce some other thing that worked in the past- pecking if flapping on extinction)

Question 15

Sidman avoidance procedure

Answer 15

The distinctive characteristic of the Sidman avoidance procedure is that the aversive is not signalled.

Question 16

Connectionism

Answer 16

Thorndike speculated that reinforcement strengthened bonds between neurons, a view that many cognitive scientists have now embraced and called connectionism

Question 17

Contingency square

Answer 17

A contingency square is a grid with strength of behavior (x) and consequence (y) (stimulus is presented or removed) axes.
Positive Reinforcement, Positive Punishment
Negative Reinforcement, Negative Punishment

Question 18

3 essential features of reinforcement

Answer 18

behaviour must have a consequence; behaviour must increase in strength/occur more often; increase in strength must be a result of that consequence.

Question 19

Tips for shaping behaviour

Answer 19

1. Reinforce small steps
2. Provide immediate reinforcement
3. Provide small reinforcers. (Too much food takes too long to eat)
4. Reinforce the best approximation available
5. Back up when necessary

Question 20

Operant learning

Answer 20

Bevaviour operates on the environment.
Behaviour is strengthened or weakened by its consequences. The behaviour is typically instrumental in producing these consequences– so this type of learning is also called instrumental learning.

Question 21

Reinforcement

Answer 21

Reinforcement is the procedure of providing consequences for a behaviour that increase or maintain the strength of that behaviour.

Question 22

Escape training

Answer 22

Escape training is the reinforcement of a behaviour to end an aversive stimulus. For example, coming in out of the rain so you don’t get soaked.

Question 23

Avoidance training

Answer 23

What reinforces your behaviour involves preventing or postponing an aversive stimulus. This might be not going out when you see or read that it’s about to rain.

Question 24

Free operant procedure

Answer 24

A free operant procedure is associated with Skinner. The behaviour may be repeated any number of times, so there isn’t an “end” in the same way there is with a discrete trial procedure. For example, a participant may push the lever in one of Skinner’s boxes many times for food within a single session/experiment.

Question 25

Compare and contrast operant and Pavlovian conditioning.

Answer 25

In operant conditioning, a stimulus (the reinforcing or punishing consequence) is contingent on a behaviour. It usually involves voluntary behaviour.

Pavlovian conditioning involves one stimulus (the US) that is contingent on another stimulus (the CS). It mostly involves involuntary/reflexive behaviour.

Though different Pavlovian and operant experiences often happen together. The distinction is tough when, as evidenced in the case of Albert and the rat: the fact that Albert reached for the rat just before the loud noise occurred means that operative learning was involved in addition to Pavlovian conditioning.

Question 26

What are primary reinforcers?

Answer 26

Primary (unconditioned) reinforcers are those that are not dependent on their association with other reinforcers. Examples would be food, water, sexual stimulation, stimulation of the brain’s “pleasure centres”, relief from hot/cold, and certain drugs.

Question 27

What are secondary reinforcers?

Answer 27

Secondary reinforcers depend on their association with other reinforcers. Examples include praise, recognition, smiles, and positive feedback. These reinforcers are conditioned.

Question 28

What are the advantages of secondary reinforcers over primary reinforcers?

Answer 28

1. Primary reinforcers lose their reinforcing value quickly (if you’re full, hunger works less and less)
2. It’s easier to reinforce behaviour immediately with secondary reinforcers (ie clicker versus walking over with food)
3. Conditioned reinforcers are less disruptive (don’t take time)
4. Conditioned reinforcers can be used in many situations, including when subject isn’t hungry or thirsty

Question 29

What are generalized reinforcers?

Answer 29

Generalized reinforcers are those conditioned reinforcers that have been paired with a number of primary reinforcers and can be used in a variety of situations (such as money).

Question 30

What are the 2 types of chaining procedures?

Answer 30

Forward chaining is when you build each successive link in the chain as you reinforce always the furthest step in the chain. You’d start with reinforcing step 1, then when they did step 2 reinforce only when they reach that, and so on.

Backward chaining is when the training starts with the last link, and backs up to start with earlier and earlier links.

With both, if the next behaviour isn’t happening, you reinforce the closest approximation (called shaping) until they reach the full behaviour for each step.

Question 31

What conditions affect the effectiveness of a reinforcer?

Answer 31

1. size (bigger better to a point)
2. Task characteristics (some things are just harder to reinforce)
3. Deprivation level (how hungry?)
4. Prior learning
5. Competing contingencies

Question 32

Hull’s drive-reduction theory

Answer 32

Empty explanatory concept.
According to Hull, a reinforcer is something that reduces a drive. Drive’s are in effect primary reinforcers that reduce physiological needs. The problem is that there are reinforcers that don’t reduce physiological needs, but nonetheless work as reinforcers.

Question 33

2-process Theory of Avoidance

Answer 33

Both Pavlovian and operant learning are involved in avoidance learning. The escape is negatively reinforced operant learning, but eventually Pavlovian conditioning comes in, as any trigger or sign that the negative reinforcer is coming becomes the CS for fear.

Question 34

1-process Theory of Avoidance

Answer 34

One-process theory says that avoidance involves only operant learning. The reinforcer in avoidance is the reduction in exposure to the negative stimulus. Evidence for this is found in the fact that preventing both the avoidance behaviour and the consequences results in extinction of the avoidance behaviour.