Wk 4 - Operant conditioning Flashcards

1
Q

What is the basis of operant conditioning? (x3)

A

That consequences = change in voluntary behaviour
Rewards = increase
Punishment = decrease

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How can one punish effectively, according to operant conditioning principles? (x8)

A
No escape
No delay
As intense as possible
Continuous schedule best
Variable least effective
Over short period
No subsequent reinforcer (don’t laugh after telling them off)
Increased effectiveness by reinforcing incompatible, appropriate behaviours
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Three reward variables that act alongside schedules to affect operant conditioning are…

A

Drive
Size
Delay

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are three mechanisms of stimulus control?
Which mean it is easier to… (x1)
Eg behaviours under stimulus control… (x4)

A
Stimulus generalisation
Stimulus discrimination
Stimulus selection
Mould than create behaviour
Traffic lights, typical talking distances, buying certain brands at the shop, social drinkers/smokers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Thorndike’s cats were an investigation into… (x2)
In an experiment involving… (x1)
Which found that… (x1)

A

How animals problem solve/are subject to operant conditioning
Puzzle box - string, platform, latch in box
Eventually get out by chance, then rapid decrease in escape time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Skinner’s Box for operant conditioning experiments involved… (x4)
And had advantages over Thorndyke’s puzzle box because… (x1)

A
Cues provided by speakers, lights
A lever/button to press
Food dispenser
Shocker in floor
It could operate unattended - used for many experiments
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Three possible methods for teaching new behaviours through operant conditioning are…

A

Wait - till animal performs desired behaviour
Shaping - reward closer approximations
Chaining - link smaller behaviours into more complex than can be conditioned through shaping

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Superstitious behaviour according to Skinner/operant conditioning… (x3)

A

Random rewards = belief we are causing its arrival
So random reinforcement can shape behaviour, e.g. athletes’ rituals, lucky pants
Our nature is to try and link behaviours with expected outcomes, even if no true association exists, e.g. pushing pedestrian crossing buttons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

The three term contingency is… (x4)

A

Skinners basis for conditioning
Discriminative stimulus – sets the occasion; cue that tells what behaviour is required; the context, eg room you’re in
Operant response – behaviour animal chooses in expectation of the…
Outcome – reinforcer/punisher that follows; the consequence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Positive reinforcement in operant conditioning…

Eg

A

Adds something to the situation in order to increase behaviour
Finish homework, get ice-cream

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Negative reinforcement in operant conditioning…

Eg

A

Removes something to increase behaviour

Turning on air-conditioning removes discomfort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Positive punishment in operant conditioning…

Eg

A

Adds something to decrease behaviour

Anti-barking collars

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Negative punishment in operant conditioning…

Eg

A

Removes something to decrease behaviour

Traffic fines, time outs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Unwanted side effects of punishment according to operant conditioning principles… (x5)

A
Changes in other behaviours
Aggression 
Fear
Modelling of violence
Learned helplessness
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Schedules of reinforcement in operant conditioning may be… (x1)
Or… (plus four types)

A

Continuous (CRF) – each response; better for punishment than reinforcement
Partial (PRF)/intermittent – only some
• Fixed ration (FR) – every nth time; eg piece-rate pay
• Variable ration (VR) – on average every nth time; eg gambling; the most effective schedule
• Fixed interval (FI) – first response after n seconds
• Variable interval (VI) – on average, the first response after n seconds; eg checking the mail; more rewarding than FI

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Graphed functions for partial/intermittent reward schedules show… (x4)

A

VR = steepest, most consistent increase in responses
FR is next, with post-reinforcement pauses after each response
VI is consistent, but slower
FI is slowest, with scalloped pattern (post-reinforcemtn pause followed by slowly increasing responses)

17
Q

Which schedules of reinforcement are most efficient? (x1)

A

Ratio

18
Q

Which schedule of reward is most resistant to extinction? (x1)

A

Variable ratio, VR

19
Q

Drive in operant conditioning is… (x2)

A

A reward variable that interacts with schedules

Reinforcement depends on how much the organism wants the reinforcer - hungry or full?

20
Q

Size in operant conditioning is… (x4)

A

A reward variable that interacts with schedules
Bigger is better; but subject to diminishing returns
Acquisition is faster with large/desired reward;
But extinction is also – smaller rewards = more extinction resistance

21
Q

Delay in operant conditioning is… (x3)

A

A reward variable that interacts with schedules
Reduces effectiveness
We prefer short-term reinforcement over long term punishment (ie chocolate over weight gain)

22
Q

Stimulus generalisation in operant conditioning is… (x2)

A

Reinforced responses to one stimuli = tendency to respond similarly to similar properties
Loose degree of stimulus control

23
Q

Stimulus discrimination in operant conditioning is… (x3)

A

Degree to which antecedent stimuli set the occasion for particular responses
Precise degree of stimulus control
Taught by using discrimination training procedures such as differential reinforcement

24
Q

Stimulus selection in operant conditioning is… (x1)

A

Stimuli can become signals (can control behaviour) if they’re predictive

25
Q

Ratio in operant conditioning refers to… (x1)

And entails what two types?

A

Reinforcement based on how many times a subject responds
Fixed - based on definite number of responses
Variable - given at some point during every X responses

26
Q

Interval schedules in operant conditioning refers to… (x1)

And entails what two types?

A

Reinforcement based on the time elapsed since last reinforcer
Fixed - based on definite time period
Variable - given any time within a time period

27
Q

A young child is allowed to go outside alone to play with friends, under the condition that she checks in with her mother regularly. Her mother praises her every second time she checks in.
What reinforcement schedule is being used?

A

Fixed ratio

28
Q

Pop quizzes are a common motivator lecturers use to encourage studying material on a regular basis and for attending lectures.
Which reinforcement schedule is being used?

A

Variable interval - at some point there will be a quiz

29
Q

Playing the pokies provides payoffs on occasion, as long as the person is performing the operant response of putting money in the machine and pressing the button or pulling the lever.
Which reinforcement schedule is being used?

A

Variable ratio

30
Q

A factory worker paid for piecework (e.g., having to assemble a certain number of units to receive money)
Which reinforcement schedule is being used?

A

Fixed ratio

31
Q

Deep sea fishing rewards on which reinforcement schedule?

A

Variable interval - rewards every so often during time rod is in water

32
Q

In contrast to normal fishing, fly fishing involves frequent casting and reeling back before catching the fish. Which type of schedule is a fly fisher on? (HINT: the more you cast, the better your chances).

A

Variable ratio - reward based on indefinite number of attempts

33
Q

A salesman is paid solely on commission, what reward schedule is he on?

A

Variable Ratio (more attempts to sell = more likely that you will get paid, but still don’t know when)

34
Q

Hitchhiking is based on what reward schedule?

A

Variable interval - can’t predict how long you’ll be standing there

35
Q

An executive’s contract specifies salary increases to be negotiated every six months.
What reward schedule is this?

A

Fixed interval

36
Q

A cleaner takes a break after each floor is cleaned

What reward schedule is this?

A

Fixed ratio

37
Q

What does discrimination training teach? (x2)

A

The performance of a specific response in the presence of a specific stimulus, and not to perform that response in the presence of another stimulus.

38
Q

What is meant by stimulus control? (x2)

And what does it result in? (x2)

A
Your behaviour comes to be under the control of the stimulus
Happens when stimulus is present, doesn’t happen when absent
Generalisation within a class of stimuli
Discrimination between classes of stimuli