W8 Learning 2: Operant conditioning

Question 1

Action outcome framework

Answer 1

Classical and operant conditioning are experimental paradigms that have lead to highly influential frame-work for associative learning.

Question 2

Classical conditioning (pavlov)

Answer 2

stimulus-response-associations. Involves the pairing of two stimuli. Conditioning stimulus (CS) and Unconditioned Stimulus (US), US is associated with a hardwired response. Response becomes associated with the CS-through conditioning. CS and US can be temporally segregated or overlapping.

Question 3

Operant (instrumental) Conditioning

Answer 3

US is contingent on behaviour of animal (e.g., only occurs when a lever has been pressed), need for action. Action-outcome association (action will determine the outcomes)

It goes beyond hard-wired unconditioned responses and incorporates more complex behaviour.

Question 4

Learning of action-outcome associations

Answer 4

‘Response’ (in operant conditioning): pressing a lever, opening a door, pushing a button etc.
Operant behaviour: under stimulus control, so that the action can be a response to a certain stimulus/situation

The outcome can be a ‘reinforcement’ or a ‘punishment’
Action => Outcome

Question 5

Law of Effect

Answer 5

“… responses that create a typically pleasant outcome in a particular situation are more likely to occur again in a similar situation, whereas responses that produce a typically unpleasant outcome are less likely to occur again in the situation” (Thorndike, 1911)

Action is driven by reward (pleasant outcome).

Question 6

Skinner Box (Operant chamber)

Answer 6

Allows for variety of operant conditioning paradigms.
Lights – Speakers – stimulus : generate action
Lever for responses
Food dispenser – appetitive stimuli/rewards: outcomes (reward)
Electrified grid – aversive stimuli/punishment: outcomes (punishment)
Used with rodents – very good at responding to these paradigms.

Question 7

Skinner’s Terminology: Reinforcer

Answer 7

an event that increases the likelihood of the action

Question 8

Skinner’s Terminology: Punishment

Answer 8

an event that decreases the likelihood of the action. (prevent you to do something again.)

Question 9

Skinner’s terminology: Positive

Answer 9

Something has been introduced

Question 10

Skinner’s Terminology: Negative

Answer 10

Something has been removed.

Question 11

Punishment

Answer 11

Decreases Behaviour
Less beneficial than Reinforcement
Temporary changes in behaviour – based on coercion
Creates negative/adversarial relationship
When the person who provide punishment leaves – unwanted behaviour returns

Question 12

Reinforcement

Answer 12

Increases Behaviour
More beneficial than punishment
More likely to result in long-term changes in behaviour
Creates positive relationship with the person providing reinforcement

Question 13

Classical condition: partial reinforcement:

Answer 13

Classical condition: partial reinforcement: intersperse trials in which the CS is not followed by the US. This is done randomly so that the CS is followed by the US with a certain probability (here 75%). Slows down both acquisition and extinction learning.

Question 14

Partial reinforcement: reinforcement schedules

Answer 14

responses are sometimes reinforced and sometimes not.
Slower initial learning: but greater resistance to extinction
As reinforcement does not appear after every behaviour, it takes longer for learner to determine a lack of reward. Extinction is slower.

Question 15

Fixed ration

Answer 15

behaviour is reinforced after a specific number of responses. (e.g. giving a child a sweet after reading 5 pages of a book.)

Question 16

Variable ratio

Answer 16

behaviour is reinforced after an average, but unpredictable number of responses. (e.g. Payoffs from slot machines and other games of
chance)

Question 16

Variable interval

Answer 16

behaviour is reinforced for the first response after an average but unpredictable, amount of time has passed (e.g. periodically checking email)

Question 17

Fixed interval

Answer 17

behaviour is reinforced for the first response after a specific amount of time has passed (e.g. receiving a monthly salary for work)

Question 18

Fixed Interval (FI) Schedule

Answer 18

First response after a designated amount of time is followed by reinforcement. FI 60s – every 60 seconds.
Produce characteristic pattern of responding observable across species.
PRP followed by slow rates of responding and high rates of responding toward the end of the interval. “Scallop” (monthly salery)

Question 18

Variable Ratio (VR) Schedule

Answer 18

Responding reinforced after a randomly determined number of responses have been emitted. (VR). VR15 – average number of responses for reinforcement – but could be anywhere between 1 – 29. Rate of responding for VR is typically faster than FR, no PRP in VR schedule. Response rates relatively constant over time. (quicker than fixed ration)

Question 18

Fixed ratio (FR) schedule

Answer 18

The number of responses required for reinforcement is describes the schedule. Continuous reinforcement is technically FR1. Probability of reinforcement increases with successive responses. Brief pause in responses (Post-reinforcement Pause – PRP) after each reinforcement before responses begin again. ‘Stair-step’ pattern

Question 19

Variable Interval (VI) Schedule

Answer 19

Responding reinforced after a randomly determined amount of time. VI 60s – average of 60 seconds between reinforcements – but individual intervals will differ from one another.
Relatively constant, no PRP (except at unusually low rates of reinforcement). Most commonly used schedule in operant research – produces steady predictable performance

Question 20

Shaping

Answer 20

process of guiding behaviour to the desired outcome through the use of intermediate stages.