Chapter 8 Flashcards

1
Q

What is an example of controlling stimulus?

A

A discriminative stimulus.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a discriminative stimulus?

A

A discriminative stimulus sets the occasion for reinforcement of an operant. I.e it signals whether reinforcement is likely following operant behaviour.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are 2 types of discriminative stimulus?

A

S(+) which signals an increased probability of reinforcement following operant in S(+) presence & S(-) signals extinction ie. that there is a low probability of operant being reinforced.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How do we test if stimulus is discriminatory?

A

Using differential reinforcement & discrimination. This involves reinforcing operant in the presence of one stimulus and not the other to form S(+) and S(-). Once this is done we test behaviour during extinction- i.e. there is no reinforcement present and see if there is discrimination between responses to S(+) and S(-). S(-) will go into extinction whereas (+) should be more resistant to extinction.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is stimulus control?

A

Change in behaviour that occurs when either S(+) or S(-) is present. In the presence of S(+) behaviour should increase because it signals the increased probability or reinforcement following operant. S(-) signals that the likelyhood of being reinforced for operant behaviour, in its presence, is unlikely I.e it signals extinction.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a response chain (successive approximation)?

A

Shaping behaviour through successive approximation. Method of shapingoperant behaviorby reinforcing responses similar to the desired behavior. Initially, responses roughly approximating the desired behavior are reinforced. Later, only responses closely approximating the desired behavior are reinforced. The process gradually leads to the desired behavior. Thus, a rat should be able to press a lever for a blue light and peck a key for red I.e of successful then the organism should be able to discriminate.
Note: that the controlling stimulus has both a discriminative and reinforcement function (reinforcing during shaping).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a real life example of reaction chain application?

A

Infants use of social referencing when presented with an ambiguous object. An infant will shift their gaze from the object to their mother to read her facial expression. The mother’s reaction acts as a discriminative stimulus to whether or not grabbing behaviour will be reinforced. i.e. happy= reinforced & angry=punishment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is he reaction chain formula look like for social referencing?

A
SD1 - R1 - SD2- R2 - S (p or r)
SD= discriminatory stimulus
R= response
SR=reinforcement.
SP= punishment

Responses to happy and sad are equal before conditioning but after infants show an increased response to happy face compared to angry. Social referencing refers to infants tendency to generalise this technique to all faces in order to navigate their social world. (+) = reinforcement & (-) punishment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a multiple schedule experiment?

A

Two different basic reinforcement schedules with their own discriminative stimuli are presented on at a time. They are differentially reinforced before 1 gets placed on extinction. This results in a phenomenon called behavioural contrast. Where changes to one schedule contigency reinforces behaviour in the other contingency.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Why are variable interval schedules used for multiple schedule experiments?

A

Variable Interval schedules are used to remove the confound where time itself could become a discriminative stimulus. This way the rat can not simply wait for reinforcement he needs to respond as well.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How do multiple schedules work?

A

still use differentiation. I.e change from S(+) VI 30s to extinction S(-). at the beginning RR for S(+) and S(-) are the same but RR for S(-) rapidly decreases across trials. till extinction. Then we have complete control over peck rate, red= high RR & green- no pecking.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How do we measure the control stimulus on multiple schedule experiments?

A

Using the “Discrimination Index”.
It compares the RR of S(+) with the sum RR of both S(+) & S(-) phases.
I(D)= S(+)/ (S(+) + S(-))

I(D)=0.5 when S +/- are the same i.e no discrimination
I(D)=1 when all responses are to S(+) i.e discrimination is complete

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What did Pierrel, Sherman, Blue, and Hegge (1970) study show?

A

In general, acquisition speed and discrimination accuracy increase the as the difference between S(+) and S(-) increases.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is superstitious behaviour?

A

During extinction trial where rat inadvertantly associates a peack to green as a cause for the light to turn red

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What can remove superstitious behaviour?

A

Differential reinforcement of other behaviour contingency. Simply, any responses to S(-) following extinction delay the onset of S(+), e.g. 1 peck to green key delays red light 2secs, per peck.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is stimulus control?

A

Behaviour is said to be under stimulus control of a S(+) when operant behaviour is more likely in its presence than in its absence.

17
Q

What type of VI reinforcement schedule will produce greater generalisation?

A

A “leaner” VI reinforcement schedule will produce less reinforcement, a flatter slope of generalisation gradient and thus, higher generalisation of operant behaviour.

18
Q

What type of VI reinforcement schedule will produce less generalisation?

A

A “richer” VI schedule of reinforcement during training will produce more steady reinforcement and create a steeper slope of generalisation gradient and thus, less generalisation of operant behaviour.

19
Q

Multiple schedules are used to test what?

A

Discrimination.

20
Q

What are limitations of successive discrimination procedures?

A
  1. They create emotional interference (extinction is an aversive procedure which can cause aggression in test subject)
  2. Emotional interference causes a slow acquisition rate for operant responses
  3. Vulnerable to spontaneous recovery which slows the acquisition of discrimination
  4. Prone to errors in responding where subject responds to S(-).
21
Q

What procedure was introduced to account for the limitations of the successive discrimination procedure?

A

Terrace (1963) Errorless Discrimination Procedure.

22
Q

A S(-) sets the occasion upon which a response is __ reinforced?

A

Never

23
Q

A S(+) does not cause or elicit the appearance of a response the way a ____ does.

A

US

24
Q

In operant conditioning, what is the antecedent stimulus paired with reinforcement called?

A

S(+/D)

25
Q

A two-component schedule in which both components have seperate stimuli is called a:

A

MULT- Multiple Schedule Procedure for discrimination and generalisation

26
Q

To keep the onset of S(D/+) from reinforcing responses in S(-) one needs to add a ___?

A

DRO- Differential Reinforcement of Other Behaviours contingency

27
Q

If Reinforcers on one schedule are depleted and responding in another schedule increases, we call this?

A

(+) Contrast

28
Q

A change in Maximal Generalisation responding, away from S(-) to the other side of S(+) is called:

A

Peak Shift

29
Q

A shaping procedure that gradually changes stimulus control from one element to another is called?

A

Fading

30
Q

If you trained a pigeon to turn in a circle when a TURN signal was presented, you could say that they bird was:

A

Reading

31
Q

With careful shaping and fading one might develop discrimination without:

A

Errors

32
Q

What are three kinds of controlling stimulus?

A

S(+) ie. reinforcement contingency, S(-) punishment contingency, S(ave) extinction contingency.

33
Q

Examples of positive reinforcement

A

praise, money, food, attention

34
Q

Examples of negative reinforcement

A

opening an umbrella in the rain, closing a window in the rain, putting on sunglasses to remove sun glare, leaving a room to avoid rude people & picking up a crying baby.

35
Q

Examples of positive punishment

A

telling off, pain, fine etc.

36
Q

Examples of negative punishment

A

removing (+) reinforcers

37
Q

What experiment is used to show behaviour contrast?

A

Multiple schedules procedure