lecture 4 Flashcards

(instrumental learning concepts and theories)

1
Q

What are modal action patterns

A

There are behaviours elicited in specific circumstances that require no training
Species specific response patterns
Threshold for eliciting the behaviour varies with physiological state of the animal
Instinctive - but experience can influence their expression

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is the sign stimulus

A

the stimulus that elicits modal action patterns

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What did Tinbergen & Perdeck (1950) show about instinct behaviour in herring chicks

A

Investigated instinct behaviour by observing the importance of the parent’s bill in herring chick’s pecking behaviour (allows them to ask for food)
Manipulated the shade of the spot on the bill and found that movements and contrast were important but realism and colour weren’t → sign releasing stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What did Baerends et al., 1982 find about sign stimuli

A

Birds pull in any egg close to nest regardless of how closely it resembles their own eggs
Large eggs elicited the strongest behaviour despite being least like their own and their high ability to recognise this.
Behaviour can be elicited by features of a stimulus that are independent of experience
Several features may contribute additively to the effectiveness of the releasing stimulus e.g colour, speckling and size contributed to egg retrieval
Using this to optimise attractiveness of a stimulus would create a supernormal stimulus more effective that the typical one

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what are some human examples of sign stimuli

A

Aspects of the human face especially baby features act like signs or supernormal stimuli (Glocker et al., 2009)
Baby face: more trustworthy / approachable
Make up : attractiveness
Junk Food - instinctual behaviours
Babinksi reflex - scratch bottom of foot produces splayed toe behaviour → grasping
Developmental change as can still be observed in adults when certain areas are inhibited as a result of alcohol
Most actions rely on learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is hypovolemic thirst

A

when there is low extracellular volume, homeostatic functions drive thirst for water and hunger for salt
symptoms: loss of blood, drop in blood pressure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is osmotic thirst

A

when there is high extracellular concentration

respiration increases, concentration of solutes increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what are the central regulatory factors of hunger

A

Not the case that there is a single signal from mouth/stomach to brain
Stomach distension similarly only provides some cues to satiety (Janowitz & Grossman, 1949).
Gastrectomized people still feel hungry, Vagotomy still allows eating
The brain (Hypothalamus) is the master regulator and has access to the neural and chemical indicators of the current state of the organism.
Need to learn food → less hunger

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is Miller & Konorski’s 1928 theory of instrumetnal learning

A

sometimes animals learn to make responses rather than just learn about USs
must do something in order to achieve desired outcome (in pavlovian conditioning the saliva is not a prerequisite of food)
two distinct learning/conditioning mechanism

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is reinforcement instrumetnal conditioning

A

Reinforcer: increase behaviour
Positive: add appetitive stimulus following correct behaviour
Negative
Escape: remove noxious stimulus following correct behaviour
Active avoidance: behaviour avoids noxious stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is punishment instrumental conditioning

A

Punishment: decrease behaviour
Positive: add noxious stimuli following behaviour
Negative: remove appetitive stimulus following behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

gambling and variable ration reward frequency Dixon et al, 2014

A

Comparison of multi-line slot machine performance with single line slot machines
Measure post reinforcement pause (time waited to start again) - proxy for desperation to pay - strength of addiction/ enhanced behavioural responding
20 line machines reduced post reinforcement pause
High risk gamblers experience an enhances sense of competency in 20 line condition
Zoratto et al. (2013) suggest that adolescent rats may be particularly sensitive to reward differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Do our choices reflect the strenght of possible responses or motivations for possible responses

A

Herrenstein’s Matching Law (1974) shows that behaviour matches to the reinforcement probabilities (rather than optimal performance)
Animals will engage in behaviour that strives to reduce motivational drives
Outcome can be distant from behaviour (important to recruit short-term motivation)
BUT animals will also engage in behaviours with association with low motivational value to access responses that are associated with higher motivational value
One behaviour can be used as a reinforcer for another behaviour (can’t determine ultimate goal of behaviour)
This means behaviour cannot be used as a metric of motivational states
Secondary reinforcement: high value stimuli or responses can come to be associated with other lower value stimuli and responses (Premac, 1965)
E.g a low probability response is reinforced by access to a high probability response
Therefore linked chains of associations motivate behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is the role of probability of an outcome for learning

A

Probability (not frequency) is relevant for strength of CR
Relative frequency and time (Skinner’s schedules) determine the rates of responding
Matching law: animals behaviour correlates with probabilities rather than selecting the best

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is meant by paradoxical choice

A

choosing to spend more time on actions with lower probability of rewards
this cannot be explained well by reasoning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is the link between gambling and paradoxical choice

A

Zentall et al. (2019) suggest Paradoxical choice effects are a model for gambling
Ojeda, Murphy & Kacelnik (2018) investigate paradoxical choice and gambling in rats
Rats divide behaviour in proportion to the probability of outcome such that 75% of behaviour distributed to button with 75% reward
But they show a preference for information, such that they are sensitive to whether stimuli in the environment indicate something will happen and exhibit increased responding to information about reward.
Decreasing the probability of reward does not alter this preference until value is severely altered (20% reward)

17
Q

What did Aoyama (2012) show about Activity Based Anorexia

A

Reduced rats food to one hour a day and introduced a wheel that they wither could or could not run on
found that without intervention the rats that could run on the wheel would die of starvation

18
Q

what is the evidence that serotonin may delay the onset and progression of ABA in animals

A

obinette et al., 2021)
NAD+ availability activates SIRT1- which increases foraging and activity.
Manipulate SIRT1 using mouse models
Knockout (KO)
Overexpressor (OX)
SIRT decreases serotonin in mice and anxiety-like behaviours
Results show that SIRT1 KO lose less body weight over time than wild type mice while SIRT OX lose more body weight over time than wild type mice (although all lose weight).
Mice without SIRT, are not having serotonin decreased → suggests serotonin may delay onset and progression of ABA

19
Q

what are the two competitng theories about ABA

A

Direct Effect (Pierce & Epling, 1994)
Exercise reduced the reinforcing effectiveness of food
Food stimuli are not as salient, the association with responding is weaker and less pleasurable
Indirect Effect (Kanarek & Collier, 1983)
A behavioural failure to adapt to the restricted feeding schedule
Activity increases rate of satiation

20
Q

How did Dwyer & Boakes (1997) test the ABA theories and what were their conclusions

A

Found recovery of weight following the introduction of the activity wheel if
Change in feeding schedule occurs before the introduction of access to the wheel
Moving feeding to the start of their active period
Activity is restricted before feeding
These results suggest that ABA is not a direct effect of changing the effectiveness of eating, rather a behavioural adaptation effect (indirect).

21
Q

summary

A

Skinner developed a theory of instrumental conditioning that explained the relation between outcomes and Responses.
Responses become strengthened or weaker by outcomes (R-O) and elicited under the control of stimuli (S-R association)
Reinforcement contingencies control action and choice in complex relations to motivation
Like other animals human behaviour is controlled by the same processes.