Lecture 3: Learning (Curtis) Flashcards

0
Q

mechanisms of behavior

A

underlying machinery that makes behavior happen –> physical machinery in the CNS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
1
Q

learning

A

an enduring change in the MECHANISMS OF BEHAVIOR involving specific stimuli and/or responses that results from prior experience with similar stimuli and responses

-> defined in terms of a change in the mechanisms of behavior rather than a change in the behavior itself

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

the startle response

A

a defensive response of evolutionary importance

ex: a sudden jump and tensing of the muscles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

habituation

A

a DECREASE IN RESPONSE as a consequence of repeated exposure to a stimulus even though the stimulus remains the same

ex: a mare no longer threatening people when they walk by her baby and nothing bad happens

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

two important things to remember about habituation:

A

the initial response (mare being threatening toward people when near her baby) is an INNATE repsonse.

the decrease in response (mare no longer being threatening to people) is LEARNED

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what goes on neurologically with habituation?

A

response fails to occur because changes in the CNS block the relay or sensory neural impulses to the motor neurons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

dishabituation

A

the habituated response is restored by exposure to a strong extraneous stimulus paired with the stimulus to which the animal has habituated

ex: a human actually does threaten the foal, then the mare returns to threatening passerby again

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

sensitization

A

an increase in responsiveness produced by repeated stimulation.

more intense stimuli produce greater increases in responsiveness and with more intense stimuli the sensitization effects persist longer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

similarities between sensitization and habituation

A

both reflect how an organism ends up sorting out what stimuli to ignore and what stimuli to respond to

both processes involve learning about just one stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

classical conditioning

A

simple mechanism whereby an organism learns about RELATIONSHIPS BETWEEN STIMULI and alters its behaviors accordingly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

unconditioned stimulus (US)

A

elicits a particular response without the necessity of prior training

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

unconditioned resposne

A

response that occurs without prior conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

conditioned stimulus

A

does not elicit a particular response initially, but comes to do so as a result of becoming associated with a US

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

conditioned response

A

response that comes to be made to the conditioned stimulus as a result of classical conditioning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

the number of pairings needed between a conditioned stimulus and a neutral stimulus depends on:

A
  1. intensity of stimulus

2. relevance of neutral stimulus

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

stimulus discrimination

A

when only ONE SPECIFIC STIMULUS elicits the response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

stimulus generalization

A

response elicited by a diverse but related group of stimuli

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

taste aversion learning - what is it and what are its 2 unique properties?

A

a robust form of classical conditioning

ex: an animal eats something –> gets sick. source of the CS and US is the same.

  1. strong taste aversions can be learned with just one pairing
  2. learning occurs even if animal does not get sick until several hours after exposure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

extinction

A

if animal is repeatedly exposed to a CS without further pairing with the US, then the animal response will eventually cease

ex: if you stop pairing the whistle with the fish, the whistle wont have the same meaning anymore

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what is the difference between extinction and habituation?

A

habituation is loss of an INNATE response
extinction is loss of a LEARNED response

in both situations, the stimulus intensity remains the same but the response decreases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

operant conditioning (instrumental conditioning)

A

behavior that is affected by the immediate consequences. the behavior occurs because it was previously instrumental in producing certain responses. ie goal directed behavior

ex: a dog has learned that the action of sitting when a person says “sit” results in food.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

appetitive stimulus

A

a good event

22
Q

aversive stimulus

A

unpleasant event

23
Q

reinforcement

A

increases the probability of the behavior occurring in the future

24
Q

punishment

A

decreases the probability of the behavior occurring in the future

25
Q

positive operant conditioning

A

a controlling stimulus is ADDED to environment

26
Q

negative operant conditioning

A

a controlling stimulus is REMOVED from the environment

27
Q

describe the way operant conditioning works

A

there is an eliciting stimulus: a hand signal, command, etc. –> gives the animal information about the immediate consequences of a given behavior –> response: behavior performed –> controlling stimulus: food reward

28
Q

positive reinforcement

A

adding something to the environment immediately subsequent to the behavior to increase the frequency of behavior.

“if you do X, good things will happen, so keep doing X.”

29
Q

negative reinforcement

A

removing something from the environment to increase the frequency of behavior

ex: car begins beeping annoyingly -> you put on your seatbelt -> car stops beeping. this increases the likelihood of you putting on your seatbelt in the future

30
Q

positive punishment

A

adding something to the environment to decrease the frequency of a behavior.
probability that a behavior will decrease as a consequence of a controlling stimulus occurring immediately subsequent to behavior.

ex: you do not put on your seatbelt -> car starts beeping -> beeping is being added to the environment to reduce the frequency of you NOT putting on your seatbelt

“if you do X, bad things happen, so stop doing X.”

ex: a bark collar

31
Q

important point to remember about negative reinforcement and positive punishment

A

you generally can’t have negative reinforcement without positive punishment first.
negative reinforcement = removing something from the environment to increase the frequency of behavior
positive punishment = adding something to the environment to decrease the frequency of a behavior

in our seatbelt example, the beeping was added to the environment to decrease our behavior of NOT wearing our seatbelt (positive punishment). when desired behavior was achieved (wearing a seatbelt) the beeping was removed from the environment (negative reinforcement)

32
Q

for punishment to be effective, 3 conditions must be met:

A
  1. immediate - within seconds of behavior
  2. consistent - occur every time
  3. appropriate for individual - interrupt behavior, but not cause fear
33
Q

which punishment do you start with?

A

the strongest!

34
Q

negative punishment

A

removing something from the environment to decrease the frequency of a behavior

referred to as a “time out” - if you do X, good things don’t happen, so stop doing X.

35
Q

prompting and fading

A

initially getting the animal to do a desired behavior by touching the animal and giving an eliciting stimulus - gradually fade the intensity of the prompt

36
Q

shaping

A

rewarding the “first step” of a behavior and gradually reward further and further into progression of the desired behavior - all done without touching the animal.
- often done for things that aren’t likely to be done naturally.

ex: teaching a dog to lie down. give treat for each step in reaching desired position, gradually require animal to engage in behavior that is more and more like final behavior.

37
Q

schedules of reinforcement -

A

determines how and when the response will be followed by a reinforcer

38
Q

what conditions must be met for schedules of reinforcement?

A
  • occurrence of a certain number of responses
  • passage of time
  • presence of certain stimuli
  • occurrence of other responses
39
Q

schedule of reinforcement: ratio

A

depends on number of responses animal has performed

40
Q

schedule of reinforcement: continuous

A

animal is reinforced for each behavior

MOST EFFECTIVE when learning a NEW behavior

41
Q

schedule of reinforcement: fixed ratio

A

gets a treat after a certain number of responses

42
Q

schedule of reinforcement: variable

A

a different number of responses is required for the delivery of each reward.

if on a steadily increasing variable ratio schedule, the behavior is likely to become very persistent

43
Q

schedule of reinforcement: interval

A

depends on the amount of time that has passed

44
Q

fixed interval

A

a response is reinforced only if it occurs after a constant and set amount of time after last reward was given.

45
Q

variable interval

A

responses are reinforced if they occur after a variable interval since the delivery of the previous reinforcer

46
Q

what affects how fast and how well learning occurs?

A

animal’s motivation

47
Q

secondary reinforcers

A

a neutral stimulus (clicker, “good,” whistle, etc.) that is paired with food via classical conditioning. eventually comes to have close to same value as food, must still be followed with the food to prevent extinction.

48
Q

learned helplessness

A

interference with the learning of new instrumental responses as a result of exposure to inescapable and unavoidable aversive stimulation

  • animal learns there is no consequence to its behavior and stops trying.
  • applies to dogs that have experienced chronic, inescapable abuse
49
Q

flooding and problems with flooding

A

deliberate exposure of the animal to a stimulus until the response extinguishes or the animal habituates.

the problem: once session begins, exposure to the stimulus must continue until the response ceases. therefore animals with strong fears may injure themselves.

50
Q

when is it best to use intermittent reinforcement?

A

good at teaching behaviors you want, REALLY good at keeping behaviors you dont want from happening

51
Q

desensitization

A

expose animal to a low-level stimulus and increase the intensity of the stimulus while maintaining the same response

52
Q

counter-conditioning

A

a response is elicited that is behaviorally and physiologically incompatible with another response. ie. rewarding a dog for being relaxed, which is incompatible with being fearful.

  • a conditioning procedure that reverses the animal’s previous response to a stimulus
  • a good technique for dogs with fear of people, fear of noises, storms, etc.