Learning and Ethology Flashcards
Edward Thorndike is one of the early psychologists who studied learning. He is considered to be part of the __ system of thought, focusing on how the…
functionalist, how the mind functioned in adapting to the environment.
Why was Thorndike also considered to be an early behaviourist?
Since as a result of his study of the objective behaviour of animals, he developed the law of effect, which formed the basis for operant conditioning.
Who conducted the experiment on little Albert? Describe it and what we learned from it.
- John Watson
- Watson presented white rat and and then make a startingly loud noise behind Albert’s head. Eventually Albert learned to associate the white rat with the loud noise, and showed a fear response.
After Watson, __ became the dominant system of psychology in the US and remained so until about _
1960
Clark Hull’s theory of motivation or drive reduction theory suggests that…
the goal of behaviour is to reduce biological drives: that is, reinforcement occurs whenever a biological drive is reduced.
The 1930’s, largely due to the work of __ __, marked the beginning of __ as a recognized discipline.
Konrad Lorenz, ethology
Lorenz rejected the idea that animal behaviour could…. Instead, he believed that…
be understood in the laboratory. Instead, he believed that an understanding of animal behaviour could be gained only in the field.
By observing the animal in its natural environment, he was able to describe the animal’s behaviour in great detail, and by studying the contect in which a particular behaviour took place, he could begin to analyze the function that the behaviour served.
Ethologists study animals in their…
natural environment, rather than in the laboratory.
Who is credited for founding the basic principles of classical conditioning?
Ivan Pavlov
Ivan pavlov noticed that through experience…
stimuli that previously had no relation to a specific reflex could come to trigger a reflex
A critical factor in the success of classical conditoning is the __ of the CS and UCS.
timing
For classical conditioning to work, when does the CS have to be presented?
before the UCS
Aqcuisition is the term used to describe…
the period during which an organism is learning the association of the stimuli.
What is extinction?
A process in which classical conditioning and be unlearned. In extinction, we repeatedly present the CS without the UCS. So, we would ring the bell but not give any food powder to the dog. If we do this long enough, the dog will eventually stop salivating to the ring. The conditioned behaviour is not REINFORCED and so it becomes extinct.
After extinction occurs, will the CS (bell ring) never again elicit the CR of salivation?
No. After a period of rest, presenting the bell without the UCS will actually elicit a weak CR of salivation, which is called SPONTANEOUS RECOVERY.
Generalization is the tendency for…
stimuli similar to the CS to elicit the CR. For example, the dog might salivate to bells of various pitches or maybe chimes. We see evidence of generalization in phobias. For example, if a child is bitten by a large dog, he is liable to fear both large and small dogs.
Backward conditioning involves
presenting the CS following the UCS; generally unsuccessful
Classical conditioning appears to have limited usefulness for humans. After all, we can pair stimuli only when…
one of the stimuli (the UCS) elicits a reflex, and people have relatively few reflexes.
Two classical conditioning phenomena tremendously expand the usefulness and applicability of classical conditioning. What are they?
1) second order conditioning
2) sensory preconditioning
Describe second order conditioning
A neutral stimulus is paired with a CS rather than a UCS. There are 2 stages involved in second-order conditioning.
1) Regular classical conditioning
2) Present a new UCS - a flash of light for example - just before presenting the CS (bell ring), but without presenting the food powder.
After several of these trials, the dog will salivate to just the flash alone. We could even do third order conditioning by presenting the tick of a metronome followed by a light flash. Eventually, the dog would begin to salivate to the ticking of the metronome.
Describe sensory preconditoning
Two neutral stimuli are paired together and then one of the neutral stimuli is paired with a UCS. There are 2 stages:
1) Pair 2 neutral stimuli, say a flash of light and the ring of a bell. Remember that both of these are neutral stimuli. 2) After several trials, we move to stage 2, where we pair the bell of the UCS with the food powder. After the animal salivates to the bell alone, we then test for the effect of sensory preconditioning by flashing the light without either ringing the bell or presenting the food. It turns out that even though the light flash and the food were never directly paired, the light flash elicits salivation.
Robert Rescorla demonstrated what about classical conditioning? What is his approach called?
He performed some experiments which suggested that classical conditoning was a matter of learning signals for the UCS. To the extent that the CS is a good signal and that it has informational value, or is a good predictor of the UCS, the CS and UCS will become associated and classical conditioning will occur.
His approach is called a “contingency explanation of classical conditioning.
What is blocking?
Blocking occurs when the CS is a good signal for the UCS and provides non-redundant information about the occurrence of the UCS.
Operant conditioning (OC) is also sometimes called
instrumental conditioning
Operant behaviour is controlled by __
consequences
One of the pioneers of OC is E.L. __. He proposed the __ of __, which suggested that…
Thorndike, law of effect; is a response is followed by an annoying consequence, the animal will be less likely to emit the same response in the future.
B.F skinner agreed with Thorndike’s contention that environmental…, but he rejected Thorndike’s stress on…
consequences affect the probability of response
mentalistic terms such as “satisfying” and “annoying”
Skinner further developed the concept of OC by distinguishing 4 important concepts - name and describe
1) Positive reinforcement - the probability that the desired response will be performed is increased by giving the organism something that it wants (reward) whenever it makes the desired response.
2) Negative reinforcement - the probability that the desired response will be performed is increased by taking away or preventing something undesirable whenever the desired response is made.
3) Punishment - the probability that the desired response will be performed is DECREASED by giving organism something undesirable whenever the response is made.
4) Extinction - behaviour that used to bring reward no longer does.
What are the two types of negative reinforcement?
1) Escape - the behaviour removes something undesirable (e.g., loud seatbelt buzzer can be stopped by clicking seatbelt on)
2) Avoidance - organism gets warning that aversive stimulus will soon occur, and the appropriate response completely avoids the stimulus (e.g., heeding a stop sign avoids a crash)
Negative reinforcers can be __ __ once desired response has been achieved
turned off
The goal of punishment is to
decrease probability of particular behaviour
Goal of reinforcement is to
increase probability of particular behaviour
According to Skinner, we don’t know if something is a reinforcer or punished until we can
look at the effect it has on the behaviour. For example, if a child is reprimanded for clowning around in class, is the child’s behaviour being rewarded or punished? It depends on whether or not the child’s clowning around increased or decreased in freq after the reprimanding. If the child’s clowning around increased after the reprimand, the reprimand was actually a reinforcer. Maybe the child likes the attention she gets from a reprimand.
An important term in OC is the discriminative stimulus, which is…
a stimulus condition which indicates that the organism’s behaviour will have consequences (e.g., only when the light is on does the pigeon get the food pellet - pg 230)
What is the partial reinforcement effect?
This effect demonstrates that it takes longer to extinguish extinguish a conditioned response when the behaviour was occasionally reinforced, rather than consistently reinforced.
Gambling is an example of what type of reinforcement?
partial reinforcement - because it’s hard to stop even though your behaviour is reinforced by an occasional win
There are 4 basic types of partial reinforcement, called schedules of reinforcement. Name and describe.
1) Fixed ratio - Org receives reinforcement only after a fixed number of responses (e.g., 5 lever presses = a food pellet)
2) Variable ratio - Org receives reinforcement after variable number of responses (e.g., on a VR 5 schedule, the animal will receive, on average, a pellet ever 5 presses. On any particular trial, the pellet could come on the 2nd lever press or the 5th press, or the 17th press).
3) Fixed-interval - Org reinforced on the first response after a fixed period of time has passed since the last reinforcement.
4) Variable interval - Org reinforced on thef irst response made after a variable amount of time has passed since the last reinforcer. However, in VI, there is an average interval time period.
What could we call a situation where an animal is being reinforced for every response?
an FR 1 schedule, also called a continuous reinforcement schedule.