Final Exam Second Half Flashcards
What is Learning?
- the acquisition, from experience, of new knowledge, skills, or responses that results in a relatively permanent change in the state of the learner.
- This definition emphasizes these key ideas:
- Learning is based on experience.
- Learning produces changes in the organism.
- These changes are relatively permanent.
- Eg. think about Jennifer’s time in Iraq and you’ll see all of these elements: Experiences that led Jennifer to associate the sound of an approaching helicopter with the arrival of wounded soldiers changed the way she responded to certain situations in a way that last for years.
- Learning can also occur in much simpler, nonassociative forms.
What is Habituation?
-
a general process in which repeated or prolonged exposure to a stimulus results in a gradual reduction in responding.
- eg. if you lived near a busy highway you probably noticed the sound of traffic when you first moved in.
- After a while, the roar wasn’t quite so deafening anymore and eventually you were able to ignore the sounds of the automobiles in your vicinity.
- This welcome reduction in responding reflects the operation of habituation.
- occurs even in the simplest of organisms.
- eg. the Aplsia exhibits habituation: when lightly touched, the sea slug initially withdraws its gill, but the response gradually weakens after repeated light touches.
What is Sensitization?
-
presentation of a stimulus leads to an increased response to a later stimulus.
- eg. Kandel found that after receiving a strong shock, Aplysia showed an increased gill-withdrawal response to a light touch.
- In a similar manner, ppl whose houses have been broken into may layer become hypersensitive to late-night sounds that wouldn’t have bothered them before.
What is Classical Conditioning?
- Ivan Pavlov.
- a type of learning that occurs when a neutral stimulus produces a response after being paired with a stimulus that naturally produces a response.
- In his classic experiments, Pavlov showed that dogs learned to salivate to neutral stimuli such as a buzzer or a metronome after the dogs had associated that stimulus with another stimulus that naturally evokes salivation, such as food.
- When Pavlov’s findings first appeared in the scientific and popular literature, they produced a flurry of excitement bc psychologists now had demonstrable evidence of how conditioning produced learned behaviours.
- This was the kind of behaviourist psychology John B. Watson was proposing: An organism experiences events of stimuli that are observable and measurable, and scientists can directly observe and measure changes in that organism.
What are the Basic Principles of Classical Conditioning?
- When the dogs were initially presented with a plate of food, they began to salivate. Pavlov called the presentation of food an unconditioned stimulus (US) - something that reliably produces a naturally occurring reaction in an organism.
- he called the dogs’ salivation an unconditioned response (UR) - a reflexive reaction that is reliably produced by an unconditioned stimulus.
- Then Pavlov paired the presentation of food with the sound of the ticking of a metronome, a buzzer, the humming of a tuning fork, or the flash of a light.
- This period is called acquisition - the phase of classical conditioning when the CS and the US are presented together.
- Nothing in nature would make a dog salivate to the sound of a metronome or a buzzer.
- However, when the CS (the sound of the metronome) is paired over time with the US (the food), the animal will learn to associate food with the sound, and eventually the CS is sufficient to produce a response, or salivation.
- Sure enough, Pavlov found that the dogs ultimately salivated to these sounds and flashes, each of which had become a conditioned stimulus (CS) - a previously neutral stimulus that produces a reliable response in an organism after being paired with a US.
- This response resembles the UR, but Pavlov called it the conditioned response (CR) - a reaction that resembles an unconditioned response but is produced by a conditioned stimulus.
- In this example, the dogs’ salivation (CR) was eventually prompted by the sound of the metronome (CS) alone because the sound of the metronome and the food (US) has been associated so often in the past.
- The CR reflects learning, whereas the UR does not.
What is Second-Order Conditioning?
- After conditioning has been established, a phenomenon called second-order conditioning - a type of learning in which a CS is paired with a stimulus that become associated with the US in an earlier procedure, can be demonstrated.
- Eg. in an early study, Pavlov repeatedly paired a new CS, a black square, with the now reliable tone. After a number of training trials, his dogs produced a salivary response to the black square, even though the square itself had never been directly associated with the food.
What is Extinction?
-
extinction - the gradual elimination of a learned response that occurs when the CS is repeatedly presented without the US.
- This term was introduced bc the conditioned response is “extinguished” and no longer observed.
- Having observed that the could produce learning through conditioning and then extinguish it, Pavlov wondered if this elimination of conditioned behaviour was permanent.
is what would happen if they continued to present the CS (metronome ticking) but stopped presenting the US (food)
What is Spontaneous Recovery?
spontaneous recovery - the tendency of a learned behaviour to recover from extinction after a rest period.
- To explore this question, Pavlov extinguished the classical conditioned salivation response and then allowed the dogs to have a short rest period.
- When they were brought back to the lab and presented with the CS again, they displayed spontaneous recovery - the tendency of a learned behaviour to recover from extinction after a rest period.
- Notice that this recovery takes place even though there have not been any additional associations between the CS and US.
- Some spontaneous recovery of the conditioned response even takes place in what is essentially a second extinction session after another period of rest.
- Clearly, extinction had not completely erased the learning that had been acquired.
- The ability of the CS to elicit the CR was weakened, but it was not eliminated.
What is Generalization?
- It wouldn’t be very adaptive for an organism if each little change in the CS-US pairing required an extensive regimen of new learning.
- Rather, the phenomenon of generalization tends to take place: The CR is observed even though the CS is slightly different from the CS used during acquisition.
- In other words, the conditioning generalizes to stimuli that are similar to the CS used during the original training.
- The more the new stimulus changes, the less conditioned responding is observed — which means that if you replaced a manual can opener with an electric can opener, your dog would probably show a much weaker conditioned response.
- When an organism generalizes to a new stimulus, two things are happening:
- 1st → by responding to the new stimulus used during generalization testing, the organism demonstrates that it recognizes the similarity between the original CS and the new stimulus.
- 2nd → by displaying a diminished response to that new stimulus, it also tells us that it notices a difference between the two stimuli.
- In the 2nd case, the organism shows discrimination, the capacity to distinguish between similar but distinct stimuli.
- → Generalization and discrimination are two sides of the same coin.
- The more organisms show one, the less they show the other, and training can modify the balance between the two.
What did the case of Little Albert show?
Classical conditioning.
- Watson wanted to see if such a child could be classically conditioned to experience a strong emotional reaction — namely, fear.
- Watson presented Little Ablert with a variety of stimuli: a white rat, a dog, a rabbit, various masks, and a burning newspaper. Albert reacted in most cases with curiosity or indifference, and he showed no fear of any of the items.
- Watson also established that an unconditioned stimulus could make Albert afraid. While Alberta was watching Rayner, Watson unexpectedly struck a large steel bar with a hammer, producing a loud noise. Predictably, this caused Albert to cry, tremble, and be generally displeased.
- Watson and Rayner then led Little Albert through the acquisition phase of classical conditioning.
- Alberta was presented with a white rat. As soon as he reached out to touch it, the steel bar was struck. This pairing occurred again and again over several trials. Eventually, the sight of the rat alone cause Albert to recoil in terror, crying and clamoring to get away from it.
- In this situation, a US (the loud sound) was paired with a CS (the presence of the rat) such that the CS all by itself was sufficient to produce the CR (a fearful reaction)
- Little Alberta also showed stimulus generalization. The sight of a white rabbit, a seal-fur coat, and a Sant Claus mask produced the same kinds of fear reactions in the infant.
What was Watson’s goal in his Classical Conditioning Experiment?
- 1st → wanted to show that a relatively complex reaction could be conditioned using Pavlonian techniques.
- 2nd → wanted to show that emotional responses such as fear and anxiety could be produced by classical conditioning and therefore need not be the product of deeper unconscious processes or early life experiences as Freud and his followers had argued.
- Instead, Watson proposed that fears could be learned, just like any other behaviour.
- 3rd → Watson wanted to confirm that conditioning could be applied to humans as well as to other animals.
- This study was controversial in its cavalier treatment of a young child, especially given that Watson and Rayner did not follow up with Albert and his mother during the ensuing years.
- A therapy that has proven effective in dealing with such trauma-induced fears is based directly on principles of classical conditioning: Individuals are repeatedly exposed to conditioned stimuli associated with their trauma in a safe setting, in an attempt to extinguish the conditioned fear response.
- However, conditioned emotional responses include much more than just fear and anxiety responses.
- eg. whey ads use attractive women in ads for products geared towards young males, including beer and sports cars
What was the Rescorla Wagner Model on Classical Conditioning?
- Robert Rescorla and Allan Wagner (1972) were the first to theorize that classical conditioning occurs when an animal has learned to set up an expectation.
- The sound of a metronome, because of tis systematic pairing with food, set up this cognitive state for the lab dogs; Pavlov, bc of the lack of any reliable link with food, did not.
- In fact, in situations like this, many responses are actually being conditioned.
- When the metronome ticks, the dogs also wag their tails, making begging sounds, and look towards the food source.
- Robert Rescorla and Allan Wagner (1972) were the first to theorize that classical conditioning occurs when an animal has learned to set up an expectation.
- The Rescorla-Wagner model introduced a cognitive component that accounted for a variety of classical conditioning phenomena that were difficult to understand from a simple behaviourist point of view.
- e. the model predicted that conditioning would be easier when the CS was an unfamiliar event than when it was familiar.
- The reason is that familiar events, being familiar, already have expectations associated with them, making new conditioning difficult.
- In short, classical conditioning might appear to be a primitive process, but it is actually quite sophisticated and incorporates a significant cognitive element.
What parts of the brain are important for classical conditioning?
- More recent neuroimaging findings in healthy young adults show activation in the cerebellum during eyeblink conditioning.
- Cerebellum is part of the hindbrain and plays an important role in motor skills and learning.
- Fear conditioning has also been studied.
- Amygdala plays an important role in the experience of emotion, including fear and anxiety.
- The amygdala, particularly an area known as the central nucleaus, is also critical for emotional conditioning.
- eg. a rat that is conditioned to a series of CS-US pairings in which the CS is a tone and the US is a mild electric shock.
- When rats experience sudden painful stimuli, they show a defensive reaction, known as freezing, in which they crouch down and sit motionless.
- In addition, their autonomic nervous systems go to work: Heart rate and blood pressure increase, and various hormones associated with stress are released.
- When fear conditioning takes place, these two components — one behavioural and one physiological — occur, except now they are elicited by the CS.
What does Fear Conditioning tell us about the Brain?
- The central nucleus of the amygdala plays a role in producing both of these outcomes through two distinct connections with other parts of the brain.
- If connections linking the amygdala to the midbrain are disrupted, the rat does not exhibit the behavioural freezing response.
- If the connections between the amygdala and the hypothalamas are severed, the autonomic responses associated with fear cease.
- Hence, the action of the amygdala is an essential element in fear conditioning, and its link with other areas of the brain are responsible for producing specific features of conditioning.
- The amygdala is involved in fear conditioning in people as well as in rats and other animals
How has Classical Conditioning been linked to Evolutionary Elements?
- Much research exploring this adaptiveness has focused on conditioned food aversions, primarily taste aversions.
- Eg. a psychology prof was once on a job interview in Southern California, and his host took him to lunch at a Middle Eastern restaurant. Suffering from a case of bad hummus, he was up all night long and developed a lifelong aversions to hummus.
- The hummus was the CS, a bacterium of some other source of toxicity was the US, and the resulting nausea was the UR. The UR (the nausea) became linked to the once-neutral CS (the hummus) and became a CR (an aversion to hummus).
- However, all of the psychologist’s hosts also ate the hummus, yet none of them reported feeling ill. It’s not clear, then, what the US was; it couldn’t have been anything that was actually in the food.
- What’s more, the time between the hummus and the distress was several hours; usually, a response follows a stimulus fairly quickly.
- Most baffling, this aversion was cemented with no single acquisition trial.
- These pecularities are not so peculiar from an evolutionary perspective.
- To have adaptive value, this mechanism (of learning to avoid food that once made us ill) should have several properties:
- Rapid learning should occur in perhaps one or two trials. If learning takes more trials than this, the animal could die from eating a toxic substance.
- Conditioning shoudl be able to take place over very long intervals, perhaps up to several hours.
- Toxic substances often don’t cause illness immediately, so the organism would need to form an association between the food and the illness over a longer term.
- The organism should develop the aversion to the smell or taste of the food rather than its ingestion. It’s more adaptive to reject a potentially toxic substance based on smell alone that it is to ingest it.
- Learned aversions should occur more often with novel foods than with familiar ones. It is not adaptive for an animal to develop an aversion to everything it has eaten on the particular day it got sick.
What have studies on taste aversion suggested?
- Studies such as these suggest that evolution has provided each species with a kind of biological preparedness - a property for learning particular kinds of associations over other kinds, such that some behaviours are relatively easy to condition in some species but not others.
- eg. the taste and smell stimuli that produce food aversions in rats do not work with most species of fish.
- Birds depend primarily on visual cues for finding food and are relatively insensitive to taste and smell.
- It is relatively easy to produce a food aversion in birds using an unfamiliar visual stimulus as the CS< such as brightly coloured food.
The study of classical conditioning is the study of behaviours that are _______?
- REACTIVE
- Most animals don’t voluntarily salivate or feel spasms of anxiety; rather, they exhibit these responses involuntarily during the conditioning process.
- Involuntary behaviours make up only a small portion of our behavioural repertoires, the remainder are behaviours that we voluntarily perform.
What is Operant Conditioning?
-
a type of learning in which the consequences of an organism’s behaviour determine whether it will repeat that behaviour in the future.
- The study of operant conditioning is the exploration of behaviours that are active.
- Edward L. Thorndike first examined active behaviours back in the 1890s, before Pavlov published his findings.
What did Edward L. Thorndike’s Experiments show?
Operant conditioning.
- Thorndike’s research focused on instrumental behaviours, that is, behaviour that required an organism to do something, such as solve a problem or otherwise manipulate elements of its environment.
- eg. Thorndike completed experiments using a puzzle box, which was a wooden crate with a door that would open when a concealed lever was moved in the right way.
- A hungry cat placed in a puzzle box would try various behaviours to get out — scratching at the door, meowing loudly, sniffing the inside of the box, putting its paw through the openings — but only one behaviour opened the door and led to food: tripping the lever in just the right way.
- After the cat earned its reward, Thorndike placed it back in the puzzle box for another round.
- Eventually, the cats became quite skilled at triggering the lever for their release.
- What’s going on:
- 1st → the cat enacts any number of likely (yet ultimately ineffective) behaviours, but only one behaviour leads to freedom and food.
- Over time, the ineffective behaviours occur less and less frequently, and the one instrumental behaviour (going right for the latch) becomes more frequent.
- From these observations, Thorndike developed the law of effect - the principle that behaviours that are followed by a “satisfying state of affairs” tend to be repeated, and those that produce an “unpleasant state of affairs” are less likely to be repeated.
What is the Law of Effect?
Thorndike developed the law of effect - the principle that behaviours that are followed by a “satisfying state of affairs” tend to be repeated, and those that produce an “unpleasant state of affairs” are less likely to be repeated.
What is the difference between Pavlov’s and Thorndike’s Work?
- In Pavlov’s work:
- the US occurred on every training trial, no matter what the animal did.
- Pavlov delivered food to the dog whether it salivated or not.
- In Thorndike’s work:
- the behaviour of the animal determined what happened next.
- If the behaviour was “correct” (ie animal triggered the latch), the animal was rewarded with food.
- Incorrect behaviours produced no results, and the animal was stuck in the box until it performed the correct behaviour.
What is Operant Behaviour?
- coined by B.F Skinner
- behaviour that an organism performs that has some impact on the environment.
- In Skinner’s system, all of these emitted behaviours “operated” on the environment in some manner, and the environment responded by providing events that either strengthened those behaviours (ie. they reinforced them) or made them less likely to occur **(ie. they punished them).
- Skinner’s elegantly simple observation was that most organisms do not behave like a dog in a harness, passively waiting to receive food no matter what the circumstance.
- Rather, most organisms are like cats in a box, actively engaging the environment in which they find themselves to reap rewards
- Skinner’s approach to the study of learning focused on reinforcement and punishment.
According to Skinner, what is a reinforcer?
any stimulus or event that increases the likelihood of the behaviour that led to it
According to Skinner, what is a punisher?
any stimulus or event that decrease the likelihood of the behaviour that led to it.