Chapter 8 Flashcards

The Adaptive Mind: Learning

1
Q

the three categories of behaviours

A
  • Reflexes are inevitable, involuntary responses to stimuli that are controlled by nervous system circuits located in the spinal cord and brainstem. They are beneficial by promoting welfare (e.g. pulling away when touching a hot stovetop), but have the disadvantage of being inflexible.
  • Instincts (a.k.a. fixed action patterns) are inborn patterns of behaviour elicited by environmental stimuli. They share the reliability and lack of dependence on experience to reflexes, but are more complex; requiring much more neurons.
  • Learning is a relatively permanent change in behaviour or the capacity for behaviour due to experience. Our behaviour changes as we mature.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Most human behaviour results from…

A

learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

he believed that human behaviour simply appears more complex and thoughtful because we often face the need to choose among competing instincts

A

William James (1887)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

imprinting

A

when a young organism bonds with adults (e.g. baby swans follow their parents)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

three categories of learning

A
  • Associative learning is the formation of associations, or connections, among stimuli and behaviours; “If A happens, B is likely to follow.”
  • Non-associative learning involves changes in the magnitude of responses to stimuli, rather than the formation of connections between them.
  • Observational learning (a.k.a. social learning/modelling) occurs when one organism watches the actions of another organism, and provides the advantage of transmitting information across generations within families and cultures.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

two types of associative learning

A
  • Classical conditioning (a.k.a. Pavlovian conditioning) is when associations are formed between two stimuli that occur sequentially in time (e.g. if a child sees a bee and gets stung, the child forms a connection between seeing bees and the pain of bee stings; leading to them feeling frightened the next time they see a bee).
  • Operant conditioning (a.k.a. instrumental conditioning) is when associations are formed between behaviours and their outcomes (e.g. if you park illegally and get a hefty ticket, you are likely to pay more attention the next time you park).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

two types of non-associative learning

A
  • Habituation is when reactions to repeated, unchanging, harmless stimuli decrease (e.g. someone who is not accustomed to young children may find it alarming to witness two kids who are screaming and rolling on the ground, whereas their mother (who is accustomed to the behaviour) wouldn’t bat an eye).
  • Sensitization is the increased reaction to many stimuli following exposure to one strong stimulus (e.g. those who experience an earthquake experience exaggerated responses to movement, light, or noise).

Habituation ensures precious resources aren’t wasted when monitoring low-priority stimuli, whereas sensitization is useful in detecting high-priority stimuli.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

implicit vs. explicit learning

A

Implicit learning occurs in the absence of conscious awareness, whereas explicit learning (what typically comes to mind when we think of “learning”) involves conscious awareness.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

stimuli related to classical conditioning

A

Conditioned stimuli (CS) refer to environmental events whose significance is learned through classical conditioning, whereas unconditioned stimuli (UCS) elicit a response without prior experience, due to an innate biological significance.

In Pavlov’s experiment, dogs heard the sound of a ticking metronome (CS) before food (UCS) appeared.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

responses related to classical conditioning

A

Conditioned responses (CRs) are learned through classical conditioning, whereas unconditioned responses (UCRs) require no previous experience.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

acquisition

A

the development of a CR; it must be contiguous (closeness in time) and contigent (correlation between the CS and UCS)

CONTIGUITY:

  • If the CS occured long before the UCS, the organism may not view the two as related.
  • If the CS occured simultaneously or after the UCS, it would not be a useful signal.

CONTINGENCY:

  • Learning about a reliable signal is easier than learning about a signal that occurs only sometimes.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

extinction

A

the reduction of a learned response

  • in classical conditioning, extinction occurs when the association between the CS and the UCS is broken
  • in operant conditioning, extinction occurs when the consequence no longer follows the learned behaviour
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

spontaneous recovery

A

during extinction training, the reappearance of CRs after periods of rest; it takes time for the new learning to replace the old

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

inhibition

A

when a CS predicts the non-occurrence of an UCS

e.g. A predator at a watering hole in hunting mode is an excitatory CS eliciting fear, but a predator relaxing after a recent kill and calmly drinking water is an inhibitory CS that tells the animal that the predator is unlikely to attack soon.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

stimuli generalizations

A

the tendency to respond to stimuli that are similar to an original CS

e.g. If our ancestors had one bad experience with a lion, it would make sense to avoid all lions, and animals with lion-like characteristics.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

discrimination

A

a learned ability to distinguish between stimuli

e.g. If you present food following a high tone, but never a low tone, a dog will initially learn to salivate to both pitched tones, but as learning progresses, will eventually learn to differentiate between the abilities of the two stimuli to predict food.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

higher-order conditioning

A

learning in which stimuli associated with a CS elicit CRs

e.g. A person who was bitten by a dog might show fear the next time the dog is seen (CS). The sight of the dog could subsequently act more like an UCR, and produce fear in response to other stimuli, like hearing the dog bark, that might signal the dog’s appearance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

latent inhibition

A

the slower learning that occurs when a CS is already familiar, compared to when the CS is unfamiliar

e.g. If you’ve eaten lots of pizzas over time and get sick after eating one, you’d probably not associate the pizza with sickness. However, if you got sick the first time you ate chocolate-covered ants, you’d associate the two.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

the Rescorla-Wagner model

A

Early in training, learning proceeds more rapidly when the association (between the CS and UCS) is new and surprising. However, later in training, learning is slower as the association is now familiar and no longer surprising.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

taste aversion

A

when the sight, smell, or flavour of a food (CS) has been paired in the past with illness (UCS), resulting in the dislike of said food (CR)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Garcia and Koelling’s rat experiment

A

Rats were given either sweetened water (“tasty water”), or normal water that triggered a light and clicking sound when drank (“bright-noisy water”). The rats were then either injected with lithium chloride to induce nausea, or were shocked. Rats that drank tasty water made quicker associations with the nausea, and rats that drank bright-noisy water made quicker associations with the shock.

This experiment had profound implications on classical conditioning, and behaviourism as a whole, as it challenged Pavlov’s views that stimuli could be easily interchangeable and prompted a renewed interest in the biological preparedness to learn things.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Albert’s white rat experiment, and its significance

A

In 1920, John B. Watson and Rosalie Raynor conducted an experiment with 9-month-old Albert. When Albert would play with a white lab rat (CS), Watson and Raynor made a loud noise (UCS) by hitting a steel bar with a hammer. Albert would then get frightened by the noise (UCR). A week later, when Albert was again offered the rat, he was afraid (CR); his fear generalized to other white, furry objects, like rabbits, dogs, and fur coats.

This experiment demonstrated that fears could potentially result from classical conditioning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

exposure therapy (flooding)

A

treating phobias by exposing people to fear-producing stimuli in a manner that is safe, until they no longer respond (i.e. extinction)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

counter-conditioning, and Peter’s leporiphobia

A

the substitution of one CR for another opposite response

e.g. In a 1924 experiment, Mary Cover Jones treated Peter, a 3-year old with a phobia of rabbits, by associating food (the new UCS) with the presence of a rabbit (CS). Eventually, Peter was able to pet the rabbit while eating.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

two applications of counter-conditioning

A
  • Aversion therapy is when a CS formerly paired with a pleasurable UCS, is instead paired with an unpleasant UCS (e.g. a compound containing silver interacts with nicotine to make tobacco cigarettes taste bad, and make smokers quit more easily).
  • Systematic desensitization is when people relax while being exposed to stimuli that elicit fear. Once the person is relaxed, the fear stimulus is gradually introduced.
26
Q

addiction and classical conditioning

A

A major challenge for those recovering from addiction is that environmental cues (CSs) associated with the effects of substance use (UCSs) can elicite cravings (CRs) (e.g. a visit to an alcoholic’s favourite bar can lead to relapse).

27
Q

latent inhibition and prejudice

A

If children grow up with little exposure to people outside of their own race, they will associate their own (familiar) race with other attributes much slower, but will quickly form stronger associations with other (unfamiliar) races much quicker (i.e. news reports about crime).

28
Q

Increased creativity is associated with a ________ latent inhibition.

A

reduced

29
Q

Skinner box

A

A specially adapted cage, named after it’s creator B. F. Skinner, that allows researchers to investigate the results of reinforcement and punishment on the likelihood that the rat will press a bar.

30
Q

the four classes of consequences

A
  • positive reinforcement
  • negative reinforcement
  • positive punishment
  • negative punishment
31
Q

reinforcement vs. punishment

A

Reinforcement increases the frequency of a behaviour, whereas punishment decreases the frequency of a behaviour.

32
Q

positive reinforcement

A

increases the frequency of an associated behaviour by providing a desired outcome

e.g. Candy is given when trying to teach kids with autism how to speak.

33
Q

the Premack principle

A

whatever behaviour an organism spends the most time and energy doing is likely to be important to that organism

34
Q

two types of reinforcers

A
  • Primary reinforcers have natural roles in survival (e.g. food).
  • Conditioned reinforcers (a.k.a. secondary reinforcers) gain value from being associated with other things that are valued (e.g. if you always say “good dog” before giving your dog a treat, the use of the phrase “good dog” can reinforce the dog’s voluntary behaviour).
35
Q

negative reinforcement

A

increases the frequency of behaviours that allow an organism to avoid unpleasant consequences (i.e. escape/avoidance behaviours)

e.g. We open umbrellas to avoid getting wet.

36
Q

positive punishment

A

eliminates or decreases the frequency of behaviours by applying an aversive stimulus

e.g. A rat will stop pressing a bar in a Skinner box if each press results in an electric shock.

37
Q

negative punishment

A

eliminates or decreases the frequency of behaviours by removing something desirable whenever the target behaviour occurs

e.g. If food is made available in a Skinner box as long as the rat doesn’t press the bar, the rat will stop pressing the bar.

38
Q

the three conditions that must be met for punishment to have observable effects on behaviour

A
  • significance: if a punisher is too mild for a particular individual, there is little incentive for that person to change behaviour
  • immediacy: immediate punishments are more effective than delayed punishments
  • consistency: effective punishment must be uniform
39
Q

Skinner’s proposed alternative to punishment

A

extinction; learned behaviours stop when they are no longer followed by a reinforced consequence

40
Q

continuous reinforcement

A

reinforcing a behaviour every time it occurs

41
Q

drawback to continuous reinforcement

A

After a new behaviour is being learned, it’s inconvenient to continue with continuous reinforcement.

e.g. If dog owners want their dogs to walk with a loose leash, once the skill is learned, it doesn’t make sense to continue reinforcing the skill with treats.

42
Q

partial reinforcement

A

the reinforcement of a desired behaviour on some occasions, but not others

43
Q

ratio schedules vs. interval schedules

A

Ratio schedules depend on the number of responses produced, whereas interval schedules depend on the passage of time.

44
Q

fixed ratio (FR) schedule

A

a reinforcement schedule in which reinforcement occurs following a set number of behaviours (e.g. restaurants where you must make a certain number of purchases before getting a reward)

  • continuous reinforcement has an FR of 1 (one behaviour per reinforcer)
  • as the amount of work for each reward is increases, responding becomes slower
45
Q

variable ratio (VR) schedule

A

a reinforcement schedule in which reinforcement occurs following a variable number of behaviours (e.g. slot machines)

46
Q

fixed interval (FI) schedule

A

a reinforcement schedule in which the time that must pass before reinforcement becomes available following a single response is set to a certain amount

e.g. If a class has a test every three weeks, students are likely to increase their studying right before the test, rather than studying consistently throughout the term.

47
Q

variable interval (VI) schedule

A

a reinforcement schedule in which the interval of time between reinforcements is allowed to fluctuate around some average amount over the course of a session (e.g. random pop quizzes)

48
Q

the partial reinforcement effect in extinction

A

extinction occurs more rapidly following continuous reinforcement, compared to that following partial reinforcement

49
Q

the two factors that influence the partial reinforcement effect in extinction

A
  • the transition from a continuous schedule to extinction is more obvious than the transition from a partial schedule to extinction (e.g. if you are accustomed to being paid for a babysitting job everytime you work, you’ll notice when you haven’t gotten paid)
  • partial schedules teach organisms to persist in the face of non-reinforcement (e.g. when working regularly on a large project despite a much-delayed grade, persistence is key)
50
Q

the matching law

A

when exposed to 2+ reinforcement schedules simultaneously, preference is shown to the behavior that achieves the highest amount of reinforcement

e.g. People spend so much time playing video games, rather than spending time in real-life socializing, as they find it rewarding and satisfying.

51
Q

the method of successive approximations (shaping)

A

a method for increasing the frequency of behaviours that never or rarely occur

Shaping begins with the reinforcement of spontaneous behaviours that are similar to the target behaviour we want to train. As training continues, stricter requirements are given for reinforcement until the exact behaviour occurs.

An example of shaping with table manners:
1. “Thank you for picking up the spoon.”
2. “Thank you for putting the spoon in the food.”
3. Thank you for using the spoon to eat your soup.”

52
Q

shaping and the right amount of reinforcement

A
  • With too much reinforcement, learning stops because there is no incentive for change.
  • With too little reinforcement, the learner becomes discouraged.
53
Q

chaining

A
  • breaking down a complex behaviour into manageable steps
  • can be done forwards or backwards
  • useful for teaching new skills to children with special needs
54
Q

latent learning

A

learning that occurs in the absence of reinforcement; there is a difference between what has been learned and what is performed (e.g. doing badly on a test despite learning a lot of material)

55
Q

Tolman’s Maze, and his rebuttal against behaviourism

A

Edward Tolman placed food in the goal boxes of mazes for rats to find, and then blocked the path in a maze to find food, but allowed the rats to choose from a number of additional paths.

Early behaviourists believe that the rats learned a simple operant “turn here for food” association, and would hence choose paths most similar to the trained one. However, the rats didn’t do that, and instead showed evidence of forming cognitive maps; they were willing to turn in a different direction if that path led to food.

56
Q

social facilitation

A

the phenomenon in which for simple tasks (e.g. pedalling a bike), the presence of others makes us perform better

57
Q

token economy

A

an application of operant conditioning in which tokens that can be exchanged for other reinforcers are used to increase the frequency of desirable behaviours (e.g. money as tokens)

58
Q

behaviour therapy

A

the use of operant conditioning concepts (i.e. extinction, reward) to treat psychological and psychiatric disorders

59
Q

imitation

A

copying behaviour that is unlikely to occur naturally and spontaneously

60
Q

the four necessary cognitive processes in the modeling of others’ behaviour

A
  • Models that get our attention are more likely to elicit imitation.
  • There must be retention of what the model did.
  • Reproduction of the behaviour must be possible.
  • A person must have a motivation for imitating the behaviour.
61
Q

memes

A

the basic unit of cultural transmission