Midterm 2 Flashcards
What is learning (2 pionts)
a process by which behaviour or knowledge changes as a result of experience
-allows us adapt to environment
what are the two processes of change in our development
-maturation and learning
what are the three types of learning
- classical conditioning
- operant conditioning
- cognitive learning
what is classical conditioning
associating stimuli with each other
one of two types of associative learning
Operant Conditioning
Associating responses with consequences
one of two types of associative learning
Cognitive Learning
Learning through observation and information
How Classical conditioning works:
after repeated exposure to stimuli with each other
The results of classical conditioning
Our natural response to one stimulus is now triggered by the new, predictive stimulus
Example of classical condition
see lightning (stimulus 1), hear thunder (stimulus 2)l; after repetition, we learn to cover our ears to lightning to avoid sound of thunder
How it works: (operant Conditioning)
we learn to associate our response (behaviour) with consequences
Results (oparant)
We learn to repeat behaviours that were followed by good results to avoid behaviour that were followed by bad results
Example (oparant)
a child learns to say ‘please’ (response) in order to get a cookie (good consequences) and learns to avoid grabbing the cookie because this is led to scolding and no cookie (had consequence )
Cognitive learning (how it works) (2 points)
- by observing events and the behaviour of others
- by using language to acquire information about events experienced by others
Pavlov’s Discovery
- (basic of classical conditioning)
- while studying digestion in dogs. Ivan Pavlov found that salivation was eventually triggered by neutral stimuli that predicted that arrivial of food such as,
- -> just seeing the food or dish
- -> seeing the person who brought the food
- ->just hearing that person’s footsteps
(before conditioning ) Neutral stimulus
a stimulus whihc doesnt tigger a response
Before conditioning
Unconditioned stimulus
a stimulus which triggers a response naturally, before/without any conditioning
During Conditioning
neutral Stimulus and unconditioned stimulus
repeatedly presented with the food (unconditioned stimulus)
Acquisition
refers to the initial stage of learning conditioning
- As the CS and US are paired, the strength of the CR grows
- Timing is important - the Cs should appear roughly half a second before the US for learning to occur
Extinction
refers to the diminishing of a conditioned response
-if the US stops appearing after the CS, then the CR decreases
After Extinction …. (processes of classical conditioning)
spontaneous recovery may occur, or a return of the CR despite no further conditioning
-Very likely to occur following a period of rest
Generalization (classical conditioning)
refers to the tendency to have conditioned responses triggered by similar or conditioned responses trigger by similar or related stimuli
-Ex: a child who learned to fear white rats is also afraid of white rabbits and santa’s beard (respond to MORE stuff)
Dicrimination
refers to the learned ability to only respond to a specific stimulus, preventing generalization
Example: a child who learns to fear white rats is only afraid of white rats and not grey or black rats (respond to LESS stuff)
Applications of classical conditioning (10)
-substance abuse immune response sexual arousal digestion reproduction territory defense learning about good bad foods advertising phobias
John B watson and playing with fear experiment (experiment)
An example of classical conditioning and phobias
- In 1920, 9-month old little Albert was not afraid of rats
- Watson and Rayner then clanged a steel bar every time a rat was presented to Albert
- Albert acquired a fear of rats, and generalized this fear to other soft and furry things
Reinforced (operant conidtioning begins)
behaviour is more likely to be tried again
example: A child punches another child to get a desired toy and it works; this child will likely to be try punching again.
Punished
behaviour is less likely to be tired in the future
ex: a child punishes another child to get a desired toy and gets sent to their room; this child is less likely to try punching again
Thorndike’s Law of Effects
States that behaviours that are followed by favourable concequences become more likely, and behaviours followed by unfavourable consequences become less likely
Skinners (expansion on thorndike’s principles and questions) (3 questions)
-How can we more carefully measure the effect of consequences on behaviouor?
what else can creatures be taught to do by controlling consequences?
What happens when we change the timing of reinforcement?
What did skinner invent
invented ‘the skinner box’ or “operant chamber”, which allowed detailed tracking of rates of behaviour (eg: lever pressing) over time
Reinforcement
refers to any feedback form the environment that makes a behaviour more likely to recur
Positive Reinforcement
adding something desirable
Negative Reinforcement
taking away something unpleasant
A cycle of reinforcement: temper tantrums
what happens if the parent gives into a temper tantrum and abides by the child’s demands??
The child’s tantrum is positively reinforced, so the tantrums will get stronger and more frequent
-The parent’s ‘giving in’ behaviour is negatively reinforced, so the parent will give in sooner and more often
What are the two types of negative reinforcement?
Avoidance learning
escape learning
Avoidance Learning
When a response is made in order to remove the possibility that the unpleasant stimulus will occur
Shaping
a behaviour by rewarding successive approximations to the behaviour is a way to train a new behaviour
example of shaping
In one well-known example, students shaped an instructor to stay left by smiling and nodding only when the instructor was to the left
Discrimination
refers to the ability to become more and more specific in what situations trigger a response
- shaping can increase discrimination, if reinforcement is only delivered when certain discriminating stimuli are present
(example: pigeons, seals, and manatees can respond to specific shapes, colours and categories of pictures).
Generalization (operant conditioning)
occurs when an operant response take place to a new stimulus that is similar to the original stimulus
-example: a dog trained to sit to the command “sit” may also sit when it hears a similar word “fit” or “sip”
Extinction (operant)
is the weakening of an operant response that results when reinforcement no longer available
example: a child no longer earns money for doing the dishes, so dish-doing decreases
Spontaneous recovery (operant)
occurs when a previously reinforces response return following a period of rest.
Reward Devaluation (operant)
occurs when a reinforcer loses some of the values
Ex, a rat pressing a bar for food may press the bar less if it is full rather than hungry
-this can obviously affect the vigour of behaviour
Delay of reinforcement
refers to how long after the behaviour occurs is the reinforcement delivered
learning much better if there is little delay
Schedules of rienfocement
refers to the rules of how often and when reinforcement is delivered
Continuous Reniforcement
the subject is rewarded every time they preform the target behaviour
(the behaviour is learned very quickly, but also stops quickly of reinforcement is no longer delivered
partial/intermittent reinforcement
the subject is rewarded only some of the time for doing the target behaviour
–>it takes longer to learn the behaviour, but it will persist longer without reward
Comparing continuous and partial reinforcement schedules:
- Continous reinforcement: –>Faster learning and faster exteniction
- ->Partial Reinforcement:
- Slower learning and more resistant to extinction
What are the two different schedules of partial/intermediate reinforcement
based on interval of time that has gone by or the certain ratio of rewards per number of instances of the desired behaviour
the two schedules Interval of time
Fixed interval schedule: rewarded very hour
Variable interval schedule:
reward after changing/random amount of time passes
the two schedules rate of time
Fixed ratio schedule: reward every five targeted behaviours
Variable ratio schedule: rewarding after a randomly chosen instance of the target behaviour
Which reinforcement schedule produces the most responding (ie, more target behvaiour)?
-each schedule produces a predictable pattern of responses when number of responses is measured over time
Punishment ( operant conditioning)
refers to any feedback from the enviroment that makes a behaviour less likely to recur
(the two types are positive and negative)
Positive Punishment
You ADD something unpleasant/aversive (eg. scold the child)
Negative Punishment
you TAKE AWAY something pleasant/desired (eg: no TV time, no attention)
What does severity have to do with punishment
the severity of punishment is not helpful decreasing a behaviour as making the punishments immediate and certain.
- the search for positive opposites - eg: ‘dont fight’ becomes ‘play nicely’
- ->in order to teach a desired behaviour, reinforce what’s right more often than punishing what’s wrong
Overview: (adding stimuli)
-Positive + Reinforcement (you get candy) [uses desirable stimuli] Strengthens target behaviours (you do your chores)
postive + punishment (you get scolded)
[uses unpleasant stimuli] Strengthens target behaviours (you do your chores)
reduces target behaviour (cursing)
Overview: (subtract stimuli)
negative-reinforcement (i stop yelling) [uses unpleasant stimuli] Strengthens target behaviours (you do your chores)
Negtaive-punishment (no cell phone) [uses desirable stimuli] Strengthens target behaviours
reduces target behaviour (cursing)
Applications of operant conditioning (school)
long before tablet computers, B.F. skinner proposed machines that would reinforce students for the correct resposes, allowing students to improve at different rates and work on different learning goals
Applications of operant conditioning (sports )
athletes improve most in shaping approach in which they are reinforced for the performance that comes closer and closer to the target skill
(eg hitting, pitches that are progressively faster)
Applications of operant conditioning (work)
some companies make pay a function of performance or company profit rather than seniority; they target more specific behaviours to reinforce,
Applications of operant conditioning (Parenting )
reward small improvements toward desired behaviours rather than expecting complete success; reward good behaviours rather than punish bad behaviours
Applications of operant conditioning (Training animals)
entertainment and to assist disabled people, the police, and the military
Basic Idea (CC and OC)
CC- assoicating events/stimuli with each other
OC-Assoicating chosen behaviours with resulting events
Response (CC and OC)
CC-Involuntary, automatic reactions such as salivating
OC- Voluntary actions “operating” on our environment
Acquisition (CC and OC)
CC-NS linked to US by repeatedly presenting NS before US
OC-Behaviour is associated with punishment or reinforcement
Extinction (CC and OC)
CC-CR decreases when CS is repeatedly presented alone
OC-target behaviour decreasing when reinforcement stops
Spontaneous Recovery (CC and OC)
CC-Extinguished CR starts again after a rest period (no CS) ‘
OC-Extinguished response starts again after a rest (no reward)
Generalization (CC and OC)
CC-When CR is triggered by the stimuli similar to the CS
OC-Response behaviour similar to the reinforced behaviour
Discrimination (CC and OC)
CC- Distinguishing between a CS and NS not linked to U.S
OC- Distinguishing what will get reinforced and what will not
Classical and operant conidtioning (examples of both)
Amy won jackpot on the slots, bells and whistles were going off all around her in the casino. Now, whenever she sees a slot machine with lots of bells and whistles, she feels a rush of excitement
Joey’s chore growing up was dishes. Every night after dinner, Jpey’s parents would sit down to watch the news while he was supposed to tend dishes. But every night, Joey was delayed in starting the dishes. He would get scolded and feel bad inside, and this usually happened right after the news began with its jaunty tune. Years later, whenever Joey hears the tune from the news, he feels bad inside
Early behaviorists in S-R learning
-implies that it would be possible to train any behaviour, and that all behaviours are equally trainable
Evolutionary history point
some realized that each species has an evolutionary history that makes it primed to learn some things faster/easier/better than others
with classical conditioning, some associations are learned more easily than others (examples)
- Rats were found to associate illness with a flavour rather than a tone, and to associate a shock with a tone rather than a flavour
- Male quail were found to have a sexual response link to a fake quail more easily than to a red light .
- Humans are more likely to develop phobias for things that have evolutionary significance (snakes, heights) rather than for things that are harmful in present day (guns, cars)
Sometimes innate tendencies actually interfere with classical conditioning
-pigeons tendency to peck a light that is associated with food is so strong, they will peck the light even if doing so means that they will not get fed
Operational conditioning, some associations are learned more easily than others: (examples)
-while a dog easily learns to detect different scents, it could never learn to put on clothes
A cat can learn to pull a lever to escape a box but it can’t learn to yawn to escape a box
Sometimes innate tendencies actually interfere with operant conditioning (example)
-The Breland’s found that a raccoon couldn’t learn to drop coins in a piggy bank for food reward
Early behaviorists believed in S-R learning (what does that imply)
- Implies that as long as S and R occurred close together in time and were followed by reinforcement, learning would happen
- no need to discuss, inter, or contemplate mental events
What was the other argument to S-R learning?
-some argued that mental events need to be considered
-Called S-O-R (cognitive) learning
‘O’ = organism’s cognitive representation of the world
Expectancy model (Rescora And Wagner, 1972)
- CS produces the expectancy that the US will follow
- The imprtant factor in classical conditioning isn’t how often the CS-US paring occurs, but rather how 3well the CS predicts the US
Cognition in classical conditioning (example)
Group 1 learn more about CS then Group 2, even though both groups had CS –>US 50 times
-group 1: CS –>US 50 times
-group 2: CS –>US 50 times
no CS –> US 50 times
Latent Learning (tolman and Honzik, 1930)
-learning that is not immediately expressed in behaviour until reinforcement is available contingent on the behaviour
Cognition in operant conditioning
- Cognitive map (Tolman, 1948):
- ->mental representation of spatial layouts
- Suggests the learning provides knowledge and expectation of what leads to what leads to what
- -> after learning simple maze many rats chose 4th (most direct) path
Problem solving (kohler, 1925)
- The “eureka” moment
- sudden perception of useful relationships
Observational learning
- refers to learning that occurs by observing the behaviour of a model
- it is highly adaptive
- ->if learning were trial and error on our own we would learn very slowly
- from watching others, we can learn how to do things when to do things etc…
What are the processes in observational
-attention, memory, motor reproduction of behaviour, motivation
Baudura’s (1961, 1963) bobo doll experiment
- showed that children are ready to learn from others
- children who watched an adult act aggressively toward the doll were more likely to behave aggressively than children who did not watch the adult aggressively
Mirror neurons
- presence of mirror neurons also show that we are wired to learn from others
- –>mirror neurons fire in the sea pattern when we watch other doing or feeling something as if we were doing the action or having the feeling ourselves!
Implications of our ‘readiness’
our ‘readiness’ to learn from others in our modern time with ample media violence:
-Research shows that viewing media violence leads to increased aggression (fights) and reduced pro social behaviour (such as helping an injured person)
The story of H.M
- H.M. was 27 years old in 1953 when he had most of his hippocampus and surrounding brain tissue removed
- operation was successful, but he could no longer form new memories
- he was able to learn and preform new tasks, even with mno memory of the task!
- ex: improves on mirror-trace task over trails
Memory
processes that allow us to record and retrieve experiences and information
The Atkinson-Shiffren Model
- The first model of memory
- Assumes memory is multistage process in which information flows along three separate and interacting memory stores
The Atkinson-Shiffrin Model (pathway)
Sensory Organs –> Sensory Memory –> Short-term Memory –> long term memory
Sensory Organs and between sensory memory (The Atkinson-Shiffrin Model)
Eyes, Ears
-Tranduction from physical energy (sensation) into neural impulses
Sensory Memory and between short term memory (The Atkinson-Shiffrin Model)
-limitless, but short-lived
2 options
-forgetting
-Attention: helps select a portion of the sensory memory for further processing
short term memory and the stuff between to long term memory(The Atkinson-Shiffrin Model)
7+- 2 itmes; last 30 seconds
(double arrow)
forgetting
-information is rehearsed some information is encoded into long term memory
-other way …. later , some information can be retrieved
long term memory (The Atkinson-Shiffrin Model)
unlimited, but not always accessible
-forgetting
Sensory memory (detailed)
-Information picked up by our senses and enter sensory memory
–>briefly holds sensory information
two methods
iconic memory
echoic memory
-Sensory memory is in the initial information processor
–>selects what details to pay attention to
–>Sends this information on the STM for rehearsal and further processing
Iconic Memory
visual memory is less than 5 seconds
Echoic Memory
Auditory memory lasts roughly 5 seconds
Sensory memory (example)
-studied by sperling (1960)
the letters and the music tones examples
Relationship between sensory memory and attention
obvious with a phenomenon called change blindness
–> failure to notice subtle changes in briefly presented stimuli unless attention is directed to those changes