Learning Theory Flashcards
Ivan Petrovich Pavlov
Classical conditioning
You can condition the response to a stimulus.
Taking a previously neutral stimulus (bell) and creating a conditioned response (salivation) by association with an unconditioned stimulus (food). Bell is rung before the food is presented.
John B. Watson
Founder of Behaviorism, based on Pavlov’s work
All behavior is just conditioned responses.
Watson suggested that animal behavior, including human behavior, is primarily the result of conditioned responses, or in simpler terms, behavior tends to be based on responding to a given stimulus – just like Pavlov’s dogs responded to the stimulus of the bell or
the presence of food.
He terrorized Baby Albert to create fear in response to a previously neutral stimulus (white rat).
Edward L. Thorndike
Law of Effect—basis of operant conditioning
Learning by trial and error. The association between stimulus and response is a connection. A consequence strengthens or weakens this connection.
If doing something makes a good thing happen, I am more likely to repeat it. If a bad thing happens, I probably won’t do it again or as often.
Burrhus Frederic Skinner
Operant Conditioning
Making the Action more or less likely to occur depending on whether the Consequence was good or bad.
Proposed that behavior is controlled by a stimulus immediately followed by an action and a consequence. Introduced the term reinforcement.
Behavior which is reinforced tends to be repeated (stronger connection). Behavior which is not reinforced will tend to die out (weaker connection).
David Premack
Premack Principle, or relativity theory of reinforcement
An animal will do something they DON’T like to do so that they get to do something else that they DO like to do.
Form of operant conditioning.
Enjoyable behaviors are “higher probability.”
Unenjoyable behaviors are “lower probability.”
Reinforcing a lower probability target behavior by awarding the animal with the opportunity to engage in a more desirable, higher probability behavior.
Examples: Wait before walk. Veggies before dessert. Study before playtime.
Classical conditioning
Taking a previously neutral stimulus (bell) and creating a conditioned response (salivation) by association with an unconditioned stimulus (food). Bell is rung before the food is presented.
A learning process that occurs when two stimuli are repeatedly paired: a response which is at first elicited by the second stimulus is eventually elicited by the first stimulus alone.
Food > salivate (unconditioned response)
Food + bell > salivate
Bell > salivate (conditioned response)
Can happen intentionally, yet also happens organically in daily activities, or in single traumatic events.
Classical conditioning involves an involuntary response. (Scared a critter? “Classic.”)
aka Pavlovian Conditioning and Associative Learning
In classical conditioning, that response is an involuntary or automatic response. It can also create an emotional response.
Example: thunder while in car, doesn’t want to get in car anymore
Stages of classical conditioning
Simple:
before: there is a new stimulus (doorbell)
during: pairing the new stimulus (doorbell) with the old stimulus (treats)
after: the new thing (doorbell) and the involuntary response are paired
Now the dog hears a doorbell and looks to their person for a treat.
- Before conditioning (no learning has happened)
a. unconditioned stimulus (US) prompts
b. unconditioned response (UR) is a natural, reflexive response - During conditioning—learning
a. neutral stimulus (NS) happens before
b. unconditioned stimulus
c. NS becomes conditioned stimulus (CS) - After conditioning—association established
a. CS prompts conditioned response (CR)
b. the behavior which was the original UR is now a CR, as it is now happening in response to a CS - Later, a novel neutral stimulus can be paired with a conditioned stimulus to cause a conditioned response to a secondary conditioned stimulus
Second-order conditioning
aka higher-order conditioning
A neutral stimulus (NS) is paired with a conditioned stimulus (CS), creating a secondary conditioned response (CR) without direct involvement of the unconditioned stimulus (US).
The dog hears the bag of food rustling (CS) and comes running (CR) for dinner (US). Later, they hear the pantry door opening (NS), which is followed by the bag rustling (CS). Eventually, the pantry door makes them come running for dinner.
CC: Acquisition
When a neutral stimulus (NS) becomes a conditioned stimulus (CS).
The conditioned response (CR) behavior increases as the association is strengthened.
Acquisition is the learning bit—it’s when the new stimulus (bell) starts to mean something.
CC: Extinction
The conditioned response (CR) decreases as the association between the conditioned stimulus (CS) and the unconditioned stimulus (US) is weakened.
“Unlearning” the conditioned response (CR) (salivating) by consistently presenting the conditioned stimulus (CS) (bell) without the unconditioned stimulus (US) (food).
Spontaneous recovery
The re-emergence of a previously extinguished conditioned response (CR) following a delay.
Extinguished behavior (Patti pulling out) She did great for 2 months randomly pulled out at a coffee shop (spontaneous recovery)
Classical Counterconditioning
- Change to response to stimuli
- a new conditioned emotional response
Changing Ember emotional response to someone one new coming in the room. Stand at her crate and give her roasted chicken until the person is in the room and Embers body is relaxed.
Be sure to keep the animal under threshold of fear throughout the process.
classical conditioning Stage 1
No learning is takimg place yet.
US produces UCR
Uncondotiond Response is a natural reflexive response.
Classical conditioning stage 2
Aquisition Stage
A Neutral stimulus is paired with an unconditioned stimulus.
The neutral stimulus becomes conditioned stimulus in this stage
Classical conditioning stage 3
Is after learning.
The conditioned stimulus (CS) elisits the conditioned response. (CR)
CC: Desensitization
Is the process of very gradually exposing the dog to a scary stimulus, ensuring he stays within the threshold where he will not react or show signs of fear or stress. This is a planned out process ensuring the dog remains calm and neutral every step of the way
Operant conditioning (OC)
Founded on Thorndike.
Animal learns to associate a behavior with a consequence.
Skinner conducted experiments to study how behaviors are strengthened which is called reinforcement, or weekend which is called punishment.
A fundamental principal of operate conditioning is that a stimulus comes first followed by a response or a behavior and then a consequence.
ABC’s.
Antecedent
Behavior
Consequence
aka Instrumental Learning
The dog’s response is voluntary. They learn that there are consequences for their behavior.
Example: teaching a Sit, the dog makes an association between sitting and a treat. The learning is that the behavior of sitting results in the consequence of a reward. The dog has a degree of control in operant conditioning.
OC Reinforcement
Positive
Positive reinforcement is adding something that will increase the likelihood of that behavior happening again.
OC reinforcers
any stimulus that will help increase or strengthen a behavior
most common: food
OC Reinforcement Schedules:
Continuous Reinforcement Schedule (CRF)
Every correct response, a reward is given.
Intermittent Reinforcement schedule: Fixed Interval (FI)
A set and unchanging amount of time between rewards. This is the least productive and most susceptible to extinction. [BUT WHY?]
Intermittent reinforcement schedule: Variable Interval (VI)
Changing and unpredictable amount of time between rewards.
