Unit 8: Learning Flashcards
Ivan Pavlov
Russian Physician
Nobel Prize 1904, Digestion
Classical conditioning on accident
Associative learning
when two or more things are paired together in time and/or space
neutral stimulus (NS)
a stimulus that doesn’t elicit any particular reflex
A student gets nervous every time the teacher hands out pop quizzes. Eventually, the student starts feeling anxious whenever they see the teacher walk toward the desk, even if no quiz is given.
Neutral Stimulus (NS): 🏫 Teacher walking toward the desk (Initially, this doesn’t cause anxiety.)
Unconditioned Stimulus (UCS): 📄 Pop Quiz (Naturally causes stress.)
Unconditioned Response (UCR): 😰 Anxiety in response to the quiz (A natural reaction to unexpected tests.)
Conditioned Stimulus (CS): 🏫 Teacher walking toward the desk (After repeated pairings with quizzes, it now causes anxiety.)
Conditioned Response (CR): 😰 Anxiety in response to the teacher walking toward the desk (The learned reaction.)
Unconditioned Stimulus (UCS)
Unlearned stimulus
A student gets nervous every time the teacher hands out pop quizzes. Eventually, the student starts feeling anxious whenever they see the teacher walk toward the desk, even if no quiz is given.
Neutral Stimulus (NS): 🏫 Teacher walking toward the desk (Initially, this doesn’t cause anxiety.)
Unconditioned Stimulus (UCS): 📄 Pop Quiz (Naturally causes stress.)
Unconditioned Response (UCR): 😰 Anxiety in response to the quiz (A natural reaction to unexpected tests.)
Conditioned Stimulus (CS): 🏫 Teacher walking toward the desk (After repeated pairings with quizzes, it now causes anxiety.)
Conditioned Response (CR): 😰 Anxiety in response to the teacher walking toward the desk (The learned reaction.)
Unconditioned Response (UCR)
Unlearned Response
UCR = CR
A student gets nervous every time the teacher hands out pop quizzes. Eventually, the student starts feeling anxious whenever they see the teacher walk toward the desk, even if no quiz is given.
Neutral Stimulus (NS): 🏫 Teacher walking toward the desk (Initially, this doesn’t cause anxiety.)
Unconditioned Stimulus (UCS): 📄 Pop Quiz (Naturally causes stress.)
Unconditioned Response (UCR): 😰 Anxiety in response to the quiz (A natural reaction to unexpected tests.)
Conditioned Stimulus (CS): 🏫 Teacher walking toward the desk (After repeated pairings with quizzes, it now causes anxiety.)
Conditioned Response (CR): 😰 Anxiety in response to the teacher walking toward the desk (The learned reaction.)
Conditioned Stimulus (CS)
Learned Stimulus
NS = CS
A student gets nervous every time the teacher hands out pop quizzes. Eventually, the student starts feeling anxious whenever they see the teacher walk toward the desk, even if no quiz is given.
Neutral Stimulus (NS): 🏫 Teacher walking toward the desk (Initially, this doesn’t cause anxiety.)
Unconditioned Stimulus (UCS): 📄 Pop Quiz (Naturally causes stress.)
Unconditioned Response (UCR): 😰 Anxiety in response to the quiz (A natural reaction to unexpected tests.)
Conditioned Stimulus (CS): 🏫 Teacher walking toward the desk (After repeated pairings with quizzes, it now causes anxiety.)
Conditioned Response (CR): 😰 Anxiety in response to the teacher walking toward the desk (The learned reaction.)
Conditioned Response (CR)
Learned Response
UCR = CR
A student gets nervous every time the teacher hands out pop quizzes. Eventually, the student starts feeling anxious whenever they see the teacher walk toward the desk, even if no quiz is given.
Neutral Stimulus (NS): 🏫 Teacher walking toward the desk (Initially, this doesn’t cause anxiety.)
Unconditioned Stimulus (UCS): 📄 Pop Quiz (Naturally causes stress.)
Unconditioned Response (UCR): 😰 Anxiety in response to the quiz (A natural reaction to unexpected tests.)
Conditioned Stimulus (CS): 🏫 Teacher walking toward the desk (After repeated pairings with quizzes, it now causes anxiety.)
Conditioned Response (CR): 😰 Anxiety in response to the teacher walking toward the desk (The learned reaction.)
Classical Conditioning Definition
learning that takes place when an originally neutral stimulus (NS) comes to produce a conditioned response CR because of its association with an unconditioned stimulus US.
Acquisition
Process of learning an association between the CS and UCS
Repeated pairings
↳ strengthens the association
First few trials produce the greatest rate of learning
Extinction
Occurs when the CS is no longer paired with UCS
↳ gradual weakening and eventual disappearance of the CR
Spontaneous Recovery
The return of a CR after it was thought to be extinguished
!!! can ONLY occur after extinction !!!
Generalization
Responding to stimuli similar to the CS
以相同的方式响应类似的刺激
一个孩子害怕一只狗，然后就会变得害怕所有的狗。
Example:
CS = metronome 60 beats/min
↳ Generalized to 50 bpm or 70 bpm
Discrimination
Opposite of Generalization
Learning to differentiate between similar stimuli.
学习区分刺激
害怕一只狗的孩子不会害怕其他狗。
EX: Person attacked by dog develops fear of large dog
↳ continues good experiences with small dogs
↳ person may fear only large dogs
Higher Order Conditioning
when an existing conditioned stimulus (CS) is used as a foundation to condition a new stimulus
Counterconditioning
反条件作用是一种行为疗法技术，通过将恐惧刺激与积极或中性的体验联系起来，用更理想的反应取代不良反应（如恐惧或焦虑） 。
将负面刺激与正面刺激配对
反条件作用的例子：
🔹害怕狗 → 积极联想：
孩子害怕狗（否定回答）。
治疗师一边给孩子糖果或表扬，一边介绍一只安静的小狗。
随着时间的推移，孩子会把狗与积极的感觉联系起来，而不是恐惧。
Pairing CS with a new UCS to change response
Systematic desensitization
Gradual exposure to phobias paired with relaxation techniques
Taste Aversion
One-trial learning (ex - avoiding food after food poisoning)
innate behavior affects learning
Lab rats lack throw up reflex
↳ rats easily learn taste aversions
↳ Nausea-drug faster than ⚡️
Biological Preparedness
Animals predisposed to learn survival-related associations quickly
EX：味觉和恶心之间的关联
Habituation
Decreased response to a repeated stimulus
Ex: Ignoring the ticking of a clock after prolonged exposure
Law of Effect
产生有利后果的行为更有可能重复，而产生不利后果的行为不太可能重复
Positive Reinforcement
Positive means “+” (ADD)
Adding a pleasant stimulus to increase a behavior.
孩子因为做作业而得到糖果，因此他们会更加努力学习。
Negative Reinforcement
Negative means “-” (SUBTRACT)
Removing an unpleasant stimulus to increase a behavior.
服用止痛药来消除头痛，鼓励将来使用
Positive Punishment
Adding an unpleasant stimulus to decrease a behavior.
一名学生因迟到而被留堂，从而减少了迟到次数
Negative Punishment
Removing a pleasant stimulus to decrease a behavior.
一名青少年因违反宵禁而被剥夺使用手机的权利
Primary Reinforcers:
Innately satisfying, do not require learning
Ex: Food, water, shelter, warmth, physical touch
Secondary Reinforcers (Conditioned Reinforcers):
Acquire value through learned association with primary reinforcers
Ex: Money, grades, praise, tokens
Shaping
reinforcing successive approximations of one behavior to the exclusion of other behavior
Instinctive Drift
Limits on behaviors due to biological predispositions
EX: raccoon wash food instinctive → difficult to train to drop coin in piggy bank (rub coins together)
Learned helplessness
decrease response after exposure to uncontrollable aversive events
Continuous
Reinforcement given EVERY time after behavior occurs
Quickest way to train new behavior
Quickest to extinguish
Partial (or Intermittent) Reinforcement
部分（间歇性）强化是指只在某些时候而不是每次都强化行为。与持续强化相比，这使得行为更能抵抗消退。
Fixed Ratio (FR)
Reinforcement after a set number of responses.
A worker gets paid every 10 items they produce. 🛠💰
Variable Ratio (VR)
Reinforcement after an unpredictable number of responses.
Slot machines give payouts at random spins. 🎰💵 (Most resistant to extinction!)
Fixed Interval (FI)
Reinforcement after a fixed amount of time.
A paycheck comes every two weeks, regardless of performance. ⏳💸
Variable Interval (VI)
Reinforcement after unpredictable time intervals.
Checking for a social media notification, which appears at random times. 📱🔔
Social Learning
Learning occurs by observing others rather than direct reinforcement
Observational Learning
also called modeling
是一种学习形式，个人通过观察他人而不是通过直接经验来获得新的行为。
Modeling
是一种学习形式，个人通过观察他人而不是通过直接经验来获得新的行为。
Vicarious conditioning
通过他人行为的后果来学习（不需要直接强化）
Cognitive Learning
Learning that involves mental processes such as thinking, memory, and problem-solving.
Insight Learning
突然意识到（学习）问题的解决方案
Latent learning
它会发生，但不会立即表现出来，除非有理由使用它
Cognitive Maps
mentally mapped the maze
