Brainscape's Knowledge GenomeTM


Top Flashcards (Certified)
All Flashcards

351 - Fundamentals of Learning > Instrumental Conditioning > Flashcards

Instrumental Conditioning Flashcards

(67 cards)

Start Studying
1
Q

T/F: elicited behaviors and classical conditioning requires participants to make a particular response to obtain CS or UCS

A

F: they elicit responses but they are not required

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what type of behavior requires a response to produce a desired environmental outcome

A

instrumental or goal-directed behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what animals did Edward Thorndike study and what was the study

A

cats in puzzle boxes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

with experience, what are the results of the edward thordike study and the name he gave the principle

A

less frequent ineffective responses
more frequent successful responses
“Law of effect”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what did throdikes study give birth to

A

learning curves: time it takes to get out decreases w/ nb of trials

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is the law of effect

A

responses that produce satisfying effect in particular situation become more liekley to occur again in that istuation and responses that produce a discomforting effect become less likely to occur again in that situation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is a synonym for law of effect

A

reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

reinforcement states that: through learning, the cues, condition,context,state of an individual will trigger a response if that repsonse previously resulted in smth ___________

A

positive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is an example of reinforcement

A

cat presses lever to get food

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what type of learning is reinforcement

A

S-R learning: stim elicits a particular response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

who discovered instrumental/operant conditioning

A

jerzy Konorski

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

who popularized operant bhv and respondent bhv

A

B.F. Skinner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what is operant bhv

A

an item of bhv that is initially spontaneous rather than a response to a prior stimulus but whose consequences may reinforce or inhibit recurrence of that bhv

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what did skinner invent

A

skinner box

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is a method for measuring instrumental bhv

A

discrete-trial procedures
distinct trials w/ beginning and end
Start box to Goal box

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what type of discrete-trial procedures are used (material)

A

runway (straight-alley maze)
T-maze

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what do the 2 types of mazes measure

A

runway: running speed or latency
T-maze: choice btw 2 outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what do discrete trials infer

A

expeirmenter must start and stop each trial: reduces learning and performance opportunities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what do free operant procedures allow

A

animal can repeat responses without constraint

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what animals were typically used for the skinner box and which are used now

A

pigeons
small rodents (rats, mice)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what is a false myth abt skinner

A

skinner box on daughter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is in a skinner box

A

operandi such as lever where animal can perform an operant response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what are some examples of operant responses

A

lever, nsoepokes, keypecks…

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

can animals use differetn ways to performe the same operant response

A

yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
what is normally triggered by operant response
reward (food, water, drugs)
26
how is learning measured in skinner box
response rate, how often responses happen
27
what is essential in operant training
careful shaping of bhv by training small, easy, successive steps get rat to look at lever, get closer, touch, press
28
what is shaping
shape bhv through successive approximation initially rewarding bhv close to intended outcome
29
is pushing a lever a natural bhv for rats
nope
30
what did skinner argue that operant conditioning can be used as
to produce extremely complex bhv (language) with rewards and punishments, encourage organism closer to desired bhv each time
31
shaping is at the origin of _____ _____ ________
behavioral modification therapies stickers
32
T.F. in all instrumental conditioning, participant response does not necessarily produce outcome or consequence
F. yes it does
33
what form can be the outcome or consequence
pleasant or unpleasant
34
what is the name for a pleasant outcome
appetitive stimulus
35
what is the name for an unpleasant outcome
aversive stimulus
36
how can operant response affect the outcome
elicit or prevent the outcome
37
what is the goal of reinforcement vs punishment
r: icrease bhv p:decrease bhv
38
what is +/- reinforcement
+: add smth good (candy, praise) -: remove smth bad (nagging, shock)
39
what is +/- punishment
+: add smth bad (shock, spanking) -: remove smth good (privileges, phone) omission training
40
what term is often misused in relation to punishm and reinforcem
negative reinforcem when meaning positive punishment
41
what categories can be made of negative reinforcement
escape: remove noxious stim (turn off alarm) active avoidance: bhv avoids noxious stim (study to avoid bad grade)
42
what are some limitations with animals for instrumental conditioning
trial and err approach: - animal does nothing - animal never does wanted bhv
43
what are some problems concerning punishment
- punished bhv is suppressed not forgotten (bhv returns when no punishm) - increased aggression - creates fear that can generalize to unwanted bhv (fear school cuz bad grades --> stop going to school) - doesnt guide to wanted bhv
44
what are some limitations with the world for reinforcem and punishm + exmaples
often unclear or contradictory - crash car (punishm), then emptahy and support from friends and fam(reward) - friends celebrate (rew) when u dont do homework to hang out (puni) - underage drinking: cool (rew), gets arrested (puni)
45
what can happen if punishm is provided in the form of attention
can reinforce > punish bhv - kid gets attention they want so keep doing bhv
46
how can attention seeking w/ punishm be avoided and the complications
omission training - differential reiforcement of other bhv (DRO) (ignore bad bhv) - ignore kid shamish window while praising good could lead to even more extreme bad bhv to get ur attention
47
what did thorndike discover when trying to condition bhvs
belongingness: some responses more naturally belonged to reinforcer, some bhv are harder to condition than others - diff to condition cats to yawn to get out of box compared to pulling string
48
which bhv belong with the reinforcer
ones that become more likely when hungry are readily reinforced with food vs responses less likely when hungry are diff to train as instrumental repsonses - racoon washes coin cuz associated with food - they will behave in relation/intention of UCS
49
what determines the effectiveness of a reinforcer
quantity and quality (work harder for better rewards)
50
what is the crespi effect
previous history of reinforcement affects value of reward - positive/neg bhv contrast effects - small/large or large/small
51
what can devalue other forms of reward with drug addiction
anticipatory negativev contrast - had 4, then 14 :)) - had 64, then 14 :((( never gonna b as good as drug more value for drug, less for everything else
52
relationship btw response and reinforcer determine _____
learning
53
what are the 2 relationship variables btw response and reinforcer
contiguity and contingency
54
what is the temporal relation btw resp and reinf
temporal contingency: dilvery of reinforcer immediately after response (how close they r in time)
55
what is the causal relation and a synonyme
response-reinforcer contingency how necessary and sufficient the instrumental repsonse is to produce the reinforcer
56
temporal and causal factors are _______ of each other
independent strong temporal relation =/= strong causal
57
how is gambling related to temporal and causal factors
strong temporal: every slot = reponse low causal: few slots = reward
58
what type of temporal relation is most effective, why
immediate reinforcement credit assignment bias: delay makes it hard to determine what response causes reinforcer
59
what are secondary/conditioned reinforcers
stimuli previously associated with the reinforcer that helps bridge gap during the delay - marking procedure to mark successful completion of the task improves learning
60
what are the results for close vs far marking procedures
- close: fast learning, the light after pressing shows that it did smth - far: reduce learning, the light b4 food tells animal that pressing didnt do anything and the light just predicts food and nothing predicts the light
61
what is repsonse-reinforcer contingency
causal factor
62
what can lead to superstitious bhv
reward delivered at intervals irrespective of what the animal does - accidental reinforcement: animal thinks turning causes it, but its just every 10 seconds
63
what are examples of superstitious bhv in humans
- gambling (slot machines promote superstitious bhv) - professional sports (lucky shorts, rituals b4 game)
64
what was skinners superstitious experiment
pigeons reinforced /15sec, what they were doing at the time of the food, re-do dont try to do nothing cuz odds are x causes y
65
what can happen if there is no contingency and causal link btw response and outcome
learned helplessness effect (lack of control) - animal exposed to shock stop trying to learn how to stop it cuz nothing does
66
what is the consequence of learned helplessness effect
undermines ability to learn a new instrumental response (they learned absence of pwr and control
67
what could reduce learned helplessness effect
learning to predict shock termination/absence - reduce harmful effects of stress they feel like they have more control, awareness, less powerless, intellectual control

351 - Fundamentals of Learning (11 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2025 Bold Learning Solutions. Terms and Conditions