Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

351 - Fundamentals of Learning > Schedules of Reinforcement > Flashcards

Schedules of Reinforcement Flashcards

1
Q

in the real world, instrumental responses _____ get reinforced each time they occur
what is the name for this concept

A

rarely
intermittent schedules of reinforcement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is a schedule of reinforcement and what do they determine for the isntrumental bhv

A

program or rule that determines which repsonse is followed by delivery of the reinforcer

rate pattern and persistence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what could a delivery of a reinforcer depend on

A

occurance of a certain nb of responses
time
presence of certian stimuli
occurrence of other responses
combination of these factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what do the different delivery of reinforcer schedules influence

A

how an isntrumental response is learned
how it is maintained
pattern of responding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

schedules of reinforcement are highly relevant to the ______ of bhv

A

motivation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

T or F: whether someone works hard or is lazy depends on their personality

A

F: more on schedule of reinforcement used

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what are some human applications for scheduled reinforcements for motivation

A

employers, workers, teachers, students

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

how are schedules of reinf studied in the lab

A

skinner box

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

who discovered brain stimulation reward (BSR)

A

Olds and Milner

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what did Olds and Milner find

A

rats press lever for electrical stimulation of certian areas in the brain (brain stimulation reward)
- self-stimulate till exhaustion (ignore food and water)
- press lever at very high rates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

which areas of the rbain support self-stimulation

A

multiple

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

T or F. some sites of the brain sustain self-stim, while others are aversive

A

T

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how often were animals reinforced in the first experiments

A

for every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is the simplest form of operant bhv

A

fixed ratio 1 (FR1) / continuous reinforcement (CRF)
1 pellet delivered/press of lever

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is an exmaple of continuous reinforcement

A

contingency management programs for substance use treatment (reward for clean urine test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what was the problem with FR1

A

time and resource consuming, dont need to reinforce every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is a simplle reinforcement schedule

A

1 single factor determines which occurrence of the instrumental response is reinforced (module 1 thing at a time)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what is the name for when reinforcement is not provided on every response

A

partial reinforcement (intimate reinf)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what factors can be manipulated in operant responding schedules

A

ratio: nb responses required for reward
interval: time/delay btw each reward

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

how can the ratio and interval variables vary

A

fixed or variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what are ratio schedules based on

A

ratio of responses required to recieve reinforcem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what is FR

A

fixed ratio schedule: reinforcm delivered after specific nb of responses
FR5: reinforcem every 5 responses
FR1: every response

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

what do fixed ratio schedules cause in bhv

A

post-reinfrocem pause (PRP): break in responding after each reinforcer
(Pre-ratio pause)
relates to procrastination

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

what is VR and RR

A

Variable ratio: nb presses required is unpredictable but varies around some mean (4,3,5,2,1 wihtout replacem)
random raito: with replacem, 1,2,3,4 or 5 every time
RR6: reinf every 4,5,6,7,8 repsonses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

T or F. the range of the VR can vary

A

T

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

what are life examples of variable ratio schedules

A

gambling, golfing, fishing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

what is FI + example

A

fixed interval: reinf for the 1st press after a fixed delay
FI2: reinf given 2min after 1st repsonse
paid/hour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

what is VI + example

A

variable itnerval: reinf for 1st press after variable delay
VI10: reinf given 8,9,10,11,12 min after 1st response
self-employed, uber: will make average hourly rate, but some hours better than others

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

example of FI vs VI for exams, which would u study more for

A

FI: fixed exams
VI: pop quizes +++

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

all ratios and intervals besides FR1 are cases of ____ ______

A

partial reinforcm: not every response is rewarded

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

why have so many different ratio schedules

A

different learning techniques

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

what is the best schedule for initial learning

A

FR1: fast, easy
if FR10 initially, will take a long time for animal to understand what to do

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

disadvantage of FR1

A

satiety and reduced effort cuz so easy

34
Q

what is the best way to get steady continuous bhv

A

variable raito and interval cuz cant predict, just always work cuz it might be just 1 away

35
Q

which (interval or ratio) produces steady reliable bhv over long periods of time

A

interval schedules

36
Q

Most jobs are on what type of schedule

A

fixed interval

37
Q

which schedule (I or R) will deliver higher rates of responding and why

A

ratio schedule
promote shorter inter-response times (IRT)

38
Q

what is Inter-response times (IRT) and how do they vary in ratio and interval schedules

A

time btw 2 responses being reinforced
Ratio: rapid responding = reinforced
Interval: reinforced only after allotted time, doesnt promote higher response rates

39
Q

which schedules provides more direct feedback function on performance

A

ratio
the more u work the more u get rewarded
interval: limit of rew in given time, (max)

40
Q

in ___ schedule, u cant increase reinf rate above a certain limit no matter how much ++ response

A

interval

41
Q

what jobs are on ratio schedule

A

doctors, lawyers, hairdressers
$ depend on nb of clients
can lead to burnout

42
Q

what jobs are on interval schedules

A

maxi, post office
+effort =/= +$
only hope hard work is recognized and results in raise

43
Q

is variability/uncertainty rewarding itself?

A

yes,

44
Q

does variability promote gambling bhv

A

yes by sensitixing our rew pathways (amphetamine)

45
Q

variable or fixed ratios are a source of stress and anxiety

A

variable

46
Q

what happens if u progressively increase ratio/interval

A

discouraged, give up

47
Q

what technique is used to measure motivation

A

progressive ratio (PR)
nm repsonses for rew increases every trial

48
Q

what is the end point measured in progressive ratio

A

break point (BP): last ratio attained BEFORE giving up

49
Q

what is an example of progressive ratio in life

A

$ pay for a coffe
effort in studying

50
Q

what imp finding of pigeons in a pelican

A

still have bhv 6 yrs later

51
Q

why did pigeons in pelican fail

A

public perception, technological advances

52
Q

how are choices in real life more complex

A

constantly making decisions
nb of choices are extensive
reinforcements are diverse

53
Q

how do we study decision-making

A

concurrent schedule: choose btw 2 response alternative, each reif on its own schedule of reinf (at the same time)

54
Q

T or F. in a concurrent schedule, animal needs to chose 1 at a time

A

F. animal is free to change back and forth btw response at any time

55
Q

what is best option: VI60 or FR10?

A

FR if easy
VI if hard
min effort for max rew

56
Q

how to calculate response rate

A

Bl/(Bl+Br)

57
Q

distribution of bhv in concurrent schedules is influenced by _____ ________

A

reinf schedules

58
Q

can the reinf rate be calculated

A

rl/(rl+rr)

59
Q

T or F. when reinf schedules on both options are the same, response and reinf rate will likely match

A

T

60
Q

what happens in concurrent schedules when 2 response alternative are not reinf on same schedule

A

matching law: relative rate of response on a particular repsonse doesnt depend on rate of reinf of that response alone, depends on rates of reinf of other alternative activities the ind may perform
we always favor best reinf, but always do both to check we are not missing anything
schedules we use to motivate ppl have to account for alternatives in their environment

61
Q

when does matching law not apply

A

undermatching: reduced sensitivity to particular resp or reinf
- dont chose it so often cuz less valuable
- sick of chocolate, so wont do bhv to get it anymore, too tired to do physical activity
overmatching: response bias to particular type of resp or reinf
- chose more cuz resp or outcome is prefered
- prefer to walk longer than sprint short
- prefer to get ice cream than chocolate

62
Q

what is choice with commitment

A

once selection is made, other alternatives no longer available (university) (apt)

63
Q

how is choice with commitment tested in animals

A

concurrent-chain schedules
- choice link: chose A or B schedule
- terminal link: B closed till A is completed (commitment)

64
Q

if given choice of A: VI and B:FI, which is more popular

A

VI prefered over FI for same overall rate of reinf
overvalue immediate rew even if less often

65
Q

do we always chose most optimal outcome when given choice

A

no, can be made to choose suboptimal
ex:
1. 0.2=1 ; 0.8=0
2. 0.2=0.5 ; 0.8=0.5

  1. is overall more beneficial, but we take 2 cuz there is certainty. we understand what the markers predict, sense of control (intolerance to uncertainty)
66
Q

what is self-control

A

complex choice
choose large delayed rew or immediate small rew

67
Q

why is it hard to motivate to do work for large but delayed rew

A

we want immediate
delay discounting: value of reinf declines w/ time (25$ today or 50$ in 2 yrs)

68
Q

delay discounting can also act as a measure of ____

A

impulsivity

69
Q

how can we measure self-control

A

choice btw 2 levers: 2 now vs 4 later
effort stays the same (press lever)

70
Q

why would keeping lever be problematic for self-control experiment

A

animal wont be able to determine what schedule is

71
Q

what type of function does delay discounting take mathematically

A

hyhperbolic decay

72
Q

what does the delay discounting equation say

A

big delay = small value
big magnitude = less affected by time
rapid decline as time goes, then more steady

73
Q

what can be inferred from delay discounting

A

when choice of immediate rew = delay rew: rate of discount

74
Q

what does delay discounting depend on

A

impulsivity
high : 100$ = 50$ in 10 days
low: 100$ = 5$ in 10 days

75
Q

what modification of delay discounting experiment makes it easier to have self-control

A

increasing delay for small and big rew
if u have to wait for both, will be willing to wait longer for big rew

76
Q

how does delay discounting vary with age

A

wait more with age, less impulsive

77
Q

what is low delay discounting rate correlated with

A

high IQ, education level, income, GPA

78
Q

what is the relation btw delay discounting and addiction

A

steeper delay discounting correlates with addiction
cause or consequence

79
Q

how to determine if addiction or delay discounting comes first

A

longitudinal study: low self-control is predictive of drug abuse

80
Q

T.F. self control can be trained

A

yes, by repeatedly using delayed rew

351 - Fundamentals of Learning (11 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions