Topic 4 (midterm 2) Flashcards
operant (instrumental) conditioning
learning that is controlled by the consequences of the organisms behavior
reinforcement
process in which a behavior is strengthened by the immediate consequence that reliably follows its occurrence
reinforcer
any event or stimulus that follows an operant response and increases or maintains its future probability
escape behavior
when operant behavior increases by removing an ongoing event or stimulus. Ex. pressing a lever to stop an electric shock
avoidance behavior
when operant behavior increases by preventing the onset of an event or stimulus. Ex. Pressing a lever to prevent the start of an electric shock
discrete trial procedures
instrumental response produced once per trial. each trial ends with removal of animal from apparatus. (i.e. there is 1 trial, animal is removed from apparatus, there is a “reset”, and then there is another trial)
free operant procedures
animal remains in apparatus and can make many responses. No intervention by examiner.
cumulative record
based on old cumulative recorder device . slope specifies the rate if change in behavior for every unit of time.
unconditional (primary) reinforcer
a reinforcer that acquired its properties as a function of species evolutionary history. (i.e. stimuli and events that have phylogenic importance)
conditional (secondary) reinforcer
otherwise neutral stimuli or events that have acquired the ability to reinforce due to a contingent relationship with other, typically unconditioned, reinforcers.
variables affecting reinforcement
immediacy, specific reinforcer used, task characteristics, contingency, contiguity
motivating operations
establishing operations that make a stimulus more effective as a reinforcer at a particular time. (ex. deprivation)
abolishing operations
make a stimulus less potent as a reinforcer at a particular time. (ex. satiation)
schedule reinforcement
a rule describing the delivery of reinforcement. Different schedules produce unique schedule effects
continuous reinforcement (CRF) schedule
behavior is reinforced each time it occurs.
types of intermittent reinforcement schedule
fixed ratio, variable ratio schedule , fixed interval schedule, variable interval schedule
Fixed ratio (FR)
behavior reinforced after a fixed number of times. generates post reinforcement pause (PRP)
post reinforcement pause (PRP)
pausing typically increases with ratio size and reinforcer magnitude
variable ratio schedule (VR)
the number of responses needed varies each time . ratio requirement varies around an average. 2 variations are random ratio and progressive ratio
random ratio
schedule is controlled by a random number generator.
progressive ratio
ratio requirement move from small to large
fixed interval schedule (FI)
behavior is reinforced when it occurs after a given period of time
variable interval schedule (VI)
the timing of the response needed varies each time. Interval varies around an average.
Premack principle
in nature, different behaviors have different probabilities of occurring. e.g., eating is high probability and pressing a lever is low probability.
High probability can reinforce low probability but not vice versa.
controlling stimulus (S)
a stimulus that changes the probability of an operant behavior.
discriminative stimulus (S^D)
a stimulus or event that precedes an operant and sets the occasion for its reinforcement. (Ex. green light). present when a behavior is reinforced
extinction stimulus (S^ delta)
a stimulus or event that precedes an operant and sets the occasion for its non-reinforcement. (ex. red light). present when a stimulus is not reinforced
discrimination
the ability to differentiate between different stimuli and respond appropriately to each.
stimulus control
a change in operant behavior that occurs when either discriminative stimulus or extinction stimulus is presented
discriminative index
a measure of the stimulus control exerted by a discriminative stimulus or extinction stimulus
generalization
the tendency to respond similarly to different but related stimuli or situations
stimulus generalization
occurs when a learned response, initially associated with a specific stimulus, is also triggered by similar, but not identical, stimuli
stimulus discrimination
distinguishing between a learned stimulus and similar stimuli.
concept formation
process by which individuals organize information and experiences into mental categories or concepts, enabling them to understand the world and make sense of new information.
the Stroop effect
phenomenon where it takes longer to name the color of a word when it doesn’t match the color of the word. For example, it takes longer to say “red” when the word “red” is printed in blue ink.
stimulus exemplar
stimuli that represent the range of relevant stimulus situations in which the response should occur after training.
