LCB Final Exam

Question 1

Distinguish operant (instrumental) conditioning from Pavlovian (classical) conditioning

Answer 1

S→ O Classical or Pavlovian conditioning
- Using a stimulus to predict an outcome
- Getting the whole body ready for something imminent whether negative or positive
R → O Instrumental or Operant conditioning
- Using reinforcement to achieve a desired outcome
- Operates on the environment or behavior that is instrumental in getting the outcome
- Controlling whether or not you get the outcome through reinforcement/punishment
- uses a response or behavior leading to or preventing outcome - the behavior is instrumental in what happens

Question 2

What is operant conditioning and what is the relationship with the operant-respondent distinction?

Answer 2

The operant-respondent distinction:
Respondent behavior:
- Respondent conditioning results in the learning of involuntary behavior
- controlled by its antecedents (something that happens before → i.e. bell)
- “elicited” by what happens before (i.e. bell in Pavlov’s dogs
- Pavlov’s dogs - drooling in response to food, controlled by its consequences or what happens when you do that behavior.
Operant behavior:
- Operant conditioning results in voluntary behavior.
- “Emitted” ( don’t have to do anything but behavior is emitted to consequences whether good or bad)
rat lever pressing for food
human playing video games

Question 3

Define and identify the basic terms and concepts of Pavlovian conditioning: conditioned stimulus (CS), unconditioned stimulus (US), conditioned response (CR), unconditioned response (UR).

Answer 3

The Stimulus predicts the Outcome
The S = conditioned stimulus (CS)
The O = unconditioned stimulus (US)
The conditioned stimulus (CS) elicits lots of different responses
These help us get ready for the upcoming event (US)
Pavlovs’s dogs example:
- Conditioned Stimulus (CS) = Bell
- Unconditioned Stimulus (US) = Food
- Conditioned Response (CR) = Drooling to Bell
- Unconditioned Response (UR) = Drooling to Food

Question 4

Define and identify the basic terms and concepts of operant conditioning: reinforcer

Answer 4

Reinforcer in operant conditioning: a consequence that strengthens or increases the likelihood of a behavior being repeated, can be positive or negative
Reinforcers can be “scheduled” or arranged in several basic ways
Continuous reinforcement schedule
Intermittent reinforcement schedules (also known as partial reinforcement schedules)

Question 5

Define and identify the basic terms and concepts of operant conditioning: operant response

Answer 5

Operant response: voluntary behavior produced by an animal to achieve a desired outcome (do something to get something)

Question 6

Define and identify the basic terms and concepts of operant conditioning: discriminative stimulus (SD)

Answer 6

Discriminative Stimulus (SD): stimulus that indicates the availability of a reinforcement for a specific behavior → a specific environmental cue/stimulus that signals to an individual that a particular behavior will be reinforced or punished (a pigeon learns that food is given when a green light is on but not when the red light is on, will later peck green light knowing it will be reinforced)

Question 7

Define and identify the basic terms and concepts of operant conditioning: SΔ

Answer 7

SΔ: a stimulus that signals the absence of reinforcement or punishment for a behavior - The absence of the stimulus is called – SΔ

Question 8

Define and identify the basic terms and concepts of operant conditioning: Stimulus control

Answer 8

Stimulus control: when a behavior occurs consistently in the presence of a specific discriminative stimulus (cue for reinforcement or punishment of certain behavior) due to past reinforcement

Question 9

Identify and explain the concept of the conditioned compensatory response and its relation with drug tolerance.

Answer 9

• Conditioned compensatory response = Opposite to the unconditioned response
  a CR that is the opposite of the UR, helping to balance/correct for the US-UR reflex. Inject adrenaline (US) heart rate increase (UR). Repeat the procedure in the same testing chamber (CS)
  Drug-taking behavior (such as using a needle or even opening a bottle of beer) functions as a signal or CS that predicts the introduction of a drug into the body.
• body compensates/prepares for a stimulus
• ex: the more you take a drug the more accustomed your body becomes to its effects and a higher dose is needed for the same effects as when the person first used the drug

Question 10

Understand prediction error and US surprisingness and how they play a role in classical conditioning, as illustrated by blocking and unblocking

Answer 10

• Prediction Error→ discrepancy between what is expected to happen and what actually happens. In classical conditioning it is the difference between the predicted outcome based on the conditioned stimulus and the actual occurrence of the US
• EX: Crucial for learning, when an unexpected outcome occurs it prompts new learning in the organism
  US Surprisingness→ A measure of how unexpected an unconditioned stimulus is in a contect
  Determines strength of association
  If the US is highly surprising, it is more likely to lead to effective learning. If it is predicted, learning may not occur, or be weaker
  Learning happens when CS → US (the better the CS predicts the US the more related) and at least part of the answer: Surprise and prediction error

Question 11

Understand prediction error and US surprisingness and how they play a role in classical conditioning, as illustrated by blocking and unblocking pt. 2

Answer 11

Blocking: after learning a stimulus-outcome relation for one stimulus (CS), learning about a second stimulus (CS) is reduced when the second stimulus is always accompanied by the first stimulus
occurs when a previously established association between a conditioned stimulus (CS) and an unconditioned stimulus (US) prevents or “blocks” the formation of a new association between an additional CS and the same US.
Ex: Conditioned response to tone during test
The conditioned light blocked conditioning to the tone → group 1 light predicted shock → group 2 did not learn that
The shock (US) was not surprising
There was no prediction error → light has already predicted it (no surprise for group 1 in phase 2)
Unblocking: Occurs when a previously blocked stimulus becomes associated with the unconditioned stimulus (US) if it is presented in a new context/surpriding element. This introdicues a prediction error=new learning
EX: In Pavlovs experiment, If a light (CS2) that was previously blocked by another conditioned stimulus like a bell (CS1) is presented with a new/suprining element before introducing food (US), the dog may now form an association between the light (CS2) and food (US)

Question 12

Explain and be able to use the Premack Principle to identify what would be reinforcing for an individual

Answer 12

Premack Principle: A more preferred behavior will reinforce a less preferred behavior
“The Premack Principle is the idea that you can motivate someone to do a less preferred task by offering them the opportunity to engage in a more preferred task as a reward.”
do something you dont want to then be able to do something you do want
Ex: parents may use the Premack Principle by letting their kid watch TV (preferred activity) only after they have finished their homework (less preferred activity) → TV serves as a reinforcer for completing homework