Task 6 Flashcards

1
Q

Who discovered instrumental conditioning?

A

Thorndike with his puzzle box

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the law of effect?

A

probability of a response (R) to stimulus (S) is function of consequence (C) that has followed R in past.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the difference between classical and instrumental conditioning?

A

Classical: If consequence occurs regardless of response -> Classical paradigm.
Instrumental: If consequence is contingent on response
-> Instrumental paradigm

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What characteristics do classical and instrumental conditioning share?

A
  • Negatively accelerated learning curve;

* Tendency for learned responses to extinguish if no longer paired with consequence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are discrete trials and who used them?

A

Thorndike: experimenter defines beginning and end of trial

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are free-operant trials and who used them?

A

Skinner: animal can operate apparatus freely, whenever it chose.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a habit slip?

A

– When discriminative stimulus produces such strong association with response and consequence, that unexpected consequence cannot disrupt S-R-C association.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the observed ‘protestant ethic effect’ in pigeons?

A

Pigeons were first trained to peck at lighted disk. Pecks were reinforced with access to grain in a feeder. During training, there was also an empty food cup in chamber. Later, the cup was filled with grain. Despite presence of freely available food in cup, pigeons continued to peck just as vigorously to obtain grain from feeder.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are two technique’s used by researchers to train animals to show desired responses?

A
  • Shaping – Process in which successive approximations to desired response are reinforced. Gradually, desired response is learned.
  • Chaining – Technique in which organisms are gradually trained to execute complicated sequences of discrete responses. It involves learning links in chain one at a time. It can be more effective if steps are trained in reverse order (= backward chaining).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the difference between primary and secondary responses?

A

X Primary reinforcers – Organisms tend to repeat behaviors that result in access to food, water, sleep and sex.
X Secondary reinforcers – Those that initially have no intrinsic value, but that have been paired with primary reinforcers, like money and grades.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the drive reduction theory of Hull?

A

X Drive reduction theory (Hull) – Organisms have innate drives to obtain primary reinforcers and learning reflects biological need to reduce these drives.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What phenomenon is meant by negative contrast?

A

A phenomenon that reflects fact that organisms who are switched from preferred reinforcer to less-preferred one will respond less strongly for it than if they had been given less-preferred one all along.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What factors determine the effectiveness of punishers?

A
  1. Discriminative stimuli for punishment can encourage cheating -> D.S. can signal whether instrumental response will be reinforced or punished. People may learn to cheat and do something when D.S. for punishment is absent.
  2. Concurrent reinforcement can undermine punishment -> Effects of punishment can be counteracted if reinforcement occurs along with it.
  3. Initial intensity matters -> Punishment is most effective if strong punisher is used from initial exposure (shock).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How does Time affect learning?

A

There is a principle stating that instrumental conditioning is faster if R-C interval is short (= temporal contiguity in classical conditioning).
If there is no delay, odds are good that most recent behavior was response that caused consequence. If there is long delay, it is more likely that other behaviors occurred during interval.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is superstition?

A

Responses that individuals make because they believe those lead to/avert (un)desired outcomes. It develops when behavior is accidentally paired with arrival of desired consequence. Reinforcement may lead to increased future performance of behavior.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Self-control=

A

Organism’s willingness to forego small immediate reward in favor of larger future reward (diets, studying for exams).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is positive reinforcement?

A

A type of operant conditioning in which the response causes a reinforcer to be ‘added’ to the environment, over time, the response becomes more frequent
o Clean room → get weekly allowance

18
Q

What is negative reinforcement?

A

A type of operant conditioning in which the response causes a punisher to be taken away, or ‘subtracted from’ the environment; over time the response becomes more frequent
o Take aspirin→ headache goes away

19
Q

What is positive punishment?

A

A type of operant conditioning in which the response causes the punisher to be ‘added’ to the environment; over time the response becomes less frequent
o Tease little sister → receive parental scolding

20
Q

What is negative punishment?

A

A type of operant conditioning in which the response causes a reinforcer to be taken away, or ‘subtracted from’ the environment; over time, the response becomes less frequent
o Fight with other children→ time-out from play

21
Q

What kind of schedule is the fixed-ratio?

A

Fixed number of responses must be made before reinforcer is delivered. Animals with this schedule have consistent pattern of fast responding leading to reinforcement, followed by post-reinforcement pause (= period with no responding).

22
Q

What kind of schedule is the fixed interval?

A

Reinforces first response after fixed amount of time. After each reinforcement, there is period with few or no responses, but rate of responding gradually increases as end of interval nears.

23
Q

What kind of schedule is the variable-ratio?

A

Produces reinforcement after fixed number of responses, on average. Thus, responder never knows when reinforcement is coming. Therefore, there is stable rate of responding.

24
Q

What kind of schedule is the variable-interval?

A

Reinforces first response after an interval that is particular length of time, on average. Rate of responding is slow and steady, as rats check periodically to see if reinforcement is available.

25
Q

What kind of principle is matching law of choice behavior?

A

– Principle that an organism given a choice between multiple responses, will make particular response at a rate proportional to how often that response is reinforced, relative to other choices.

26
Q

What experiment displays matching law of choice behavior?

A

pigeon with two keys VI 1-m and VI 2-m will peck at a 2:1 ratio, allotting its time and effort among a set of possible operant responses

27
Q

What is the bliss point?

A

the allocation of resources that maximizes subjective value or satisfaction and shifts with economic condition changes → e.g. Graph to the right: Jamie can spend $100 on albums and dinner; depending on how he spends it and how much they cost, determines his bliss point to maximize his satisfaction

28
Q

What is the Premack principle?

A

opportunity to perform highly frequent behavior can reinforce performance of less-frequent behavior.

29
Q

What study diplayed the Premack principle?

A

Rats were given free access to drinking water and running a wheel. On average, they spend more time running than drinking. Then, access to wheel was restricted, so that they were allowed to run only after they had drunk certain amount of water.
X Observations – Rats learned the association and total amount of running decreased while amount of drinking increased. Running was acting as reinforcer and was increasing probability of infrequent behavior (= drinking).

30
Q

What is the response deprivation hypothesis?

A

Any behavior can be reinforcing, if opportunity to perform that behavior is restricted.

31
Q

What structures are involved in instrumental conditioning?

A

Stimulus information: V1, S1 and frontal cortex
Voluntary responses: Motor cortex (M1)
Basal ganglia helps link associations between sensory and motor cortex, so that stimuli elicit appropriate motor responses

32
Q

What area take part in predicting outcomes? And what functions do neurons in that area have?

A
Orbitofrontal cortex
Functions:
- code value of reward
- code identity of expected outcome
- respond with a strength proportional to perceived value of choice
33
Q

Where is the reinforcement system and what system activates dopamine?

A

Ventral tegmental area (VTA) – Region in brainstem that projects dopamine to nucleus accumbens, which in turn projects dopamine to dorsal striatum.
X Dopaminergic neurons in N.A. project to motor areas in dorsal striatum that can drive motor responses.

34
Q

What is extinction mimicry?

A

Effect in which response of drug-group rats seems to extinguish, even though animals are still receiving food for lever-pressing.

35
Q

Why are the three theories on why extinction mimicry occurs?

A
  1. Anhedonia hypothesis
  2. Incentive salience hypothesis
  3. Reward prediction hypothesis
36
Q

What is the anhedonia hypothesis?

A

Dopamine-blocking drugs block link from taste system to reinforcement system  Dopamine gives food its hedonic value and drugs that block dopamine release take away that ‘goodness’, reducing incentive to work for food.
- Disapproved because Parkinson’s patients do experience pleasure.

37
Q

What is the incentive salience hypothesis?

A

Dopamine helps provide organisms with motivation to work for reinforcement. Organisms unable to produce dopamine, still enjoy pleasurable stimuli, but do not work to obtain them. Interfering with dopamine system reduces ‘craving’ but not ‘liking’.

38
Q

What is the reward prediction hypothesis?

A

States that dopamine is involved in predicting future reward.

39
Q

What are endogenous opioids?

A

Class of chemicals that are naturally occurring neurotransmitter-like substances with many of same effects as opiate drugs.

40
Q

Concerning drug addiction: what does the involvement with dopamine suggest?

A

Amphetamines and cocaine work by increasing brain dopamine levels:
- Incentive salience hypothesis of reinforcement – Dopamine is involved in ‘wanting’ but not ‘necessarily ‘liking’.

41
Q

What schedule is reinforced in compulsive gambling?

A

Skinner proposed that it is reinforced on VR schedule.

42
Q

What are treatment methods for drug & behavioral addictions

A

Cognitive therapy: Extinction, distancing, reinforcement of alternate behavior, delayed reinforcement
Medical treatment: Naltrexone-> blocks opiate receptors