9 - Avoidance and punishment Flashcards

1
Q

What is negative reinforcement?

A
  • The removal of a stimulus (-) (usually unpleasant or aversive) following a response, which then leads to an increase in the future strength of that response
  • Examples:
    → Rat runs to the opposite side of the cage (R) -> Escapes the shock (Sr)
    → Open an umbrella -> Escape the rain
  • Two behaviors are associated with negative reinforcement:
    1) Escape behavior: performance of the behavior terminates the aversive stimulus
    → p.ex: running indoors after the rain has started
    2) Avoidance behavior: performance of the behavior prevents the aversive stimulus from occurring
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

We first learn to ___, then we learn to ___.

A

Escape; avoid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the shuttle avoidance task? Give an example.

A
  • An animal has to shuttle back and forth in a box to avoid an aversive stimulus
  • Example:
    → A rat in a chamber must climb over a low barrier to stop feeling a shock
    → a stimulus (light) is then presented for 10 seconds, followed by a mild electric shock
    → the rat can escape the shock by climbing over the barrier to the other side as it will quickly learn to do whenever it feels a shock
    → at this early point in the process, the presence of the shock is a discriminative stimulus that sets the occasion for the escape easier of crossing the barrier (this is escape)
    Escape:
    → Light & Shock (Sd): Cross barrier (R) -> Removal of shock (Sr)
  • This procedure demonstrates that we first learn to escape from an aversive stimulus and then learn to avoid it
    → the shock is preceded by the presentation of the light, which means the light is a warning signal that the shock is about to occur
    → as the rat learns to associate the light with the shock, it will begin crossing the barrier whenever the light is presented, before the shock begins
    Avoidance:
    → Light (Sd): Cross barrier (R) -> Avoidance of shock (Sr)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Give an everyday example of escape and avoidance.

A
  • p.ex: you first learn to make up an excuse to leave a conversation with a bad tempered coworker (escape)
  • p.ex: you then learn to take a longer route to your office to avoid seeing the coworker (avoidance)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the two-process theory of avoidance?

A
  • It states that two processes are involved in learning an avoidance response:
    → classical conditioning
    → operant conditioning
  • This theory states that avoidance behaviour is the result of distinct processes; classical conditioning in which fear response comes to be elicited by a CS, and operant conditioning in which moving away from the CS is negatively reinforced by a reduction in fear
  • How can the lack of change reinforce a response?
    → reduction of fear serves as a negative reinforcer
    → during the avoidance process, the rat moves from one non-aversive environment to another to avoid a shock, this is a concept that is interesting to study
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Explain process 1 of the two-process theory of avoidance.

A
  • This is the escape step, which we are less interested in because its more easily explained than avoidance
  • Classical conditioning of a fear response to a CS.
    → On each trial, light (NS/CS) is paired with shock (US).
    → provoking CS.
  • Example:
    → Rat in shuttle avoidance procedure
    → Light (NS): Shock (US) -> Fear (UR)
    → Light (CS) -> Fear (CR)
    → the light that precedes the shock becomes a CS that elicits a conditioned fear reaction
  • Example:
    → Cat going to the vet
    → Carrier (NS): Needle (US) -> Fear (UR)
    → Carrier (CS) -> Fear (CR)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Explain process 2 of the two-process theory of avoidance.

A
  • Operant conditioning of a fear response to an SD
  • Reduction of fear is a negative reinforcer for the response that produced it
  • Example:
    → Rat in shuttle avoidance procedure
    → Light (Sd): Climb over barrier (R) -> Reduction in fear (Sr)
  • Example
    → Cat going to the vet
    → Carrier (Sd): Hide (R) -> Reduction in fear (Sr)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are some problems with Mowrer’s 2-process theory?

A
  • In the absence of the CS, the fearful response should extinguish.
  • But… avoidance responses are often extremely persistent so researchers have found that dogs would continue to job barriers to avoid shocks over 100s of trials, even though the shock apparatus had been disconnected and avoidance was no longer necessary
    → if the animal repeatedly encounters the CS, in the absence of the US, then fear of the CS should eventually extinguish, but it seemed as though the behaviour did not extinguish, therefore a good deal of conditioned fear is conserved because exposure to the CS are too brief for extinction to take place
    → Brief exposure might sometimes strengthen a conditioned fear response which would further counteract the process of extinction
    → Because fear responses are rapidly acquired, and subsequently avoided, there is no opportunity for extinction
  • This relates to the theory of incubation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is incubation?

A
  • If you associate a fearful event with a stimulus, you will avoid that stimulus whenever possible
  • Incubation is the strengthening of a conditioned fear response as a result of brief exposures to the aversive CS.
  • Example: each time you briefly encounter a dog, your fear response grows stronger
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Explain how avoidance conditioning relates to phobias.

A
  • Avoidance learning appears to be a fundamental process in the development and maintenance of phobic behaviour.
  • Example: If you were bitten by a dog, you may develop a fear of dogs might try to avoid dogs in the future
  • This is why exposure therapy only works well if given longer time to interact with whatever is aversive, and over time get closer to the aversive stimulus
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are some limitations to applying models of experimental avoidance to human phobias?

A
  • Experimentally conditioned avoidance usually takes several trials.
  • in experimental settings, avoidance behaviour seems to condition less readily than avoidance behaviour in a phobia
  • Real phobias are often acquired following a single exposure
    → rat avoids shock by climbing over barrier whenever it sees the light —> in humans, people avoid the cs (person who has been attacked by a dog will avoid possibility of even encountering the dog)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the approach-avoidance conflict?

A
  • Events can be both rewarding and punishing
  • When an event is far away, the rewarding aspects tend to outweigh the punishing aspects
  • As the event approaches, the aversive (punishing) aspects increase more than the rewarding aspects
    → Punishment outweighs reward
  • Example: Agreeing to write a book chapter
    → Deadline: 6 months (rewarding)
    → “Sure, I’d love to be involved! It won’t be that much work.”
    → Deadline : 1 month (punishing)
    → “Why did I agree to do this? Nobody reads these chapters.”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is OCD? Give some examples of behaviours.

A
  • Obsessive-compulsive disorder (OCD) is a disorder characterized by:
    → Persistent thoughts, impulses, or images (called obsessions)
    → Repetitive stereotyped actions (called compulsions) that are carried out in response to the obsessions
  • Example: Compulsive cleaning
    → A person may have an obsessive worry about contacting germs (obsession)
    → This leads to a compulsive tendency to take a shower and clean the house many times each day
  • Example: Compulsive checking
    → A person might have an obsessive worry about whether she turned the oven off after dinner.
    → This leads to a compulsive pattern of returning to the kitchen several times a day to check it
  • People with OCD also have a tendency to feel personally responsible for events that are highly improbable
  • People with OCD are usually unable to recall any particular conditioning event that could account for the obsessional anxiety response
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How does OCD relate to the two-process theory?

A
  • Obsessions and compulsions have opposite effects on anxiety.
  • Obsessions associate with an increase in anxiety, whereas compulsions associate with an decrease in anxiety.
  • Example:
    → A person who has a fear of germs
    → a person who has a contamination fear and is a compulsive cleaner usually experiences an increase in anxiety after exposures to situations in which contamination might have occurred such as when taking out the garbage
  • OCD was once considered a difficult disorder to treat, but this changed when clinicians began analyzing it through avoidance conditioning especially when using mowrer’s two process theory of avoidance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

How can we differentiate OCD and phobias in terms of their avoidance tactics?

A
  • OCD typically involves an active avoidance response
    Do something to reduce the anxiety.
    → i.e. A person with OCD will clean often.
  • Phobic behaviour typically involves a passive avoidance response
    Don’t do something to reduce the anxiety.
    → i.e. A person with a phobia will avoid contaminated areas
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is exposure and response prevention (ERP)? Give an example

A
  • ERP: A method of treating OCD
    → Involves gradual increases in prolonged exposure to the anxiety-arousing event…
    → While not engaging in the compulsive behavior pattern that reduces the anxiety
    → Preventing the avoidance response form occurring should result in the eventual extinction of anxiety
  • Combines:
    → graduated exposure of systematic desensitization
    → prolonged exposure of flooding therapy
  • Example:
    → A compulsive cleaner might be required to first touch door handles and hand rails that cause low anxiety.
    → Then she must touch objects associated with moderate anxiety, such as garbage cans and dogs.
    → Finally she must touch objects associated with high anxiety, such as dead birds and dog excrement.
    → She cannot perform any compulsive behavior patterns during exposure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is systematic desensitization?

A
  • Behavioral treatment for phobias that involves pairing relaxation with a succession of stimuli that elicit increasing levels of fear
  • 2 ways to do this
    → Imaginal
    → in-vivo
  • Typically we will start out with imagining it, then move onto in-vivo
18
Q

What is flooding?

A
  • Behavioral treatment that involves prolonged exposure to a feared stimulus (compared to gradual exposure used in systematic desensitization).
    → Imaginal flooding
    → In vivo flooding
  • Exposures are relatively long (often 90 mins) to ensure sufficient time for anxiety to begin and extinguish
19
Q

Explain how irrational beliefs play their role in people with OCD.

A
  • People with OCD feel they should be in complete control of their thoughts.
  • Many people have intrusive thoughts, but they are not problematic because they…
    → Can rationalize
    → Can block them out
    → People with ocd do not recognize that intrusive thoughts are normal
    → Fail to realize that some thoughts are reflexes that are automatically elicited by certain stimuli and that it is futile to try and control such thoughts
  • People with OCD also have a tendency to feel personally responsible for events that are highly improbable
    → carry out various safety actions (rechecking doors ) and if they have any intrusive/irrational thought will start double checking that there is not something in their house that might catch fire
    → becomes maladaptive behaviour and makes day to day functioning very troublesome
20
Q

Patients with OCD exhibit hyperactivity in ___-___ brain regions that control inhibition, error monitoring and ‘feelings of rightness’.

A

Frontal-stratial
- Thus, at a neuronal level, ocd individuals exhibit hyperactivity

21
Q

How is brain volume different in people with OCD?

A
  • Patients with OCD have lower grey matter volume in the putamen, orbitofrontal cortex, and aCC
    → missing important neuronal features that make up the grey matter (axons)
    → lack of grey matter means less grey matter to overcome intrusive thoughts that occur it’s hard to tell someone to stop being irrationally if their brains structure is different than healthy adults
22
Q

What are the treatments of OCD?

A
  • Behavioral therapy:
    → Exposure and Response Prevention (ERP) and cognitive behavioral therapy (CBT)
  • Pharmacological treatment:
    → Selective serotonin reuptake inhibitors (SSRIs)
    → clomipramine, fluoxetine
    -** Deep Brain Stimulation (DBS) of internal capsule** (pathways between thalamus and cortex)
    → Used to a small effect, but has shown promise
    → Experimental treatment at this point.
    → Search for other targets
    → Used to treat PD, depression, AD, MS
  • A lot of these techniques are behavioural, chemical and using instruments to improve functioning (short term), but no longer-term alleviations/improvement of symptoms
23
Q

Very generally speaking, what is punishment?

A
  • Consequences of behaviour that:
    1) follow a behaviour, and
    2) as a result, the future probability of that behaviour decreases
24
Q

What are the 2 types of punishment?

A

1) Positive punishment
- The presentation of a stimulus (+) (usually unpleasant or aversive) following a response, which then leads to a decrease in the future strength of that response
- Examples:
→ Rat presses bar (R) -> Gets a shock (Sp+)
→ Argue with boss (R) -> Get reprimanded (Sp+)
2) Negative punishment
- The removal of a stimulus (-) (usually pleasant) following a response, which then leads to a decrease in the future strength of that response
- Examples:
→ Rat presses bar (R) -> Water spout retracts (Sp-)
→ Argue with boss (R) -> Lose job (Sp-)
- 2 main forms: Time out; response cost

25
Q

In negative punishment, what is a time-out? What are some problems with the time-out?

A
  • Loss of access to rewards for a brief period of time following the occurrence of a problem behaviour
  • Why might time-outs not be the best way to punish a behaviour?
    → Consider the replacement setting, Consider the length, etc.
    → p.ex: time-out for 3 minutes but that isn’t enough, or they say it’ll be longer but don’t follow through
  • Punishment is likely to be ineffective if the time-out setting is actually more reinforcing
    → p.ex: sending a child to their room when acting out at the dinner table would reinforce the behaviour if they prefer being in their room rather than the dinner table
  • Time-outs that are too long interfere with the development of more appropriate behaviours.
    → More effective when combined with the DRI (Reinforcing a behaviour that is specifically incompatible with the target behaviour; After the short time out, praise the child when he is interacting in a friendly manner with his sister)
26
Q

In negative punishment, what is a response cost?

A
  • The removal of a specific reinforcer following the occurrence of a problem behaviour
  • You can adjust the punishment to suit the misbehaviour
    → p.ex: slight aggression with a sibling will make the kid lose dessert, but strong aggression with a sibling will make the kid lose dessert and TV for the night
  • Drawback: You must clearly identify a reinforcer that, if removed, will have an impact on behaviour
27
Q

When comparing negative punishment and extinction, how do their outcomes differ?

A
  • Extinction: the non-reinforcement of a previously reinforced response, the result of which is a decrease in the future strength of that response
    → behaviour that used to produce a reinforcer no longer does
  • Negative Punishment: the removal of a stimulus (usually pleasant) following a response, which then leads to a decrease in the future strength of that response
  • Does the behaviour grow weaker because performing the behaviour :
    1) no longer leads to something (extinction)
    2) leads to the removal of something that you would otherwise possess (negative punishment)?
28
Q

Explain the 4 classes of contingencies (primary, secondary, punisher, reinforcer).

A

1) Primary reinforcer
- A primary reinforcer is an event that is innately reinforcing
- Things we are born to like:
→ water, food, proper temperature, safety
2) Primary punisher
- A primary punisher is an event that is innately punishing; Unconditioned
- Things we are born to dislike
→ extreme hunger, extreme thirst, extreme temperature, fear, startle, pain, nausea
3) Secondary reinforcer
- A secondary reinforcer is an event that has become reinforcing because it has in the past been associated with some other reinforcer; Conditioned
4) Secondary punisher
- A secondary punisher is an event that has become punishing because it has in the past been associated with some other punisher; Conditioned
- if a shock is an effective punisher, then a tone that has been paired with it in a classical conditioning procedure will become a conditioned aversive stimulus which can be then used as a secondary punisher

29
Q

True or false: Punishment of an inappropriate behaviour does not directly strengthen the occurrence of appropriate behaviour.

A

True: This is one of the problems with the use of punishment
- It may even result in a general suppression of behaviour
- Example:
→ Giving a time-out to a student who is disruptive in class will not teach him how to pay attention in class
→ It may result in him withdrawing from class interaction

30
Q

The person delivering a punishment could become a ___ ___ for punishment

A

Discriminative stimulus (SD)
- This is one of the problems with punishment
- The unwanted behaviour is suppressed only when that person is present
- Example:
→ The teacher is an Sd for punishment
→ When the teacher is away from the class, students are more disruptive

31
Q

True or false: Punishment might simply teach the individual to approach the person who delivered the punishment.

A

False: It might teach them to avoid the person
- This is one of the problems with punishment
- Example:
→ If a student routinely gets punished by the teacher, he may begin skipping that class, at the expense of his grades and education

32
Q

Punishment is likely to elicit a strong ___ ___.

A

Emotional response
- This is one of the problems with punishment
- Example:
→ If a student is upset after being punished by the teacher, she will be unreceptive to the teacher’s subsequent attempts to teach her more appropriate behaviours

33
Q

Punishment can sometimes elicit an ___ ___.

A

Aggressive reaction
- This is one of the problems with punishment
→ Example: After being reprimanded, the student may act aggressively towards the punisher (the teacher), or another target

34
Q

True or false: The use of punishment might teach the person that punishment is an acceptable means of controlling behaviour.

A

True: This is one of the problems with punishment
- whatever kids see, they can easily absorb it because they have a harder time filtering it
- Example: If a child is often given time-outs for disruptive behavior, she may learn that time-outs are an effective way of punishing people’s behavior

35
Q

The use of punishment is often strongly ___.

A

Reinforced
- This is one of the problems with punishment
- The punisher may be enticed to punish more often because she likes the results.
- Example:
→ A teacher may punish a student to get them to stop talking out of turn.
→ Positive punishment for the student results in immediate negative reinforcement for the teacher

36
Q

What are the benefits of punishment? (3)

A

1) Punishment can sometimes lead to an increase in social behaviour.
→ Example: Fighting siblings may become more affectionate.
2) Punishment sometimes results in an improvement in mood.
→ Example: A young child may stop crying.
3) Punishment can increase attention to the environment.
→ Example: A young child may show increased eye contact and interest in ongoing activities

37
Q

How can we make an effective use of punishment? (6)

A

1) Punishment should be immediate rather than delayed
→ This aids the association between the punishment and the unwanted behaviour
2) Punishment should consistently follow each occurrence of the unwanted behaviour
3) Punishment should be intense enough from the outset to suppress the target behaviour
4) Negative punishment is generally preferable to positive punishment
→ This is less likely to produce many of the harmful side effects of punishment
5) Punishment is more effective when accompanied by an explanation (feedback)
→ Thus, it is easier to avoid punishment in the future
6) Punishment of inappropriate behaviour should be combined with positive reinforcement for appropriate behaviour

38
Q

What is contingent vs. non-contingent punishment?

A
  • Contingent punishment: There is a clear connection between a predictable behaviour and the consequence
    → punishment is initiated following an undesirable response/behaviour
    → The animal/person has some control over their behaviour; Emitted responses are voluntary
    → They can mediate their behaviour to minimize punishment
  • Non-contingent punishment: Lack of a connection between a predictable behaviour and the consequence
    → delivery of punishment is not dependent upon the occurrence of a behaviour
    2 types of non-contingent punishment
    → Learned helplessness
    → Experimental neurosis
39
Q

What is learned helpnessness?

A
  • Type of non-contingent punishment
  • A reduction in learning ability that results from repeated exposure to uncontrollable aversive events
    → There is a lack of a connection between a behaviour and a predictable consequence (non-contingent)
  • Seligman & Maier (1967) were interested in developing therapeutic behavioural interventions for treating depression
  • First needed to induce depression (learned helplessness) in an animal model by administering electrical shocks at random intervals
    → Dogs were shocked by ringing a bell, dogs could not avoid being shocked and eventually laid down
    → Dogs would simply lie down at the sound of bell even when no shocks administered → When dogs who had not been shocked placed in diving cage, quickly avoided the shock side and jumped onto the other side
    → When does that had been previously subjected to inescapable shock were put in the box on electrified side, they did not jump over the barrier to avoid it
    → They simply laid down and accepted it, this is learned helplessness
40
Q

How do we see learned helplessness in humans?

A
  • People who suffer a series of uncontrollable aversive events become extremely passive and despondent
    → Marital problems
    → Loss of employment
    → Health problems
41
Q

How can we treat learned helplessness?

A
  • Encourage the person to accomplish a graded series of relatively minor tasks
  • Progress to more challenging tasks
    → i.e. A student who wants to go to graduate school
    –> set up a meeting, then email a bunch of profs, work toward getting good grades, etc.