Chapter 11 Flashcards

1
Q

What are some things done to preserve internal validity?

A
  • control groups
  • standardized, controlled, environment
  • many participants
  • double-blind study design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Threats to internal validity

Design Confounds

A

There is a problem with how the experiment is designed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Threats to internal validity

Selection Effects

A

Levels of IV differ because the participants in each level are different

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Threats to internal validity

Order Effects

A
  • within groups design
  • differences may be due to IV or the order that info is presented
  • Includes fatigue and practice effects
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Threats to internal validity

What are maturation threats

A
  • A change in behavior that emerges spontaneously as a result of time, ex. spontaneous remission of depression
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Threats to internal validity

How can you prevent maturation threats?

A
  • include a comparison/control group
  • Ex. Campers that do not have low sugar diet, or women enrolled in a different type of therapy
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Threats to internal validity

What are history Threats

A
  • Threat occurs because something specific has happened between the pretest and posttest that influences most participants in the same way
  • Ex. weather changing
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Threats to internal validity

How can you prevent history threats?

A

With a good comparison/control group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Threats to internal validity

What is regression threat?

A
  • Due to regression to the mean: when a group average is extreme at time 1, it is often less extreme when the behavior is measured again at time 2. Due to beginner’s luck or choking
  • Extreme scores are rare. You should expect that extreme measures on time one will regress to the mean. People who are chosen because they are extreme also regress to the mean at time 2.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Threats to internal validity

How to prevent regression threat?

A

Have a comparison group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Threats to internal validity

What is attrition threat

A
  • Attrition: when participations drop out of the study before the end (common when pre and post test occur on different days)
  • Attrition threat: when only certain kinds of participants drop out (the dropout isn’t random)
  • Often in Clinical/medical studies. (Participants that live farther away from lab/clinic/hospital are less likely to come back, and are also more likely to live in food/health care deserts)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Threats to internal validity

How to prevent threats to attrition?

A

When people drop out, remove their scores from the entire data set

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the difference between attrition and history threats

A

Attrition only affects some participants, history affects all

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Threats to internal validity

What is testing threat?

A
  • Specific kind of order effect
  • Change in participant as a result of taking a test more than once.
  • Participatns can get better at taking the test, or bored, or fatigued
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Threats to internal validity

How to prevent test threats?

A
  • Get rid of the pretest all together
  • Use different forms for the 2 tests
  • Have a comparison group
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Threats to internal validity

Instrumentation threats

A
  • Occurs when a measuring instrument changes over time
  • Coders may change how they judge behaviors over time, or when a researcher uses a different form of measurement for pre/post test
17
Q

Threats to internal validity

How to prevent instrumentation threats to internal validity?

A
  • post test only design
  • make sure pre and posttest measures are equivalent
  • Retrain coders throughout the experiment
18
Q

Threats to internal validity

Observer bias and demand characteristics

A
  • Observer bias: When researchers’ expectations influence their interpretation of the results. Threatens internal and construct validity.
  • Demand characteristics: Participants guess the purpose of the study and change their behavior
19
Q

Threats to internal validity

How to control for observer bias and demand characteristics?

A
  • Double-bind study design
  • Masked design- the participants know and raters/coders do not
20
Q

Threats to internal validity

Placebo effect

A
  • When participant receives a treatment and measurably improves. But only bc of participant’s beliefs.
  • Pain is very susceptible to placebo effects.
  • Using a placebo equates expectancy
21
Q

Threats to internal validity

How to control for placebo effect?

A
  • Double blind placebo control study
  • Neither the people treating nor the partcipants know which group they are in
  • The type of placebo matters
22
Q

Null effects overview

A
  • When difference between levels of the IV are not big enough
  • Sometimes null effects are important
22
Q

Null Effects

Weak manipulations

A
  • When IV is not altered enough to produce change in DV
  • Ex. If I want to test does money=happiness. How much money is necessary to get the effect? $10 vs $10,000
23
Q

Null effects

Insensitive measures

A

The change is too small to be detected

24
Q

Null effects

Ceiling and floor effects

A
  • Ceiling: all the scores are clustered together at the high end. (could be test is too easy)
  • Floor: All scores clustered at low end
  • Makes it hard to see real effects
25
Q

What does it mean if an experiment gives a null result?

A
  • The IV had no effect OR there is an effect but the study didn’t detect it
  • There might not be enough between-group difference, or too much within group variability
26
Q

What is a manipulation check?

A
  • Detect weak manipulations, ceilings, and floors
  • Looks at how varibles were operationally defined to confirm IV was successfully manipulated.
  • Definition: Separate dependent variable that makes sure the manipulation worked.
  • Ex. in an anxiety study, after telling people they will recieve electric shocks, ask about anxiety directly
27
Q

Within group variability

A
  • Too much variability within a group creates error variance (noise), making it hard to see true differences
28
Q

What is measurement error?

A
  • a human or instrument inflates/deflates a true score
  • Ex. A person’s height is recorded wrong because of the angle of the observer

directly related to within group variablility

29
Q

How to control for measurement error?

A
  • Use a reliable and precise tool
  • Measure more instances
30
Q

Other causes to within-group variability

A
  • individual differences: consider money and mood, some people are naturally more cheerful than others
31
Q

How to control for within group variability

A
  • Change the design (from independent groups to within groups)
  • Add more participants
32
Q

What is situation noise and how is it controlled

A
  • Situation noise: external distractions, lots going on in the environment. Things of this sort can influence behavior
  • Control: Often why researchers try and control the environment, helps to control extraneous variables
33
Q

Reporting Null Effects

A
  • They can be disappointing and somtimes you don’t want to report
  • But it is important to accept what the data tells us
  • Null effects are informative: vaccines do not cause autism, a safer treatmnet is just as effetive as an aggressive treatment, an education program is not more effective at teaching reading, etc.
34
Q

Easter egg

A

8 kids throw basketball in pool