Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Stats Second Semester > Threats to Validity > Flashcards

Threats to Validity Flashcards

1
Q

What is the most important tool to identify a cause-effect relationship

A

An experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does an experiment require

A

Control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does control in an experiment allow us to observe

A

A cause and effect relationship

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What change are we looking for

A

Changes in the DV are caused by the manipulation of the IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define internal validity

A

The extent to which the results obtained are a function of the variables that were systematically manipulated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What may internal validity effect

A

Changes in the IV being responsible for the observed variation of the DV
Variation in the DV may be attributed to other causes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What type of variables internal validity effected by

A

Confounding Variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Why is internal validity important

A

To determine cause and effect relationships

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does high internal validity link to

A

Strong evidence of causality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does low internal validity link to

A

Little or no evidence of causaility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What two things can be done to maximise internal validity

A

Able to rule out the possibility of other factors producing the change
Control and eliminate possible extraneous influences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Where is it easiest to maximise internal validiity

A

Lab settings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a treat to internal validity

A

Something that compromises our confidence in saying that a relationship exists between the IV and DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are some examples of internal validity threats

A 
History effects
Matruation effects
Mortality
Instrumental decay
Participant selection
Stats regression to the mean
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Define a history effect

A

Events occurring during the experiment that are not part of the treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is an example of a history effect

A

During the experiment, a fire alarm goes off which affects one group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How could history effects be solved

A

Hold experiences constant except for IV; randomly assign conditions to time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define maturation effects

A

Biological or psychological processes within participants that may change simply due to the passing of time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are some examples of maturation effects

A

Aging
Fatigue
Hunger

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Is it true that maturation effects occur naturally overtime and influence the results of the study

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Define mortality

A

The differential loss of individuals from treatment and/or control groups due to nonrandom reasons.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the problem of mortality

A

Those who drop out of your study could be qualitatively different from those who remain.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the solution to mortality

A

Try to stop people dropping out, e.g., provide an inconvenience allowance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define intsturment decay

A

Measuring devices change over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What are some examples of instrument decay

A

Equipment becomes inaccurate with age

Experimenters become more skilled, or bored

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is the solution for instrumental decay

A

Randomise condition to time, check reliability of instruments, train staff.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Define participant selection

A

Different types of participants placed at the different levels of the IV.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are some examples of participant selection that would influence internal validity

A

Only males in control group and only females in experimental group.
If you test different groups at different times, then people will be different.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is the solution to participant selection threats

A

Random assignment and matching

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Define stats regression to the mean

A

Going back to mean after extreme behaviour

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is the problem with stats regression to the mean

A

People elected for treatment because of extreme score on pre-test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What are the two complications when participants communicate

A

Effects equalising groups

Effects separating groups

33
Q

Define effects equalising groups

A

Diffusion of treatment effects
compensatory rivalry
compensatory equalisation

34
Q

Define effect separating groups

A

Resentful demoralisation

35
Q

Define diffusion of treatment effects

A

Occurs if the control group learns about manipulation

36
Q

What is the solution for diffusion of treatment effects

A

Do not debrief any participants until ALL have finished

37
Q

Define compensatory rivalry

A

When participants in different conditions start competing

38
Q

What is an example of compensatory rivalry

A

If participants become aware that they are in the control group, they may work harder to overcome the ‘disadvantage’ of being in the control group.

39
Q

Who named the compensatory rivalry effect

A

Saretsky 1972

40
Q

What did Saretsky 1972 name compensatory rivalry

A

John Henry efect

41
Q

Define compensatory equalisation

A

What if experimenters know which condition participants are in?

42
Q

What is an example of compensatory rivalry

A

: Experimenters in charge of the control group might feel bad that their group is not receiving treatment, and attempt to make up for this by providing enhanced services that go beyond the routine treatment regimen.

43
Q

Define resentful demoralisation

A

If the control group learns that they are in the control group, they may become resentful and not try as hard.

44
Q

What would resentful demoralisation lead to

A

Increase the size of the observed difference between experimental and control groups

45
Q

What does external validity effect our ability to do

A

Generalise

46
Q

What question does external validity have us ask

A

Does the IV represent the concept we intend?

47
Q

What makes a measure externally valid

A

A measure is externally valid if it truly measures the hypothetical construct intended.

48
Q

What makes an experiment externally valid

A

If it is similar to phenomenon in the real world

49
Q

What does high external validity mean

A

Having a lack of control and confounds

50
Q

What are the two types of external validity

A

Population validity

Ecological validity

51
Q

Define population validity

A

The extent to which the results can be generalised from the experimental sample to a defined population

52
Q

Define ecological validity

A

The extent to which the results can be generalised from the set of environmental conditions in the experiment to other environmental conditions.

53
Q

What do threats to external validity lead to

A

A compromise our confidence in stating whether the study’s results are generalisable.

54
Q

What are the threats to external validity

A

Reactive effects of testing
Reactive effects of experimental setting
Selection-treatment interaction
Multiple-treatment interference

55
Q

Define reactive effects of testing

A

: Occurs whenever a pre-test increases or decreases the respondents’ sensitivity to the treatment

56
Q

What is an example of reactive effects of testing

A

Studies involving self-report measures of attitude and interest are very susceptible to this threat.

57
Q

When can reactive effects of experimental arrangements occur

A

occur when the conditions of the study are such that the results are not likely to be replicated in non-experimental situations

58
Q

What do Hawthron novelty, experimenter and Rosenthal effects have to do with

A

Reactive effects of experimental arrangements

59
Q

Define hawthorn effects

A

Wanted to test how things like light levels effected productivity, but when experimetners went away the effect departed.

60
Q

Define novelty effects

A

Highly engaged compared to when outside of the lab.

61
Q

Define rosenthal effects

A

interviewing study, and they start discussing things relevant to the hypothesis, say more things to support hypothesis, their behavior is influenced by your behavior.

62
Q

Define selection treatment interaction and how it effects external validity

A

: The possibility that some characteristic of the participants selected for the study interacts with some aspect of the treatment.

63
Q

What is an example of a selection treatment effect

A

May include prior experiences, learning, personality factors, or any traits that might interact with the effect of the treatment.

64
Q

Define multiple-treatment inference

A

When participants receive more than one treatment, the effects of previous treatments may influence subsequent ones.

65
Q

What are examples of multiple treament inference

A

This has a likelihood of occurring whenever the same research participants are exposed to multiple treatments.
Sequence effects
Carry-over effects

66
Q

How can external validity be improved

A

Replication

Replication with extension

67
Q

What is replication

A

An additional scientific study that is conducted in exactly the same manner as the original research project

68
Q

What is the consequence of a replication

A

When we replicate an experimental finding, we are able to place more confidence in that result.

69
Q

Define replication with extension

A

An experiment that seeks to replicate a previous finding but does so in a different setting or with different participants or under different conditions.

70
Q

What are the threats to stats validity

A

Making a type I or II error

71
Q

Define a type I error

A

Rejecting the null hypothesis when the null hypothesis is true

72
Q

What are the possible causes of a type I error

A

Fishing

73
Q

Define a type II error

A

Failing to reject the null hypothesis when the null hypothesis is false

74
Q

What are the possible causes of a type II error

A

Power
Reliability of measures, treatments
Random irrelevance
Random heterogeneity of respondents

75
Q

Which of the following threats to internal validity refers to the effect of people dropping out of the study?

A

Mortality

76
Q

Which of the following threats to internal validity might lead to increased differences between treatment and control groups?

A

Resentful demoralisation

77
Q

If a study has high external validity, the results can be generalised to

A

Different participants, settings and times

78
Q

What will increase the likelihood of type I errors

A

Fishing

Stats Second Semester (9 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions