Error & Control Flashcards

1
Q

What are the 2 categories of measurement error?

A
  • Random errors obscure the results

- Constant or systematic error, bias the results - much worse

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are Extraneous Variable?

A

Undesirable variables that add error to our experiments (measurement of the DV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How are Extraneous Variables controlled?

A

Random allocation/ counterbalancing - adds error variance

Results in an even addition of error variance across levels of the IV.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are Confounding Variables?

A

Disproportionately affect one level of the IV more than other levels.
- Add constant/systematic error at the level of the IV.

Confounding variables introduce a threat to internal validity experiments.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Threats to Internal Validity. (sources of confounding variables)

A
  • Selection
  • History
  • Maturation
  • Instrumentation
  • Reactivity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How is Selection a Threat to Internal Validity?

A

Bias resulting from the selection or assignment of participants to different
levels of the IV.

Random assignment - solves problem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How is History to a threat to Internal Validity?

A

Uncontrolled events that take place between testing occasions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How is Maturation a threat to Internal Validity?

A

Intrinsic changes in characteristics of participants between different test occasions, in repeated measures design.

Counterbalancing order of experiments - solves problem.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How is Instrumentation a threat to Internal Validity?

A

Changes in the sensitivity or reliability of measurement instruments during the course of the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How is Reactivity a threat to Internal Validity?

A

Ps awareness that they are being observed may alter behaviour

Can threaten internal validity if Ps are more influenced by reactivity at one level of the IV than the other.

Counteracted by Blind Procedures.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define Subject Related - Demand Characteristics.

A

Ps might behave in the way they think the researcher wants them to behave.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define Experimenter related - Experimenter bias.

A

Experimenter can affect outcomes due to their own bias.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

4 forms of reliability.

A
  • Test-retest reliability
  • Test-rater reliability
  • Parallel forms reliability
  • Internal consistency
    > Split-Half Reliability
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Define Test-retest Method of reliability

A

It assesses the external consistency of a test.

Measures fluctuations from one time to another.

Important for constructs which we expect to be stable (e.g. personality type)/ similar over time points.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Define Inter-rater (test-rater) reliability

A

It assesses the external consistency of a test.

Measures fluctuations between observers (the degree to which different raters give consistent estimates of the same behaviour)

Important when results are measured by each experimenters objectivity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Define External Reliability (Parallel forms reliability)

A

The extent to which a measure varies from one use to another.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define Internal Reliability

A

Extent to which a measure is consistent with itself

18
Q

What is the Spilt-Half Method of Reliability.

A

It assesses the internal consistency of a test.

Then measures the extent to which all parts of the test contribute equally to what is being measured.

19
Q

Define Content Validity.

A

Is the content appropriate.

20
Q

Define Face Validity

A

Based on subjective judgement. Does the test relate to the underlying theoretical concepts?

21
Q

Define Construct Validity.

A

Does the test relate to underlying theoretical concepts? Is the construct we are trying to measure valid?

The validity of a construct is supported by cumulative research evidence collected over time.

22
Q

Define Convergent validity.

A

Convergent validity: correlates with tests of the same and related constructs.

23
Q

Define Discriminant validity.

A

Discriminant validity: doesn’t correlate with tests of different or unrelated constructs.

24
Q

Define Internal Validity.

A

The extent to which the manipulation of our IV caused the change to our DV.

25
Q

Define Criterion Validity.

A

Looks at the degree to which the measurement agrees with other measurements that are assessing the same construct.

26
Q

Define Concurrent Validity.

A

There is a high correlation between two measures of the same thing

27
Q

Define Predictive Validity.

A

The scale has the ability to predict some other variable measuring a different construct.

28
Q

Define Divergent Validity.

A

Is there a lack of correlation with measures of different and unrelated constructs.

29
Q

Which 6 forms of validity are used to establish construct validity over time.

A
Content
Face
Criterion
Concurrent
Predictive
Construct
30
Q

Which 2 forms of validity are used to establish construct validity in the short term.

A

Convergent

Divergent

31
Q

Define Causation

A

Sufficiency and Necessity are needed.

Sufficient: Y is adequate to cause X.

Necessary: Y must be present to cause X

32
Q

Define True Causation.

A

True causation can only be established when necessity and sufficiency criteria are satisfied

The manipulation of the IV, in the absence of all other factors, will always result in the DV change (sufficient)

33
Q

Define Multifactorial Causation.

A

Phenomenon is determined by many interacting factors

34
Q

What is a Random Sample?

A
  • the gold standard
  • each member of the population has an equal chance of being selected
  • usually quasi-random
35
Q

What is a Systematic Sample?

A
  • draw from the population at fixed intervals

- problematic in populations with a periodic function

36
Q

What is a Stratified Sample?

A

Proportional: specified groups appear in numbers proportional to their size in the population

Disproportional: specified groups which are not equally represented in the population, are selected in equal proportions.

37
Q

What is a Cluster sample?

A

researcher samples an entire group or cluster from the population of interest

38
Q

What is an Opportunity/Convenience Sample?

A
  • people who are easily available

- but can lead to a biased sample

39
Q

What is a Snowball Sample?

A
  • recruit small number of participants and then use those initial contacts to recruit further participants
  • biases the sample, but useful if you want to recruit very specific populations.
40
Q

What is Population Validity?

A

is our sample representative?

41
Q

What is Ecological Validity?

A

does the behaviour measured reflect naturally occurring behaviour?