Week 10 Reliability and validity Flashcards

1
Q

What is reliability?

A

The consistency of measurements, or of an individual’s performance on a test; or the absence of measurement error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two types of error?

A

Systematic and random

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is systematic error?

A

Consistent error which biases the true score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is random error?

A

Unpredictable error which biases the true score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the types of reliability?

A

Relative and absolute

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is relative reliability?

A

The degree to which data maintain their position in a sample with repeated measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is absolute reliability?

A

The degree to which repeated measurements vary for individuals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the tests for reliability?

A

Retest reliability
Inter-rater reliability
Internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How does retest reliability test reliability?

A

Test stability in measurements across two tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How does Inter-rater reliability test reliability?

A

Correlate the scores with data obtained from different researchers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How does internal consistency test reliability?

A

Reliability across different parts of a measurement instrument (questionnaire sub-scale)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Does correlation infer agreement and provide an example?

A

No
A perfect positive correlation exists between an expensive
laboratory body fat analyser & a cheap ‘home use’ analyser but they calculate different BF%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the measures of absolute reliability?

A

Technical error of measurement
Standard error of measurement
Coefficient of variation
Limits of agreement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is validity?

A

The extent to which a test or instrument measures what i is supposed to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the types of validity of measurements?

A

Face validity
Content
Construct validity
Criterion (concurrent and predictive validity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the types of validity in a study?

A

Internal

External

17
Q

What is face validity?

A

The method of data collection obviously involves the factor being measured (timing gates in a 100m sprint)

18
Q

What is content validity?

A

Evidence that the content on a test correspond to the content it was designed to cover

19
Q

What is construct validity?

A

Assess the extent to which an instrument accurately measures hypothetical constructs

20
Q

What is convergent validity?

A

Scores on a instrument are related to those on a similar instrument

21
Q

What is discriminant validity?

A

Scores on a instrument are not related to those on a from an instrument which assess a different construct

22
Q

What is criterion-related validity?

A

Evidence that scores form an instrument correspond with or predict concurrent external measures conceptually related to the measured construct

23
Q

What is concurrent validity?

A

Scores collected at roughly the same time

24
Q

What is predictive validity?

A

Criterion instruments completed at a later date (testing a group of subject for a certain construct, and then comparing them with the results obtained at a later date)

25
What is commonly used to assess criterion related and construct validity?
Person's correlation coefficient
26
What is internal validity?
Refers to the ability to attribute changes in the dependent variable to the manipulation of the independent variable.
27
How is internal validity effected?
Depends on the robustness of methods
28
What is external validity?
Refers to the ability to generalise the results of a study to other setting and other individuals
29
What are the threats to external validity?
Reactive or interactive effects of testing Interaction of selection bias and the treatment Reactive effects of experimental arrangements Multiple-treatment interference