Week 10 Reliability and validity Flashcards

1
Q

What is reliability?

A

The consistency of measurements, or of an individual’s performance on a test; or the absence of measurement error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the two types of error?

A

Systematic and random

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is systematic error?

A

Consistent error which biases the true score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is random error?

A

Unpredictable error which biases the true score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the types of reliability?

A

Relative and absolute

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is relative reliability?

A

The degree to which data maintain their position in a sample with repeated measurements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is absolute reliability?

A

The degree to which repeated measurements vary for individuals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the tests for reliability?

A

Retest reliability
Inter-rater reliability
Internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How does retest reliability test reliability?

A

Test stability in measurements across two tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How does Inter-rater reliability test reliability?

A

Correlate the scores with data obtained from different researchers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How does internal consistency test reliability?

A

Reliability across different parts of a measurement instrument (questionnaire sub-scale)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Does correlation infer agreement and provide an example?

A

No
A perfect positive correlation exists between an expensive
laboratory body fat analyser & a cheap ‘home use’ analyser but they calculate different BF%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the measures of absolute reliability?

A

Technical error of measurement
Standard error of measurement
Coefficient of variation
Limits of agreement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is validity?

A

The extent to which a test or instrument measures what i is supposed to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the types of validity of measurements?

A

Face validity
Content
Construct validity
Criterion (concurrent and predictive validity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the types of validity in a study?

A

Internal

External

17
Q

What is face validity?

A

The method of data collection obviously involves the factor being measured (timing gates in a 100m sprint)

18
Q

What is content validity?

A

Evidence that the content on a test correspond to the content it was designed to cover

19
Q

What is construct validity?

A

Assess the extent to which an instrument accurately measures hypothetical constructs

20
Q

What is convergent validity?

A

Scores on a instrument are related to those on a similar instrument

21
Q

What is discriminant validity?

A

Scores on a instrument are not related to those on a from an instrument which assess a different construct

22
Q

What is criterion-related validity?

A

Evidence that scores form an instrument correspond with or predict concurrent external measures conceptually related to the measured construct

23
Q

What is concurrent validity?

A

Scores collected at roughly the same time

24
Q

What is predictive validity?

A

Criterion instruments completed at a later date (testing a group of subject for a certain construct, and then comparing them with the results obtained at a later date)

25
Q

What is commonly used to assess criterion related and construct validity?

A

Person’s correlation coefficient

26
Q

What is internal validity?

A

Refers to the ability to attribute changes in the dependent variable to the manipulation of the independent variable.

27
Q

How is internal validity effected?

A

Depends on the robustness of methods

28
Q

What is external validity?

A

Refers to the ability to generalise the results of a study to other setting and other individuals

29
Q

What are the threats to external validity?

A

Reactive or interactive effects of testing
Interaction of selection bias and the treatment
Reactive effects of experimental arrangements
Multiple-treatment interference