Validity and Reliability

Question 1

Define validity

Answer 1

• The degree to which the test or instrument measures what it is supposed to measure

Question 2

What are the 4 types of validity

Answer 2

Logical or face
Content
Criterion
Concurrent

Question 3

Define logical or face validity

Answer 3

• Degree to which a measure involves the performance being measured
  
  • Not objective, hence not useful for research

Question 4

Define content validity

Answer 4

• Usually applies to education settings

- Degree to which the sample of items or questions on a test are representative of some defined content

Question 5

Define criterion validity

Answer 5

• Degree to which scores on a test are related to some recognised standard or criterion

Question 6

Define concurrent validity

Answer 6

• Type of criterion validity in which the scores from a measurement instrument are correlated with a criterion measure that is administered at the same time

Question 7

Define reliability

Answer 7

• Relates to the consistency or repeatability of an observation

Question 8

What is validity dependent on

Answer 8

Reliability and relevance

Question 9

TO be valid a test must be what

Answer 9

reliable

Question 10

A test can be x but not y

Answer 10

x = reliable 
y = valid

Question 11

What is the reliability and classical test theory

Answer 11

• Test reliability is sometimes discussed in terms of observed score, true score, and error score

Question 12

reliability and classical test theory equation

Answer 12

• Observed score = True score + Error score

Question 13

How can reliability been expressed

Answer 13

• Can be expressed by a correlation coefficient, ranging from -1.00 to 1.00

Question 14

Define interrater reliability

Answer 14

inter-rater reliability is the degree of agreement among raters.

Question 15

What correlation do u use for two measures, and what for more than two

Answer 15

Pearson r = two 
Intraclass correlation = for more then two

Question 16

what correlation is used for interrater reliability

Answer 16

Kappa

Question 17

What is the correlation range

Answer 17

• 1.00 to 1.00

Question 18

What does the Pearson r tell us

Answer 18

It gives information about the magnitude of the association, or correlation, as well as the direction of the relationship between variables.

Question 19

Explain the correlation ranges from 0 to + 1

Answer 19

.80 - 1: Very strong positive
.60 - 79: Strong positive 
.40 - 59: Moderate positive 
.20 - 39: Weak positive 
.0 - 19: Very weak positive

Question 20

Explain the correlation ranges from 0 to - 1

Answer 20

• 1.00 to - 0.80: Very strong negative
• 0.79 to - 0.60: strong negative
• 0.59 to - 0.40: moderate negative
• 0.39 to - 0.20: weak negative
• 0.19 to -0.01: very weak negative

Question 21

Define internal consistency reliability

Answer 21

nternal consistency reliability is a way to gauge how well a test or survey is actually measuring what you want it to measure.

Question 22

What does test-rest measure

Answer 22

It reflects the variation in measurements taken by an

instrument on the same subject under the same conditions

Question 23

Threats to external validity

Answer 23

Hawthorne effect

Demand characteristics

Question 24

Threats to internal validity

Answer 24

• Maturation
• History
• Statistical regression: An initial extreme score is likely to be followed by less extreme subsequent scores
• Instrumentation e.g. Uncalibrated equipment
• Selection Bias, e.g. Groups not randomly assigned

Question 25

Define hawthorne effect

Answer 25

subject is influenced by the fact that it is being recorded, e.g. Fastest sprint when professor enters lab

Question 26

Define demand characteristics

Answer 26

Participants detect the purpose of the study and behave accordingly

Question 27

Define internal validity

Answer 27

Internal validity is the extent to which a piece of evidence supports a claim about cause and effect

Question 28

Define external validity

Answer 28

External validity is the validity of applying the conclusions of a scientific study outside the context of that study