Week 5

Question 1

Define validity

Answer 1

• Is the degree of truthfulness of a test score

- The degree to which the test or instrument measures what it is supposed to measure

Question 2

What two characteristics is validity dependent on

Answer 2

Relevance

Reliability

Question 3

What are the two types of validity that are logical validity

Answer 3

Face validity

Content validity

Question 4

Define face validity

Answer 4

• Infers that a test is valid by definition

- It is clear that the test measures what it is supposed to

Question 5

Define content validity

Answer 5

• Infers that the test measures all aspects contributing to the variable of interest
  
  • e.g. who is the most physically fit

Question 6

Two types of validity that are statistical validity

Answer 6

concurrent validity

Predictive validity

Question 7

Define concurrent validity

Answer 7

• Infer that the test produces similar results to a previously validated test e.g. VO2 max

Question 8

Define predictive validity

Answer 8

• Infers that the test provides a valid reflection of future performance using a similar test, e.g. can performance during test A be used to predict future performance in test B

Question 9

Validity type that is both logical and statistical

Answer 9

Construct

Question 10

Define construct validity

Answer 10

• Infers not only that the test is measuring what is supposed to, but also that it is capable of detecting what should exist, theoretically
  
  • Therefore relates to hypothetical constructs

Question 11

Define reliability

Answer 11

• Reliability relates to the consistency or repeatability of an observation
  
  • Degree to which repeated measures of the same trait are reproducible under the same conditions

Question 12

Test reliability is sometimes discussed in terms of….

Answer 12

Observed score
true score
error score

Question 13

Observed score equation

Answer 13

Observed score = true score + error score

Question 14

Define internal consistency

Answer 14

Internal consistency reliability is a way to gauge how well a test or survey is actually measuring what you want it to measure.

Question 15

What does test-rest measure

Answer 15

It reflects the variation in measurements taken by an

instrument on the same subject under the same conditions

Question 16

Define kappa - interrater reliability

Answer 16

The consistency of a given measurement from categorical outcomes

Question 17

Define Intraclass Correlation Coefficient (ICC)

Answer 17

s a descriptive statistic that can be used when quantitative measurements are made on units that are organized into groups. It describes how strongly units in the same group resemble each other.

Question 18

Threats to internal validity

Answer 18

• Maturation
  
  • History
  • Statistical regression: An initial extreme score is likely to be followed by less extreme subsequent scores
  • Instrumentation e.g. Uncalibrated equipment
  • Selection Bias, e.g. Groups not randomly assigned

Question 19

Threats to external validity

Answer 19

Hawthorne effect

Demand characteristics

Question 20

Define hawthorne effect

Answer 20

subject is influenced by the fact that it is being recorded, e.g. Fastest sprint when professor enters lab

Question 21

Define demand characteristics

Answer 21

Participants detect the purpose of the study and behave accordingly

Question 22

Define internal validity

Answer 22

Internal validity is the extent to which a piece of evidence supports a claim about cause and effect

Question 23

Define external validity

Answer 23

External validity is the validity of applying the conclusions of a scientific study outside the context of that study