Week 7 Learning Outcomes

Question 1

Define systematic error

Answer 1

A consistent, repeatable error associated with faulty equipment or a flawed experiment design

Systematic errors can lead to results that are consistently skewed in one direction.

Question 2

Define random error

Answer 2

An unpredictable error that leads to variability in measurements due to chance factors

Random errors can often be reduced by increasing the sample size.

Question 3

What is intra-rater reliability?

Answer 3

The degree to which the same rater provides consistent scores over multiple trials

Intra-rater reliability is crucial for ensuring that a single evaluator’s measurements are stable.

Question 4

What is inter-rater reliability?

Answer 4

The level of agreement among different raters evaluating the same phenomenon

High inter-rater reliability indicates that different evaluators give similar scores.

Question 5

What is test-retest reliability?

Answer 5

The consistency of a measure when it is administered to the same group on two different occasions

Test-retest reliability is important for determining the stability of a measure over time.

Question 6

Define face validity

Answer 6

The extent to which a test appears to measure what it is supposed to measure, based on subjective judgment

Face validity is not a rigorous form of validity but is important for user acceptance.

Question 7

Define content validity

Answer 7

The degree to which a test covers the representative sample of the domain being measured

Content validity ensures that all aspects of a construct are adequately assessed.

Question 8

Define construct validity

Answer 8

The extent to which a test measures the theoretical construct it is intended to measure

Construct validity is crucial for ensuring that the test truly reflects the concept being studied.

Question 9

Define criterion validity

Answer 9

The extent to which a measure correlates with an outcome or criterion that it should theoretically be related to

Criterion validity can be assessed through predictive or concurrent validity.

Question 10

Identify commonly used statistics related to measurement reliability

Answer 10

• Cronbach’s alpha
• Kappa statistic
• Intraclass correlation coefficient
• Pearson correlation coefficient

These statistics help quantify the reliability of measurements in research.