College 8: Interpretation of results

Question 1

What is reliability?

Answer 1

The consistency of a test score

Question 2

What is validity?

Answer 2

The degree to which a test is measuring what it was actually intended to measure

Question 3

What is inter-rater reliability?

Answer 3

The conclusions of 2 psychologists should be the same when observing test scores of 1 person

Question 4

What is test-retest reliability?

Answer 4

Test results should be consistent when it is repeated on the same subject on a different point of time

Question 5

What is parallel-forms reliability?

Answer 5

Measures the correlation between 2 equivalent versions of a test -> can sometimes avoid practice effects

Question 6

What is internal consistency reliability?

Answer 6

The correlation between multiple items within a test are intended to measure the same construct

Question 7

What is translation validity?

Answer 7

The extent to which an abstract concept has been captured by a psychometric instrument

Question 8

Translation validity

What is face validity?

Answer 8

Does the content of a test appear to be suitable towards it aims?

Face validity considers how suitable the content of a test seems to be on the surface. It’s similar to content validity, but face validity is a more informal and subjective assessment.

Question 9

Translation validity

What is content validity?

Answer 9

Is a test fully representative of what it aims to measure?

It assesses whether a test is representative of ALL ASPECTS of the construct. If some aspects are missing from the measurement (or if irrelevant aspects are included), the validity is threatened.

Question 10

What is criterion-related validity?

Answer 10

Whether the results correspond to other measures of the same construct

Question 11

Criterion-related validity

What is predictive validity?

Answer 11

The degree to which the operationalization can predict other measures of the same construct that are measured in the future

Operationalization’s ability to predict what it is theoretically able to predict. The extent to which a measure predicts expected outcomes.

Question 12

Criterion-related validity

What is concurrent validity?

Answer 12

The degree to which the operationalization can predict other measures of the same construct that are measured at the same time

Operationalization’s ability to distinguish between groups it theoretically should be able to. This is where a test correlates well with a measure that has been previously validated.

Question 13

What is construct validity?

Answer 13

Whether a test actually measures the concept that is intended to measure

Question 14

Construct validity

What is convergent validity?

Answer 14

The measure should be associated with things that it should be associated with

Question 15

Construct validity

What is discriminant validity?

Answer 15

The measure should not be associated with things that it shouldn’t be associated with

Question 16

What is sensitivity?

Answer 16

The probability of a positive test, given that the person is actually affected -> the detection of true positives

Question 17

What is specificity?

Answer 17

The probability of a negative test, given that the person is healthy -> the detection of true negatives

Question 18

What means the p-value?

Answer 18

The probability of obtaining certain test results in the real world that are at least as extreme as the results that you observed in your data with the assumption that the null hypothesis would be correct

Question 19

Wat does Bayesian statistics do?

Answer 19

Quantify evidence in either the favor of H1 or H0

Question 20

What does effect sizes do?

Answer 20

Quantify the size of the difference/relationship you are interested in