Lecture 2 - Validity and Reliability

Question 1

What are 5 rest selection considerations?

Answer 1

1. Population
2. Ease and feasibility of test administration
3. Ease of normative data comparison
4. Ethics and fairness
5. Validity and reliability

Question 2

______ = the ability of a test to measure accurately, and ________= the consistency or repeatability of an observation.

Answer 2

validity; reliability

Question 3

What 3 things does validity depend on?

Answer 3

1. reliability
2. relevance
3. appropriateness of scores

Question 4

What are 4 types of validity evidence?

Answer 4

1. Construct validity
2. Logical (face) validity
3. Criterion validity
4. Convergent validity

Question 5

All common types of validity evidence can be estimated either _______ or ________.

Answer 5

logically; statistically

Question 6

_________ validity evidence = the test effectively measures the desired construct.

Answer 6

construct

Question 7

_______ validity evidence = the measure obviously involves the performance being measured.

Answer 7

logical/face

Question 8

Is statistical evidence required for logical/face validity evidence?

Answer 8

NO

Question 9

What is criterion validity also called?

Answer 9

statistical or correlation validity

Question 10

______ validity = degree to which scores on a test are related to a recognized standard or criterion.

Answer 10

criterion (or statical or correlation)

Question 11

How is criterion validity obtained?

Answer 11

By determining the correlation/validity coefficient (r) between scores for a test and the criterion measure.

Question 12

What are 2 types of criterion-related evidence?

Answer 12

1. Concurrent validity

2. Predictive

Question 13

_______ validity = the criterion is measured at approximately the same time as the alternate measure and the scores are compared.

Answer 13

Concurrent

Question 14

_______ validity = the criterion is measured in the future (weeks, months, years) later.

Answer 14

predictive

Question 15

________ validity evidence = = 2 or more measurements are conducted to collect data and establish that a test battery is measuring what is purports to measure.

Answer 15

convergent

Question 16

________ = the degree to which repeated measurements of a train are reproducible under the same conditions.

Answer 16

reliability

Question 17

Use ____-____ scores to calculate a stability reliability coefficient.

Answer 17

test-retest

Question 18

What are the three types of reliability?

Answer 18

1. Stability
2. Internal-consistency
3. Objectivity

Question 19

_______ reliability = scores do not change across days.

Answer 19

Stability

Question 20

What are 3 factors that contribute to low stability?

Answer 20

1. The people tested may perform differently
2. The measuring instrument may operate of be applied differently
3. The person administering the measurement may change

Question 21

______-_______ reliability = evaluator gives at least two trials of the test within a single day. Change in the score trials indicate ____ reliability.

Answer 21

internal-consistency; poor

Question 22

What is a benefit of internal consistency reliability?

Answer 22

All measurements are taken within the same day.

Question 23

The internal-consistency reliability coefficient (is/is not) comparable to the stability reliability coefficient.

Answer 23

IS NOT; I-C coefficient is almost always higher

Question 24

________ = rater/judge reliability; aka ____-tester reliability.

Answer 24

objectivity; inter

Question 25

What are 2 factors effecting objectivity?

Answer 25

1. The clarity of the scoring system

2. The degree to which the “judge” can assign a score accurately

Question 26

What are 5 considerations for reducing measurement error?

Answer 26

1. Valid and reliable tests
2. Instructions
3. Test-complexity
4. Warm up and test trials
5. Equipment quality and preparation

Question 27

What does calibration require

?

Answer 27

comparison between measurements

Question 28

Under what 3 conditions can reliability be expected in?

Answer 28

1. The testing environment is favourable to good performance
2. People are motivated, ready to test, informed, and familiar
3. The person administering the test is trained and competent