5

Question 1

reliability/precision

Answer 1

the consistency of test scores

Question 2

the consistency of test scores

Answer 2

reliability/precision

Question 3

test–retest coefficients

Answer 3

estimate the reliability/precision of test scores when the same people take the same test form on two separate occasions

Question 4

estimate the reliability/precision of test scores when the same people take the same test form on two separate occasions

Answer 4

test–retest coefficients

Question 5

alternate-form coefficients

Answer 5

estimate the reliability/precision of test scores when the same people take a different but equivalent form of a test on two independent testing sessions.

Question 6

estimate the reliability/precision of test scores when the same people take a different but equivalent form of a test on two independent testing sessions.

Answer 6

alternate-form coefficients

Question 7

internal consistency coefficients

Answer 7

which estimate the reliability/precision of test scores by looking at the relationships between different parts of the same test given on a single occasion

Question 8

which estimate the reliability/precision of test scores by looking at the relationships between different parts of the same test given on a single occasion

Answer 8

internal consistency coefficients

Question 9

scorer reliability

Answer 9

agreement when raters use their subjective judgment to assign scores to test taker responses

Question 10

agreement when raters use their subjective judgment to assign scores to test taker responses

Answer 10

scorer reliability

Question 11

measurement error

Answer 11

Variations in the measurements of the room—perhaps a fraction of an inch from time to time

Question 12

Variations in the measurements of the room—perhaps a fraction of an inch from time to time

Answer 12

measurement error

Question 13

reliable test

Answer 13

one we can trust to measure each person in approximately the same way every time it is used

Question 14

one we can trust to measure each person in approximately the same way every time it is used

Answer 14

reliable test

Question 15

just because it’s reliable doesn’t mean its _____

Answer 15

valid

Question 16

true score (T)

Answer 16

a measure of the amount of the attribute that the test is designed to measure

Question 17

a measure of the amount of the attribute that the test is designed to measure

Answer 17

true score (T)

Question 18

random error (E)

Answer 18

the difference between a person’s actual score on a test and that person’s true score (T)

Question 19

the difference between a person’s actual score on a test and that person’s true score (T)

Answer 19

random error (E)

Question 20

error in measurement formula

Answer 20

X = T + E

Question 21

systematic error

Answer 21

When a single source of error always increases or decreases the true score by the same amount

Question 22

When a single source of error always increases or decreases the true score by the same amount

Answer 22

systematic error

Question 23

two problems that can add systematic error as well as random error to test scores

Answer 23

practice effects and order effects

Question 24

reliability coefficient

Answer 24

correlation between the two sets of test scores

Question 25

correlation between the two sets of test scores

Answer 25

reliability coefficient

Question 26

test–retest method

Answer 26

a test developer gives the same test to the same group of test takers on two different occasions

Question 27

a test developer gives the same test to the same group of test takers on two different occasions

Answer 27

test–retest method

Question 28

Practice effects

Answer 28

limitation in test-retest when test takers benefit from taking the test the first time (practice), which enables them to solve problems more quickly and correctly the second time

Question 29

when test takers benefit from taking the test the first time (practice), which enables them to solve problems more quickly and correctly the second time

Answer 29

Practice effects

Question 30

alternate forms/parallel forms

Answer 30

create two different forms of the test

Question 31

create two different forms of the test

Answer 31

alternate forms/parallel forms

Question 32

order effects

Answer 32

changes in test scores resulting from the order in which the tests were taken

Question 33

changes in test scores resulting from the order in which the tests were taken

Answer 33

order effects

Question 34

Internal consistency

Answer 34

a measure of how related the items (or groups of items) on the test are to one another.

Question 35

a measure of how related the items (or groups of items) on the test are to one another.

Answer 35

Internal consistency

Question 36

split-half method

Answer 36

divide the test into halves and then compare the set of individual test scores on the first half with the set of individual test scores on the second half

Question 37

divide the test into halves and then compare the set of individual test scores on the first half with the set of individual test scores on the second half

Answer 37

split-half method

Question 38

homogeneous test

Answer 38

measuring only one trait or characteristic

Question 39

measuring only one trait or characteristic

Answer 39

homogeneous test

Question 40

heterogeneous test

Answer 40

measuring more than one trait or characteristic

Question 41

measuring more than one trait or characteristic

Answer 41

heterogeneous test

Question 42

Estimating reliability using methods of internal consistency is appropriate only for a _________

Answer 42

homogeneous test

Question 43

scorer reliability/interscorer agreement

Answer 43

the amount of consistency among scorers’ judgments

Question 44

the amount of consistency among scorers’ judgments

Answer 44

scorer reliability/interscorer agreement

Question 45

intrascorer reliability

Answer 45

whether each clinician was consistent in the way he or she assigned scores from test to test.

Question 46

whether each clinician was consistent in the way he or she assigned scores from test to test.

Answer 46

intrascorer reliability

Question 47

interrater agreement

Answer 47

an index of how consistently the scorers rate or make decisions.

Question 48

an index of how consistently the scorers rate or make decisions.

Answer 48

interrater agreement

Question 49

intrarater agreement

Answer 49

How well a scorer makes consistent judgments across all tests.

Question 50

How well a scorer makes consistent judgments across all tests.

Answer 50

intrarater agreement

Question 51

confidence interval

Answer 51

a range of scores that we feel confident will include the test taker’s true score

Question 52

a range of scores that we feel confident will include the test taker’s true score

Answer 52

confidence interval

Question 53

factors That Influence Reliability

Answer 53

1) poorly designed test 2) administrators don't follow insturctions 3) test not scored accurately 4) test takers: fatigue, illness, exposure to test questions before hand

Question 54

what are the six factors related to sources of error

Answer 54

test length homogeneity: similar questions on the test test-retest interval: longer the interval, lower the reliability test administration scoring cooperation of test takers

Question 55

generalizability theory

Answer 55

concerns how well and under what conditions we can generalize an estimation of reliabilty/precision of test scores from one test administration to another

Question 56

concerns how well and under what conditions we can generalize an estimation of reliabilty/precision of test scores from one test administration to another

Answer 56

generalizability theory