chapter 4 Flashcards

1
Q

**error

A

It means that there will always be some inaccuracy in our measurements*

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

reliable

A

Tests that are relatively free of measurement error are considered

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

**Charles Spearman

A

actually worked out most of the basics of contemporary reliability theory, and published it in 1904 in the American Journal of Psychology.
-Thorndike’s book An Introduction to the Theory of Mental and Social Measurements (1904),

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

bell-shaped

A

**The distribution of random errors is normal,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

*Standard error of measurement

A

is the standard deviation of the error scores (X-T) around the true score (T).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Item Response Theory:

A

An individual receives items on a test such as an IQ test based on previous correct or incorrect items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Models of Reliability

A

Federal government guidelines require that a test be reliable before one can use it to make employment or educational placement decisions*

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Test reliability is usually estimated in one of three ways:

A

Test-retest method
Parallel Forms method
Internal Consistency method (half and half with items)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Test-Retest Method

A

Only applies to measures ofstable traits*—but some important things one might measure change over time.
There can be a “carry-over effect”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

not stable -test retest method

A

a low correlation between scores on two administrations could mean that the characteristic under study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Spearman-Brown formula**

A

Where r is correlation
r = 2r
1 + r

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

**All measures of internal consistency evaluate

A

the extent to which the different items on the test measure the same ability or trait (or the same construct-idea)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

kappa statistic

A

is the *best method** for estimating interrater reliability-dntk

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

The Kappa statistic indicates

A

the actual agreement as a proportion of potential agreement following a correction for chance agreement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

**Standard Error of Measurement

A

is an estimate of the degree to which a test provides inaccurate readings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

**When tests are used to make important decisions about someone’s future,

A

, evaluators must minimize error.

17
Q

What to do about low reliability

A

Increase the number of items

18
Q

factor and item analyis.

A

Sometimes some items don’t actually measure the construct

19
Q

** If a test is not reliable, then one cannot demonstrate that it has any meaning!

A

There can be no validity without reliability***.