Chapter 4.2: Reliability Flashcards

1
Q

Refers to stability or consistency of the measurement

A

Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

An index of reliability, a proportion that indicates the ratio
between the true score variance on a test and the total variance

A

Reliability Coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

○ Refers to the proportion of the total variance attributed to true
variance

○ The greater the proportion of the total variance attributed to
true variance, the more reliable the test

A

Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Goals of Reliability

A

○ Estimate errors in psychological measurement

○ Devise techniques to improve testing so errors are reduced

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

All of the factors associated with the process of measuring
some variable, other than the variable being measured

A

Measurement Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Categories of Errors:
➢ Source of error in measuring a targeted variable caused by
unpredictable fluctuations and inconsistencies of other
variables in the measurement process

➢ Primarily influences the reliability of the measurement

A

Random Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Categories of Errors:
➢Source of error in measuring a variable that is typically
constant or proportionate
to what is presumed to be the
true value of the variable being measured

➢Primarily influences the validity of the measurement

A

Systematic error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Sources of Error Variance:
The extent to which the score is affected by the content
sampled in the test and by the way the content is
sampled (Item sampling or Content sampling)

A

Test Construction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Sources of Error Variance:
– Test environment: Room temperature, level of lighting, amount of ventilation
and noise

– Test taker Variables: Pressing emotional variables, physical discomfort, lack of
sleep, and effect of drugs or medications

– Examiner-related variables: Examiner’s physical appearance and demeanor

A

Test Administration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Sources of Error Variance:
– NOT ALL test can be scored by computer
– Scorers and scoring system are potential source of error
variance
– If subjectivity is involved in scoring, then the rater can be a
source of error variance
– Subjectivity in scoring can even enter in behavioral
assessment

A

Test Scoring and Interpretation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Reliability Estimates:
– Using the same instrument to measure the same thing as
two points in time
– The results of evaluation is called test-retest reliability
– 1 group; 2 different administration
– Measure something that is relatively stable over time
such as personality

A

Test-Retest Reliability Estimates/ Time Sampling
Method

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

interval between testing is 6
months

A

Coefficient of Stability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

most appropriate in reaction time
and perceptual judgment

A

Test-Retest Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Reliability Estimates:
Each form of the test, the means and the variances of
observed test scores are equal

A

Parallel Forms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Reliability Estimates:
– Simply different versions of a test that have been
constructed so as to be parallel
– Applicable on relatively stable traits

A

Alternate Forms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Uses a Coefficient of equivalence

A

Parallel Forms and Alternate Forms Reliability Estimates/
Item Sampling

17
Q

Uses a Coefficient of Stability

A

Test-Retest Reliability Estimates/ Time Sampling
Method

18
Q

Assesses the correlation between multiple items in a
test that are intended to measure the same construct
○ Split-half reliability
○ Kuder-Richardson formula
○ Cronbach Alpha

A

Internal Consistency

19
Q

– Correlating two pairs of scores obtained from equivalent
halves of a single test administered once
– The reliability of the test is directly related to the length
of the test
– The source of error variance is content sampling

A

Split-Half Reliability Estimates

20
Q

Allows a test developer or user to estimate internal
consistency reliability from a correlation of two halves of a
test

A

Spearman-Brown Formula

21
Q

– Used to determine the number of items needed to attain a
desired level of reliability

A

Spearman-Brown Prophecy

22
Q

items in a scale are unifactorial

A

Homogenous

23
Q

composed of items that measure more than one trait

A

Heterogeneous

24
Q
  • Developed by Cronbach
  • It is the preferred statistic for obtaining an estimate of internal
    consistency reliability
A

Coefficient Alpha

25
A value of .90 or above indicates _______ __ ____
redundancy of items
26
❏A relatively new measure for evaluating the internal consistency of a test ❏A measure used to evaluate the internal consistency of a test that focuses on the degree of difference that exists between item scores
Average Proportional Distance (APD)
27
It is the degree of agreement of consistency between two or more scorers (judges or raters) concerning a particular measure
Inter-Scorer Reliability
28
Reliability Ranges: 1 =
perfect reliability
29
Reliability Ranges: ≥ 0.9 =
excellent reliability
30
Reliability Ranges: ≥ 0.8 < 0.9 =
good reliability
31
Reliability Ranges: ≥ 0.7 < 0.8 =
acceptable reliability
32
Reliability Ranges: ≥ 0.6 < 0.7 =
questionable reliability
33
Reliability Ranges: ≥ 0.5 < 0.6 =
poor reliability
34
Reliability Ranges: < 0.5 =
unacceptable reliability
35
Reliability Ranges: - 0 =
no reliability