Reliability Flashcards

1
Q

Tests that are free from measurement of error

A

Reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

measurements are consistent, or repeatable

A

Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

who pioneered reliability

A

Charles Spearman

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Measurement of instruments are imperfect thus we use this formula

A

X= T+E

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

problems created by using a limited number of items to represent a larger more complicated construct

A

domain sampling model

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

it is the ratio of variance of the observed score on the shorter test and the variance of the long run true score

A

reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

focuses on an item difficulty to assess the ability

A

Item Response Theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

it is an index of reliability

A

Reliabilitycoefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

a proportion that indicates the ratio between the true score variance on a test and the total variance

A

reliability coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Sources of Error

A

Test Construction , Test Administration, Test Scoring and I

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

another name for test retest reliability estimate

A

Time Sampling Method

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

obtained by correlating pairs of scores from the same people on 2 different administrations of the same test

A

Test-Retest Reliability Estimate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

The estimate of test retest reliability is

A

coefficient of stability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

it exists when for each form of the test the means and the variances of the observed score test acores are equal

A

Parallel Forms and Alternating Forms Reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

obtained by correlating 2 pairs of scores obtained from equivalent halves of a single test administered once

A

Split Half Reliability Estimates

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Steps in Split Half Reliability

A
  1. Divide the test into equivalent halves 2. Calculate Pearson r bet. scores of the 2 halves of the test 3. Adjust the half test reliability using Spearman Brown Formula
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

refers to the degree of correlation among all items on a scale

A

Inter item consistency

18
Q

it measures a single trait

A

Homogenous Test

19
Q

Used when the items are highly homogenous and is the same result with split half reliability

A

KR-20 formulas

20
Q

reliability criteria that doesn’t require calculation of p and q

A

KR21

21
Q

item difficulty in KR21

A

average of 50%

22
Q

the mean of all possible split-half correlations,

A

Coefficient Alpha

23
Q

Coefficient alpha is corrected by what

A

Spearman-Brown Formula

24
Q

how to increase relia ility?

A
  • increase the number of items or observations. -Eliminate items that are unclear. -Standardize the conditions under whixh the test is taken. -Moderate the degree of difficulty of the tests. -Minimize the effects of external events. -Standardize the instructions -Maintain a consistent scoring procedures
25
Q

type of reliabilty that measures stability

A

test retest

26
Q

type of reliabilty that measures equivalence

A

Parallel or Alternate Forms

27
Q

type of reliabilty that measures Agreement

A

Inter-rater

28
Q

type of reliabilty that measures consistency of each item in the underlying construct

A

Internal consistency

29
Q

Statistical Computation for Test-retest

A

Correlation (Pearson r or Spearman ro)

30
Q

Statistical Computation for Stability

A

Correlation (Pearson r or Spearman rho)

31
Q

Statistical Computation for equivalence

A

Correlation, Pearson r or Spearman rho

32
Q

Statistical Computation for parallel or alternate forms

A

Correlation (Pearson r or Spearman rho)

33
Q

Statistical Computation for Agreement

A

Percentage and Kappa’s coefficient

34
Q

Statistical Computation for inter rater

A

Percentage and Kappa’s coefficient

35
Q

Statistical Computation for Internal Consistency

A

Cronbach’s Alpha , Kuder Richardson, Ordinal/Composite

36
Q

Statistical Computation for Consistency

A

Cronbach’s Alpha,Kuder-Richardson,Ordinal/Composite

37
Q

it is usually an internal consistency of alpha as index

A

.70

38
Q

Newly developed should not have what consistency

A

should not have internal consistency of .90 and above

39
Q

modest reliabilty

A

.60 - .69

40
Q

Considerations in the use and purpose of reliability coefficients

A

homogeneity vs heterogeneity of test items. dynamic vs static characteristics. Speed test vs Power test