Module 5: Reason for Accepting or Rejecting Instruments and Tools based on Psychometric Properties

Question 1

Reliability Coefficient Values and their Interpretations

Answer 1

.90 and up = excellent
.80 - .89 = good
.70 - .79 = adequate
below .70 = may have limited applicability

Question 2

In a case of basic research, what should the range of the reliability coefficient be to at least be accepted?

Answer 2

.70 to .90

Question 3

In a case of a clinical setting, what should the range of the reliability coefficient be to at least be accepted?

Answer 3

.90 to .95

Question 4

Validity Coefficient Values and their Interpretations

Answer 4

above .35 = very beneficial
.21 - .35 = likely to be useful
.11 - .20 = depends on the circumstances
below .11 = unlikely to be useful

Question 5

Item Difficulty Ranges and their Interpretations

Answer 5

0.0 - 0.19 = very difficult
0.20 - 0.39 = difficult
0.40 - 0.60 = average/moderately difficult
0.61 - 0.79 = easy
0.80 - 1.0 = very easy

Question 6

Item Discrimination Ranges and their Interpretations

Answer 6

.40 & above = very good item
.30 - .39 = good item
.20 - .29 = fair item
.09 - .19 = poor item

Question 8

Optimal Boundary Lines for Distributions

Answer 8

The optimal boundary lines for the “upper” and “lower” areas of distribution of scores will distinguish the upper and lower 27% of distribution of scores if it is a normal distribution as in 0.27/n, wherein n = no. of students

It is 33% if it is a platykurtic distribution

Question 9

Inter-Item Reliability Index and their Interpretations (Cronbach’s alpha)

Answer 9

a >/= 0.9 - excellent
0.9 > a >/= 0.8 - good
0.8 > a >/= 0.7 - acceptable
0.7 > a >/= 0.6 - questionable
0.6 > a >/= 0.5 - poor
0.5 > a - unacceptable

Question 10

Interrater Reliability Coefficient and their Interpretations according to Cicchetti & Sparrow (1981)

Answer 10

0.75 - 1.0 = excellent
0.6 - 0.74 = good
0.41 - 0.6 = fair
0 - 0.4 = poor

Question 11

Interrater Reliability Coefficient and their Interpretations according to Fleiss (1981)

Answer 11

0.75 - 1.0 = excellent
0.41 - 0.74 = fair to good
0 - 0.4 = poor

Question 12

Interrater Reliability Coefficient and their Interpretations according to Landis & Koch (1977)

Answer 12

0.80 - 1.0 = almost perfect
0.60 - 0.79 = substantial
0.40 - 0.59 = moderate
0.20 - 0.39 = fair
0 - 0.19 = slight
< 0 = poor

Question 13

Interrater Reliability Coefficient and their Interpretations according to Regier et al. (2012)

Answer 13

0.80 - 1.0 = excellent
0.60 - 0.79 = very good
0.40 - 0.59 = good
0.20 - 0.39 = questionable
0 - 0.19 = unacceptable

Question 14

What does a 0 mean in interrater reliability coefficient?

Answer 14

0 means 0% of the variance in the scores assigned by the scorers was attributed to true differences and 100% to error

Question 15

P-Value and State of Hypothesis

Answer 15

P-Value ≤ ∞, reject null hypothesis
P-Value ≥ ∞, accept null hypothesis

Question 16

p-value and Evidence against Null Hypothesis

Answer 16

p > 0.10 = weak or no evidence
0.05 < p ≤ 0.10 = moderate
0.01 < p ≤ 0.05 = strong evidence
p ≤ 0.01 = very strong evidence