Chapter 3: Basic Psychometric Principles Flashcards
Many variables are called _____.
Constructs
Variables of interest are either ____ or ____ in nature
Continuous
Quantitative
What is the goal of the measurement of variables of interest?
assign scores o the units under study often the participant
___ refers to the theory and techniques for assessing the adequacy of such quantitative scores.
Psychometrics
What are the two terms of the psychometric theory that measures quality?
Reliability and Validity
___ Refers to the consistency of scores over replicated assessments.
Reliability
____ the extent to which differences in scores reflect actual differences in the characteristic (construct) of interest.
Validity
If you were to test a prisoner in a jail on a Tuesday and they test again one week later and the score is the same or similar. This is considered to what type of assessment of reliability?
test-re-test
What is a pre-construct of validity?
Reliability or consistency
___ the appropriateness of scores derived from a given measurement procedure of intended use (unbiased selection of applicants for occupational or educational activities; testing of theoretical propositions by examining relations among scores representation various constructs of interests.)
Validity
How do you address whether a score provides information about underlying constructs?
Validity
____ theory proceeds from the assumption that scores derived from psychological assessment procedures are inherently imperfect.
Classical reliability
Someone comes in to test and is not feeling their best on a certain day. Maybe they did not perform well on this date or to their best. What is it called when this occurs?
Measurement Error
____ is the most commonly reported reliability coefficient.
Chronbach’s coefficient alpha
Why is Cronbach’s coefficient alpha the most commonly reported reliability coefficient?
It can and should be computed and reported any time a multi-item scale is administered to a sample of participants.
Coefficient alpha is a coefficient of internal consistency reliability referred to as ____.
Coefficient of equivalence
___ Variance that is consistent over replicated assessments
true score variance
___ is usually. notated as rXX. Quantifies the proportion of variance in scores that is attributable to true scores.
Reliability Coefficient
What is a confusing feature of reliability theory?
Besides all of it :-)
Measurement error comes in different types
It is normally relevant to report both ___ and ____
coefficients of internal consistency coefficients of stability
Reliability is a property of scores, not ____.
measures
indicates the proportion of score variance that this attributable to a combination of ___.
specific factor error
__ item variance that does not load on the general factor common to all items on the scale.
Random error
___ test-retest reliability coefficient.
Coefficient of stability
Researchers should be concerned about reliability because ____.
measurement error biases estimates of effect sizes in psychological research.
___ computing the correlation between scores on variables x and y.
Observed correlation
The observed correlation is always smaller in magnitude than the true correlation is called___.
attenuation
True or False: A very reliable measure may still have poor validity.
True
___ is much more difficult to summarize succinctly.
Validity evidence
Reliability is a property of the scores on a test for a particular population of ____.
examinees
A coffee cup in an assessment. Someone may normally view an error with the image such as needing a saucer.
Test bias
