7-8 Flashcards
refers to the inherent uncertainty associated with any measurement, even after care has been taken to minimize preventable mistakes
Measurement Error
Preventable mistake and mistake that we can’t control
Measurement Error
consists of unpredictable
fluctuations and inconsistencies of other variables in the measurement proces
Random Error
Chance difference between the observed and true value
Random
terms that refer to variation among items within a test as well as to
variation among items between tests
Item sampling and content sampling
the interviewers may
not have been trained properly, the wording in the
questionnaire may have been ambiguous, or the items may
have somehow been biased to favor one or another of the
candidates.
Methodological Error
influence test scores in a
consistent direction. Systematic errors either
consistently inflate scores or consistently deflate
scores. Once a —— becomes known, it
becomes predictable—as well as fixable
Systematic Error
terms that refer to
variation among items within a test as well as to variation
among items between tests.
Item sampling or content sampling,
the measuring by using the same
instrument to measure the same thing at two points in time,
and the result of such an evaluation is an estimate of
Test retest
an estimate of reliability obtained
by correlating pairs of scores from the same people on two
different administrations of the same test.
Test retest
an estimate of reliability obtained
by correlating pairs of scores from the same people on two
different administrations of the same test.
Test retest
The degree of the relationship
between various forms of a test
Coefficient of Equivalence
refers to an estimate of the extent
to which item sampling and other errors have affected test
scores on versions of the same test when, for each form of the test, the means and variances of observed test scores
are equa
is a statistic that quantifies reliability, ranging from
0 (not at all reliable) to 1 (perfectly reliable)
Reliability
refers to the inherent uncertainty
associated with any measurement, even after care has been
taken to minimize preventable mistakes.
Measurement Error
is a consistent or proportional difference between the
observed and true values of something (e.g., a miscalibrated scale
consistently registers weights as higher than they actually are
Systematic
is a chance difference between the observed and true values
of something (e.g., a researcher misreading a weighing scale records
an incorrect measurement).
Random Error
the measurement of a quantity if there were no error at all.
True Score
the score on an ability test is presumed to reflect not only the
testtaker’s true score on the ability being measured but also the error.
CTT
refers to the component of the observed test score that does not
have to do with the testtaker’s ability.
Error
consists of unpredictable fluctuations and
inconsistencies of other variables in the measurement process
Random Error
This source of error fluctuates from one testing situation to another
with no discernible pattern that would systematically raise or lower
scores.
Random Error
are inconsistent errors that happen by
chance. They are inherently unpredictable and transitory.
Random Error
Source of error in measuring a variable that is
typically constant or proportionate to what is presumed to be the true
value of the variable being measured.
Systematic Error
room temperature, level of lighting, and amount of
ventilation and noise, for instance. A relentless fly may develop a
tenacious attraction to an examinee’s face. A wad of gum on the seat of
the chair may make itself known only after the testtaker sits down on it.
Test environment
variable of interest when evaluating a patient’s
general level of suspiciousness or fear is the patient’s home
neighborhood and lifestyle. Especially in patients who live in and must
cope daily with an unsafe neighborhood, what is actually adaptive fear
and suspiciousness can be misinterpreted by an interviewer as psychotic
paranoia
Event of the day
usually contain a disclaimer as to the margin of
error associated with their findings.
Survey and Polls
An estimate of reliability obtained by correlating
pairs of scores from the same people on two different administrations of
the same test.
Test retest
Most appropriate for variables that should be stable over time, such as
personality, and not appropriate for variables expected to change over
time.
Test retest Reliability
For each form of the test, the means and the
variances of observed test scores are equal.
Parallel forms
Typically designed to be equivalent with respect to
variables such as content and level of difficulty.
Alternate forms
Estimates the extent to which specific sources of variation under defined conditions are contributing to the test
score.
Domain Sampling Theory
Based on the idea that a person’s test scores vary from testing to testing because of variables in the testing situatio
Generalizability Theory
refers to the intercorrelations
among items within the same test. If the test is designed to
measure a single construct and all items are equally good
candidates to measure that attribute, then there should be a high
correspondence among the items
Internal Consistency
range or band of test scores that is likely to
contain the true score. A —— is the mean of your
estimate plus and minus the variation in that estimate.
Confidence Interval
A statistical measure that can aid a
test user in determining how large a difference in test scores should be
before it is considered statistically significant.
Standard Error of difference
can be used to estimate the extent to which an
observed score deviates from a true score.
Standard error
the tool used to estimate or infer the extent to
which an observed score deviates from a true score
Standard Error of Measurement
