Week 1-2 Psychometrics Flashcards
Psychometric soundness
the reliability and validity of a test
Reliability
Consistency of measurement, Precision with which the test measures and the extent to which error is present in the measurement
Validity
The ability of a test to measure what it is intended to measure
Cronbach’s definition of psychological test (3 criteria)
- Test involves behavioural samples
- The behavioural samples are collected in a systematic way
- The purpose of the test is to compare the behaviour of two or more people
Scaling
how numerical values are assigned to psychological attributes
3 key properties of numbers
The property of identity
The property of order
Th property of quantity
Norm-referenced tests
Norm referenced tests are used to compare a person’s test score with scores from a representative reference sample
e.g intelligence tests
Criterion referenced tests
Criterion referenced tests are used to evaluate an
individual’s test score with reference to a set standard
mastery tasks
Criterion referenced tests are typically used to gauge
achievement or mastery, so they are sometimes called
mastery tasks
inter-individual differences
comparing the behaviour of different people
intra-individual differences
comparing the behaviour of the same people at different times in different contexts
4 factors that can negatively affect the
interpretation of test scores as valid
- demand characteristics
- social desirability effects
- malingering
- experimenter bias
The property of identity
Represents “sameness” vs. “differentness” by sorting people into categories based on similarity of psychological features
The property of identity: 3 rules
1 must satisfy the property of “identity”
2 the categories must be mutually exclusive
3 the categories must be exhaustive
The property of order
- represents information about the relative amount of an attribute people possess
- When numerals have this property, they indicate the rank order of individuals on some psychological attribute
The property of quantity
-conveys information about the magnitude of differences between individuals
-Real numbers can be used to represent the quantity of an attribute
-cases can be compared with each other in a
meaningful and informative way
absolute zero
Absence of an attribute
arbitrary zero
does not indicate the absence of an attribute
Additivity
Unit size should remain constant—all units being counted should be equal
Intelligence, aptitude, and personality test scores are ordinal in nature because
they indicate not the amount of intelligence, aptitude,
and personality traits, but rather the rank order of individuals
In psychological measurement is additivty satisfied?
rarely, for example, in tests each question does not have equal difficulty
Counting is a __________ but not _____________ condition for measurement
necessary, sufficient