ASSUMPTIONS ABOUT PSYCHOLOGICAL TESTING AND ASSESSMENT Flashcards
ASSUMPTIONS ABOUT PSYCHOLOGICAL TESTING
AND ASSESSMENT
Psychological Traits and States Exist
Psychological Traits and States
Can Be Quantified and Measured
Test-Related Behavior Predicts Non-Test-Related Behavior
Tests and Other Measurement Techniques Have
Strengths and Weaknesses
Sources of Error Are Part
of the Assessment Process
Testing and Assessment Can Be Conducted
in a Fair and Unbiased Manner
Testing and Assessment Benefit Society
Assumption 1: Psychological Traits and States Exist
…
any distinguishable, relatively enduring way in which one
individual varies from another
based on
observing a sample of behavior
trait
distinguish one person from
another but are relatively less enduring
States
psychological traits that relate to
intelligence, specific intellectual abilities, cognitive style, adjustment, interests, attitudes,sexual orientation and preferences, psychopathology, personality in general, and specific
personality traits.
psychological trait exists only as a ….
construct
an informed, scientific concept
developed or constructed to describe or explain behavior.
construct
an observable action or the product of an observable action, including test- or assessment-related
responses.
overt behavior
a reminder that a trait is not
expected to be manifested in behavior 100% of the time
relatively enduring
a way in which one individual varies from another.
trait and state
Assumption 2: Psychological Traits
and States Can Be Quantified and Measured
…
test score is presumed to represent the strength
of the targeted ability or trait or state and is frequently based on
assumption that the more the testtaker responds in a particular
direction as keyed by the test manual as correct or consistent with a particular trait, the higher
that testtaker is presumed to be on the targeted ability or trait
cumulative scoring
word domain is substituted for world in this context.
refer to either (1) a sample of behaviors
from all possible behaviors that could conceivably be indicative of a particular construct or
(2) a sample of test
items from all possible items that could conceivably be used to measure a particular construct.
domain sampling
Assumption 3: Test-Related Behavior
Predicts Non-Test-Related Behavior
objective of the
test is to provide some indication of other aspects of the examinee’s behavior
psychological tests may be
used not to predict behavior but to
postdict
to aid in
the understanding of behavior that has already taken place.
behavior samples may
shed light, under certain
circumstances, on someone’s state of mind in the past.
tools of assessment great value in such an evaluation.
case history data or the defendant’s personal
diary during the period in question
Assumption 4: Tests and Other Measurement
Techniques Have Strengths and Weaknesses
…
Competent test users understand a great deal about the tests they use.
how a test was developed, the circumstances under which it is appropriate to
administer the test, how the test should be administered and to whom, and how the test results
should be interpreted.
understand and appreciate the limitations
how those limitations might be compensated for by data from other sources.
how those limitations might be compensated for by data from other sources.
test users know the tests they use and are aware of the tests’ limitations
Assumption 5: Various Sources of Error
Are Part of the Assessment Proces
…
a long-standing assumption that factors other than what a test
attempts to measure will influence performance on the test.
error
the component of a test score attributable
to sources other than the trait or ability measured.
error variance
measurement professionals tend to view error as simply an element in the process of measurement, one for which any theory of measurement must surely account.
classical test theory
also variously referred to as true score theory
the
assumption is made that each testtaker has a true score on a test that would be obtained but
for the action of measurement error.
true score theory
Alternatives to CTT
IRT
item response theory
Assumption 6: Testing and Assessment Can
Be Conducted in a Fair and Unbiased Manner
….
one source of
fairness-related problems is…
test user who attempts to use a particular test with people
whose background and experience are different from the background and experience of people
for whom the test was intended.
test fairness are more
political than psychometric
it is important to keep in mind
that tests are tools. And just like other, more familiar tools (hammers, and
so on), they can be used properly or improperly.
Assumption 7: Testing and Assessment Benefit Society
….
Considering the many critical decisions that are based on testing and assessment procedures,
we can readily appreciate the
the need for tests, especially good tests. And raises
one critically important question