Basic Assumptions About Psychological Testing and Assessment Flashcards
What is Assumption 1?
Psychological Traits and States Exists
Distinguishable, relatively enduring way in which an individual differs from another
Trait
Distinguishes a person from another but is less enduring
State
Based on observing a sample of Behavior
Trait and the magnitude of the trait
ways to observe/measure
- Direct Observation
- Analysis of Self-Report Statements
- Pencil-or-Paper Tests
Psychological Traits:
- Intelligence
- Specific Intellectual Abilities
- Cognitive Style
- Adjustment
- Specific Personality Traits
Some people deny that traits exist and there is
a controversy how they exist
true
informed, scientific concept developed or constructed to describe or explain behavior
Construct
What is Assumption 2?
Psychological Traits and States can be Quantified and Measured
Develop items that provides _____ to the trait
insight
Develop appropriate test items and appropriate way to _____ the items
score
method of scoring whereby points or scores accumulated on individual items or subtests are tallied, and the higher the total sum, the higher the individual is presumed to be on the ability, trait, or other characteristic being measured
Cumulative Scoring
What is Assumption 3
Test-Related Behavior Predicts Non-Test-Related Behavior
tasks in some tests _____the actual behaviors that the test user is attempting to understand
mimic
tests yield only a sample of the behavior that can be expected to be emitted under contest conditions –
Predict or postdict
To estimate or suppose something which took place in past; to conjecture something that occurred beforehand.
Postdict
say or estimate that (a specified thing) will happen in the future or will be a consequence of something
predict
What is Assumption 4?
Tests and Other Measurement Technique Have Strengths and Weaknesses
strength and weakness can be based on:
- how a test was developed
- the circumstances under which it is appropriate to administer the test
- how the test should be administered
- to whom
- how the test results should be interpreted
- limitation
What is Assumption 5?
Various Sources of Error are Part of the Assessment Process
mistake, miscalculation, etc. – In assessment: more that what is expected
Error
the component of a test score attributable to sources other than the trait or ability measured
Error Variance
What is Assumption 6?
Testing and Assessment Can be Conducted in a Fair & Unbiased Manner Assumption
What is Assumption 7?
Testing and Assessment Benefit Society
The raw score (X) obtained by any individual is made up of a true component/true score (T) and a random error (E) component
Classical Test Theory
Formula for Classical Test Theory
X = T + A
Assumes that the items selected for any one test are just sample of items from an infinite domain of potential items
Domain Sampling Theory
Domain sampling is the most common CTT used for…
practical purposes
Concerns of CTTs is to __ with random error of the raw score
cope
The less random error in the measure, the more the raw score reflects the…
true score
Assumptions of the Theory of True & Error Scores
– The raw score is made up of the true score plus random error (𝑋 = 𝑇 + 𝐸); the average of raw scores is the best estimate of the true score
– Random errors around the true score would be normally distributed; the expected value of error = 0
– Random errors are uncorrelated
– Random errors are uncorrelated to the T
is consistent across an entire population
SEM
As the test become longer, it becomes increasingly…
reliable
The important statistics about test items (i.e. difficulty) is dependent on the sample of respondents being representative of the population
true
Scores in the population are assumed to be
– A) measured at the interval level
– B) normally distributed
– When these are not met, Test Developers convert scores, combine scales, and others to ensure the assumption is met
When item responses change, the properties of a test does not change
false
Developed to address the shortcomings and limitations of the CTT
Item Response Theory (IRT)
Who developed IRT
Lord and Novik (1968)
CTT focus is on the pattern of responses the respondent makes to the set of items
no, this is IRT
In IRT, it does not assume that all items are parallel
true
CTT focus is on the single score that one obtains on the test
true
In IRT, all items are treaterd as though they are parallel
false, this is CTT
_______ there is a linkage between a response to any item on a test and the characteristic being assessed by the test.
Fundamental assumption:
Characteristic is a latent trait
true
Linkage is the probability of a negative response to any single item on a test is a function of the individual’s level
false, it is postive response
Critical feature that is analyzed in IRT is the entire pattern of item responses to all test items by an individual.
true
If IRT: Pattern of Item Responses; then CTT:___
Raw Scores of the Test
IRT: _____
Assessment of Measurement Error at any level of
CTT:
Measurement Error is the same at every level of the test score
