Psych Assessment Flashcards
assumption 1
psychological traits and state exists
assumption 2
psychological traits and states can be quantified and measure
is any distinguishable, relatively enduring way in which one individual varies from one another
trait
distinguishes one person from another but relatively less enduring
state
assumption 3
test behavior predicts non-test behavior
assumption 4
test and other measurements have strengths and weaknesses
assumption 5
sources of error are part of the assessment process
long standing assumption that factors other than what a test attempts to measure will influence performance on the test
error
refers to the component of test score attributable to sources other than the trait or ability measured
error variance
assumption 6
testing and assessment can be done in a fair and unbiased way
assumption 7
testing and assessment can benefit society
is the stability or consistency of the measurement
reliability
includes the notion that each individual measurement has an element of error such as observer’s error, environmental changes, participant’s changes, etc
reliability
- index of reliability
- a proportion that indicates the ratio between the true score variance on a test and the total
variance
reliability coefficient
defined as one on which test takers will fall in the same positions relative to each other
reliable test
Stable charcteristics of the individual
true characteristics
Chance features of the individual or the situation
random measurement of error
tools used to estimate or infer the extent to which an observed score deviates from a true score
standard error of estimates
used to evaluate the error associated with administering a test at two different times.
test-retest
- When interval between testing is greater than six months
- the estimate of test-retest reliability. obtained using pearson-r
coefficient of stability
compares two equivalent forms of a test that measure the same attribute
parallel/alternate forms
• a test is given some and divided into halves that are scored separately.
• The results of one half of the test are then compared with the results of the other.
• Use the odd-even system, whereby one subscore is obtained for the odd-number items in the test and another for the even -numbered items.
split-half method
- Refers to the degree of correlation among all the items on a scale.
- Useful in assessing the homogeneity of the test
inter-item consistency
Methods used to obtain estimates of internal consistency:
- KR 20
- Cronbach alpha
a formula that estimates the internal consistency of test in which the items are non-dichotomous or there is no right or wrong answer
cronbach alpha
• The degree of agreement or consistency between two or more scorers (or judges or raters) with regard to a particular measure.
• There is a judge to rate the examine answers
• For creativity or projective test
inter-scorer reliability
- is a judgment or estimate of how well a test measures what it purports to measure in a particular context.
- it is a judgment based on evidence about the appropriateness of inferences drawn from test scores.
validity
is the process of gathering and evaluating evidence about validity
validation
validation process if test users plans to alter format, instruction, language, or content of the test
local validation
• When the items look like they measure what they are supposed to measure.
• The judgement about the items appropriateness is made by the test taker rather than expert in the domain.
face validity
• It is important whenever a test is used to make inferences about the broader domain of knowledge and or skills represented by a sample of items.
• Is important in maximal performance test and typical performance test
content validity
Qualitative process in which test items are compared to a detailed description of the test domain.
content validity
• Is the ability of a test to predict performance on another measure.
• The test is referred to as the “predictor” labeled X and the validation measure as the criterion labeled Y.
criterion validity
is a judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest - the measure of interest being the criterion.
criterion-related validity
is an index of the degree to which a test score predicts some criterion measure.
predictive validity
is an index of the degree to which a test score is related to some criterion measure obtained at the same time
concurrent validity
Whether a test measures what it is intended to measure. Referred to as personality dimensions of personality traits
construct validity
measure correlating the same construct
congruent validity
a validity coefficient sharing little or no relationship between two tests measuring unrelated constructs
discriminant or divergent validity
is an informed, scientific idea developed or hypothesized to describe or explain behavior
construct
Statistical bias (intercept bias, slope bias)
test bias
Is a judgement resulting from the intentional or unintentional misuse of rating scale
rating error
error in rating that arises from the tendency on the part of the rater to be lenient in scoring
leniency error
systematic reluctance to giving ratings at either positive or negative
central tendency error
tendency to give a particular ratee a higher rating than he or she objectively deserves because the rater’s failure to discriminate among conceptually distinct aspects of a ratee’s behavior
halo effect
The extent to which a test is used in an impartial, just and equitable way
fairness
• Refers to a group of statistics that can be calculated for individual test items.
• It helps in explaining why a test shows a certain level of reliability and validity.
• Particularly useful when test is unrealible or fail to demonstrate relationship with criterion measures.
item analysis
2 Commonly used technique of Item analysis:
- Item Difficulty
- Item Discrimination
• appropriate for maximal performance test- achievement and aptitude test.
• Requires that test items be scored as correct and incorrect.
item difficulty
percentage of the pupils who got the item right. It can also be interpreted as how easy or how difficult an item is
Difficulty Index / Item difficulty index
Operationally define as difficult item as one that few people answer correctly
item difficulty analysis
- appropriate for almost any type of test.
- Indicates the extent to which different types of people answer an item in different ways.
item discrimination
- separates the bright from the poor ones. Thus, a good test item separates the bright from the poor pupils.
- Measures of Item Discrimination
discrimination index
two approaches of discrimination index:
- Item-discrimination index
- Item-total Correlation
is the proportion obtained by comparing the performance of two subgroups of test-takers
extreme group method
Multifaceted capacity that manifest itself in different ways across all life span
intelligence
• Intelligence is inherited
• Believed that the most intelligent persons were those equipped with the best sensory abilities
• Abilities used in mental processes cannot be seperated because they interact together
Francis Galton
The degree of availability of one’s experiences for the solution of his present problems and the anticipation of future ones.
Henry Goddard
• Development of cognition in children
• Intelligent may be conceived of as a kind of evolving biological adaptation to the outside world.
jean piaget
refer to organized action or mental structure that when applied to the world leads to knowing or understanding
schema/schemata
Defined intelligence as the aggregate of global capacity of the individual to act purposefully, to think rationally and to deal effevtively with his environment.
david wechsler
• Believed that the intelligence quotient or IQ meant to quantify intellectual functioning to allow comparison among individuals
• IQ= mental age / chronological age x 100
lewis terman
Model of general mental ability or Two-factor-theory of intelligence
charles spearman
required for performance of mental test of all kinds; he called this kind of “mental energy” that underlies the specific factors
general ability
required for performance on just one kind of mental test
special abilities
• Identified seven (7) primary mental abilities:
- Verbal comprehension
- Word fluency
- Number
- Space
- Associative memory
- Perceptual Speed
- Induction or General Reasoning
louis leon thurstone
Believed that g’s has two related but distinct components: fluid intelligence & crystallized intelligence
raymond cattell
The ability to see relationships as in analogies and letter and number series. Also believed as the primary reasoning ability. This decreases as one ages
fluid intelligence
Acquired knowledge and skills or also know as Factual Knowledge. This increases
with age.
crystallized intelligence
- Proposed additional factors to Cattell’s types:
• Visual processing (Gv)
• Auditory processing (Ga)
• Quantitative processing (Gq)
• Speed processing (Gs)
• Reading and writing (Grw)
• Short-term memory (Gsm)
• Long term storage and retrieval (GIr) - Vulnerable abilities
- Maintained abilities
John L. Horn
Propose the THREE STRATUM THEORY
John B. Carrol
as “g”
third stratum
composed of 8 abilities and processes
second stratum
level/speed factor each different depending on the second stratum to which they are linked
first stratum
- proposed by Kevin McGrew
- Exclusion of G since it has little relevance to cross battery assessment and interpretation
- There is a higher order general factor and 9 broad stratum abilities and over 70 narrow abilities.
CHC model (catell-horn-carroll)
Integration of the two models
broad stratum
Proposed that intelligence comprise of 180 elementary abilities and these 180 elementary abilities are made up of combination of three dimension
joy paul guilford
what the person does
operation
the material on which operations are performed
content
the form in which the information is stored and processed
product