Ch. 8 - Assessment and Testing Flashcards
Appraisal:
- Process of assessing or estimating attributes
- Broad term-could use various methods
Difficulty index
- indicates % of individuals who answered each question correctly
Forced choice
- AKA recognition items
- can control for desirability phenomenon
Normative test
- Participant can legitimately be compared to others who have taken the test
Ipsative test
- Can’t legit compare to others who have taken the test
- does not reveal absolute strengths
- within-person analysis
Power test
- time is not an issue
Achievement test
- measures maximum performance or present level of skill
Personality test/interest inventory
- measures typical performance
Cyclical test
- several sections which are spiral in nature
- gets more difficult with each section
Test battery
- horizontal test
- several measures are used to produce results that could be more accurate than from a single source
Vertical test
- versions for various age brackets or levels of education
Horizontal test
- measures various factors during same testing procedure
Validity
- more important than reliability
- # 1 factor in construction of a test
- a test must measure what it says it will measure
Reliability
- need to give repeated readings which are nearly identical for the same person every single time or across participants (inter-rater reliability)
5 types of validity
1 - construct validity: test’s ability to measure a theoretical construct like intelligence, self-esteem, etc.
2 - concurrent valididty: how well the test compares to other tests measuring the same thing
3 - content valididty: does the test examine or sample under scrutiny? How well it covers all relevant parts of the construct it aims to measure
4 - predictive validity: empirical validity - reflects the test’s ability to predict future behavior according to established criteria
5 - consequential valididty - tries to ascertain the social implications of using the test
A test can be _ but not _
reliable; valid
Reliability measurement
i.e., .70 reliability = 70% of score is accurate and 30% inaccurate
True variance =
- correlation squared
- reliability coefficient AKA coefficient of determination
Francis Galton
- felt intelligence was a unitary faculty
- concluded intelligence was normally distributed
Guilford
- isolated 120 factors which added up to intelligence
- known for thoughts on convergent and divergent thinking
Kuder-Richardson
- coefficents of equivalence
- measure internal consistency reliability
- KR-20 or KR-21 formulas
Cross validation coefficent
- is smaller than initial validity coefficent
- known as shrinkage
- helps guard against error factors, which are likely present with small sample sizes
1st intelligence test created by
- Alfred Binet & Theodore Simon
- is now a standardized measure
Convergent thinking
- when divergent thoughts/ideas are combined into a singular concept
Divergent thinking
- the ability to generate a novel idea
Formula for Ratio IQ
MA/CA x 100
- test was created to discriminate children w/o an intellectual disability from children w/ an intellectual disability
- formula has been replaced by standard age score
Entropy =
- dysfunctional families are either too open or too closed
- a healthy family is in a state of negative entropy
IQ tests (SAS)
WPPSI - children 2.5-7
WAIS-IV - 16-90
WISC-IV - 6-16
WAIS-IV
- 16-90
- Cattell-Horn-Carroll neurocognitive research
- online exam 60-90 minutes
- object assembly and picture arrangement dropped
- 10 subjects, 4 index scores
- 100 is mean with SD of 15
Arthur Jensen
- known for 1969 article about black vs white IQ controversy
John Ertl
- claimed he invented an electronic machine to analyze neural efficiency and take place of paper/pencil IQ test
Raymond Cattell
- responsible for the fluid and crystallized intelligence
- known for 16 personality factor questionnaire
Crystallized intelligence
- measured by tests that focus on content
Fluid intelligence
- tested by what has been called “content-free reasoning” such as a block design or a pictorial analogy problem
Robert Williams
- created the Black Intelligence Test of Cultural Homogeneity (BITCH)
Factor-analytic tests
- Analyze data outside a given theory
- knwon as inventory, not theory-based tests
Myers-Briggs based on
Jung
Aptitude =
Achievement =
Potential
What has been learned
Thematic Apperception Test (TAT
- 31 cards with ambiguous pictures
- make up a story for each
The Rorschach is similar with 10 inkblot cards
Bender Gestalt Test
- expressive projective measure
- determines if brain damage is evident
- copy 16 geometric figures
Interest inventories
- best for high schoolers
- reliable, not threatening to test-taker
AARC =
- association for assessment and research in counseling
Increasing a test’s length…
- increases reliability
- shortening the length, decreases reliability
Word association test
- is a projective test
Item difficulty
0 - 1.0
The higher the item difficulty is set at, the easier the questions are to answer (.75 will be easier than .25 item difficulty)
