Chapter 5: Test Worthiness

Question 1

Correlation of determination

Answer 1

=shared variance

• statement about factors that underlie variables that account for their relationship
• -how much of the variability in one variable can be explained by variation in another

Question 2

validity

Answer 2

degree to which all evidence supports intended interpretation of test scores for intended purpose
–does it measure what it’s supposed to measure

Question 3

content validity

Answer 3

is the content valid for the kind of test it is

Question 4

four step process of developing content validity

Answer 4

1. survey domain
2. content matches domain
3. specific items match content
4. analyze relative importance of each objective

Question 5

criterion related validity

Answer 5

relationship between test and criterion that the test should be related to
–two types: concurrent validity and predictive validity

Question 6

concurrent validity

Answer 6

does instrument relate to another criterion NOW

Question 7

predictive validity

Answer 7

does instrument relate to another criterion in future

Question 8

concepts related to predictive vaidity

Answer 8

• -standard error of the estimate: using known value of one variable to predict scores on a second variable
• -false positive: predicts an attribute that doesn’t exist
• -false negative: instrument forecasts no attribute when it does exist

Question 9

construct validity

Answer 9

extent to which instrument measures a theoretical or hypothetical trait
–**clearly define trait or concept you are measuring

Question 10

four methods of establishing construct validity

Answer 10

experimental design, factor analysis, convergence w/ other instruments, discrimination with other measures

Question 11

experimental design

Answer 11

creating hypothesis and research studies that show instrument captures correct episode
-or meta analysis

Question 12

factor analysis

Answer 12

demonstrates statistical relationship between sub scales

-how similar or different are sub scales?

Question 13

convergence

Answer 13

comparing test scores to other, well established tests

Question 14

divergence

Answer 14

correlate test scores with other tests that are different

you want a meager correlation

Question 15

reliability

Answer 15

accuracy/consistency of test scores

Question 16

3 types of reliability

Answer 16

test-retest, alternate/parallel/equivalent, internal consistency (split half or odd even, coefficient alpha, kuder richardson)

Question 17

test retest

Answer 17

give test twice to same groups of people (problems: learning, familiarity with test)

Question 18

alternate, parallel, equivalent forms

Answer 18

two forms of same test

• correlate scores on first with scores on second
• -BUT: are two forms ever really equivalent

Question 19

internal consistency reliability

Answer 19

how do individual items relate to each other and test as whole

• reliability within test rather than multiple admins
• 3 ways to establish: split half/ odd even, chronbachs alpha and ruder richardson internal consistency

Question 20

item response theory

Answer 20

extension of classical test theory (looks at amount of error in total test)
-IRT: probability individuals will answer each item correctly/match quality being assessed

Question 21

Griggs vs. Duke Power Co

Answer 21

tests for hiring and advancement must show ability to predict job performance

Question 22

ADA

Answer 22

accommodations for individuals taking tests for employment must be made

Question 23

Carl Perkins

Answer 23

individuals with disability have right to vocational assessment, counseling, and placement

Question 24

IDEA

Answer 24

assures rights of students suspected of having a learning disability to be tested at school’s expense

Question 25

civil rights act

Answer 25

series of laws concerned w tests used in employment and promotion

Question 26

section 504 and rehabilitation act

Answer 26

relative to assessment--any instrument used to measure appropriateness for program or service must measure ability, not be a reflection of disability

Question 27

practicality

Answer 27

time, cost, format, readability, ease of admin, scoring, interpretation

Question 28

steps to selecting and administering tests

Answer 28

1. determine client's goals 2. choose instruments relevant to goals 3. research 4. examine test worthiness 5. choose!