Chapter 4 Flashcards
Psychometric
Measurement of the properties of the mind (reliability and validity)
Predictor
Any variable used to forecast a criterion
Reliability
Consistency of a measure (measuring device)
Test-retest reliability
Reveals the stability of test scores through repeated applications of the test
Coefficient of stability
Correlation of two sets of scores through evaluation of the same group at two different times
Reliable coefficient of stability
The higher the coefficient, the better
Equivalent-form reliability
Reveals the equivalence of tests scores between two versions of the test
Coefficient of equivalence
Two scores per person though two versions of a test
Internal-consistency reliability
Reveals homogenous (item content is similar) of the items in a test
Split-half reliability
Division of the items into odd and even numbered items and each person receives two scores for each half and then each are correlated; longer tests = greater reliability
Cronbach’s alpha/Kuder-Richardson 20 (KR20)
Mini tests; if the test are homogenous it will have a high internal consistency reliability coefficient; if heterogenous (items covered a wide variety of concepts) it is not internally consistent, coefficient will be low
Inter-rater reliability (conspect reliability)
Reveals the degree of agreement among the assessments of 2+ raters i.e. multiple raters analyzing a job or multiple interviewers evaluating job candidates
Validity
Stability of measurement (accuracy; drawing inferences from tests)
Validation
Empirical process of determining the degree test scores are statistically related to criterion scores
“To validate”
Establish the degree it predicts 1+ criteria
Valid
Accuracy
Continuum of validity
Decision about a tests manifestation of validity to be put into use
Construct
Theoretical concept (abstract ideas) proposed to explain behavior i.e. intelligence, motivation, mechanical comprehension, and leadership
Construct validity
The need for actual measure of proposed construct i.e. paper and pencil test for intelligence; the degree of accuracy of a measure of construct
Convergent validity coefficient
High correlation between scores from new test of intelligence and the existing measures of intelligence; reflect degree the scores
Divergent validity coefficients
Low correlations; reflect the degree which scores diverge from each other in assessing unrelated concepts
Criterion-related validity
Degree which a test forecasts a criterion
Concurrent criterion-related validity
How a predictor can forecast a criterion at the same time i.e. student’s GPA based on test score, give predictor test (if valid = high correlation)
Predictive criterion-related validity
Collection of predictor info and use it for forecasting future criterion-related validity
Validity coefficient
Statistic index (correlation coefficient) that reveals the degree of association between two variables
Content validity
Degree which subject matter experts agree items in a test represent a sample of the knowledge the test claims to measure
Face validity
Appearance that items in a test are appropriate for the intended use of the test by the individuals who take it
Inventory
Assessment method where the responses to questions are recorded and interpreted but not evaluated in terms of correctness