Research Methods Chapter 7 Flashcards
Tests that are designed to measure the degree of learning that has taken place after a person has been exposed to a specific learning experience
Achievement Tests
Tests that focus on information acquired through the informal learning that goes on in life
Aptitude Tests
Gathering and integrating data to make educational evaluations
Assessment
A formula that provides an estimate of the reliability of a homogeneous test or an estimate of the reliability of each dimension in a multidimensional test
Coefficient Alpha
Validity evidence based on the relationship between test scores and criterion scores obtained at the same time
Concurrent Evidence
Degree to which the test works well in practice and does not have negative or abnormal social and psychological consequences
Consequential Validity
Validity evidence based on a judgment of the degree to which the items, tasks, or questions on a test adequately represent the construct domain of interest
Content-Related Evidence
Validity evidence based on the relationship between the focal test scores and independent measures of the same construct
Convergent Evidence
The standard or benchmark that you want to predict accurately on the basis of the test scores
Criterion
Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance
Criterion-Related Evidence
A frequently used name for what Lee Cronbach called “coefficient alpha”
Cronbach’s Alpha
Tests that are designed to identify where a student is having difficulty with an academic skill
Diagnostic Tests
Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs
Discriminant Evidence
The consistency of a group of individuals’ scores on alternative forms of a test measuring the same thing
Equivalent-Forms Reliability
The difference between true scores and observed scores
Error
A statistical procedure that analyzes correlations among test items and tells you the number of factors present. It tells you whether the test is unidimensional or multidimensional
Factor Analysis
In test validity, refers to how well the different items in a test measure the same construct or trait
Homogeneity
A unidimensional test in which all the items measure a single construct
Homogeneous Test
The ability to think abstractly and learn readily from experience
Intelligence
The consistency with which the items on a test measure a single construct
Internal Consistency
The degree of agreement or consistency between two or more scorers, judges, or raters
Interscorer Reliability
A scale of measurement that has equal intervals of distances between adjacent numbers
Interval Scale
Evidence that groups that are known to differ on the construct do differ on the test in the hypothesized direction
Known Groups Evidence
Assigning symbols or numbers to something according to a specific set of rules
Measurement
One of the primary sources of information about published tests
Mental Measurements Yearbook
The specific group for which the test publisher or researcher provides evidence for test validity and reliability
Nominal Scale
A rank-order scale of measurement
Ordinal Scale