Research Methods Chapter 7

Question 1

Tests that are designed to measure the degree of learning that has taken place after a person has been exposed to a specific learning experience

Answer 1

Achievement Tests

Question 2

Tests that focus on information acquired through the informal learning that goes on in life

Answer 2

Aptitude Tests

Question 3

Gathering and integrating data to make educational evaluations

Answer 3

Assessment

Question 4

A formula that provides an estimate of the reliability of a homogeneous test or an estimate of the reliability of each dimension in a multidimensional test

Answer 4

Coefficient Alpha

Question 5

Validity evidence based on the relationship between test scores and criterion scores obtained at the same time

Answer 5

Concurrent Evidence

Question 6

Degree to which the test works well in practice and does not have negative or abnormal social and psychological consequences

Answer 6

Consequential Validity

Question 7

Validity evidence based on a judgment of the degree to which the items, tasks, or questions on a test adequately represent the construct domain of interest

Answer 7

Content-Related Evidence

Question 8

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct

Answer 8

Convergent Evidence

Question 9

The standard or benchmark that you want to predict accurately on the basis of the test scores

Answer 9

Criterion

Question 10

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance

Answer 10

Criterion-Related Evidence

Question 11

A frequently used name for what Lee Cronbach called “coefficient alpha”

Answer 11

Cronbach’s Alpha

Question 12

Tests that are designed to identify where a student is having difficulty with an academic skill

Answer 12

Diagnostic Tests

Question 13

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs

Answer 13

Discriminant Evidence

Question 14

The consistency of a group of individuals’ scores on alternative forms of a test measuring the same thing

Answer 14

Equivalent-Forms Reliability

Question 15

The difference between true scores and observed scores

Answer 15

Error

Question 16

A statistical procedure that analyzes correlations among test items and tells you the number of factors present. It tells you whether the test is unidimensional or multidimensional

Answer 16

Factor Analysis

Question 17

In test validity, refers to how well the different items in a test measure the same construct or trait

Answer 17

Homogeneity

Question 18

A unidimensional test in which all the items measure a single construct

Answer 18

Homogeneous Test

Question 19

The ability to think abstractly and learn readily from experience

Answer 19

Intelligence

Question 20

The consistency with which the items on a test measure a single construct

Answer 20

Internal Consistency

Question 21

The degree of agreement or consistency between two or more scorers, judges, or raters

Answer 21

Interscorer Reliability

Question 22

A scale of measurement that has equal intervals of distances between adjacent numbers

Answer 22

Interval Scale

Question 23

Evidence that groups that are known to differ on the construct do differ on the test in the hypothesized direction

Answer 23

Known Groups Evidence

Question 24

Assigning symbols or numbers to something according to a specific set of rules

Answer 24

Measurement

Question 25

One of the primary sources of information about published tests

Answer 25

Mental Measurements Yearbook

Question 26

The specific group for which the test publisher or researcher provides evidence for test validity and reliability

Answer 26

Nominal Scale

Question 27

A rank-order scale of measurement

Answer 27

Ordinal Scale