Chapter 4 - Of Tests and Testing

Question 1

Age Norms

Answer 1

Norms that indicate the average performance of different samples of testtakers who were at various ages at the time the test was administered.

Question 2

Classical Test Theory (CTT)

Answer 2

The assumption that a testtaker has a true score on a test that would be obtained but for the action of measurement error.

Question 3

Construct

Answer 3

An informed, scientific concept developed or constructed to describe or explain behavior. We cannot see, hear, or touch them, but we can infer their existence from overt behavior.

Question 4

Content-Referenced Testing and Assessment

Answer 4

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with reference to a set standard.

Question 5

Convenience Sample

Answer 5

A sample that is convenient or available for use, and selected primarily for that reason.

Question 6

Criterion

Answer 6

A standard on which a judgment or decision may be based.

Question 7

Criterion-Referenced Testing and Assessment

Answer 7

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with reference to a set standard.

Question 8

Cumulative Scoring

Answer 8

Cumulative scoring is the idea that the more answers you get correct - or that are consistent with a particular trait - the higher you are presumed to be on a targeted ability or trait. So, for example, the more spelling words you get correct, the more you have mastered the spelling for that week.

Question 9

Developmental Norms

Answer 9

Norms developed on the basis of any trait, ability, skill, or other characteristic that is presumed to develop, deteriorate, or otherwise be affected by chronological age, school grade, or stage of life. Grade and age norms are examples of developmental norms.

Question 10

Domain-Referenced Testing and Assessment

Answer 10

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with reference to a set standard.

Question 11

Domain Sampling

Answer 11

This can refer to either 1) a sample of behaviors from all possible behaviors that could conceivably be indicative of a particular construct, or 2) a sample of test items from all possible items that could conceivably be used to measure a particular construct.

Question 12

Equipercentile Method

Answer 12

A method for determining the equivalency of scores on different tests with reference to corresponding percentile scores.

Question 13

Error Variance

Answer 13

The component of a test score attributable to sources other than the trait or ability measured.

Question 14

Fixed Reference Group Scoring System

Answer 14

A scoring system where the distribution of scores obtained on the test from one group of testtakers - referred to as the fixed reference group - is used as the basis for the calculation of test scores for future administrations of the test.

Question 15

Grade Norms

Answer 15

Norms that are designed to indicate the average test performance of testtakers in a given school grade. They are developed by administering the test to representative samples of children over a range of consecutive grade levels. Then the mean or median score for children at each grade level is calculated.

Question 16

Incidental Sample

Answer 16

A sample that is convenient or available for use, and selected primarily for that reason.

Question 17

Local Norms

Answer 17

Norms that provide normative information with respect to the local population’s performance on some test.

Question 18

National Anchor Norms

Answer 18

An equivalency table for scores on two tests that are supposed to measure the same thing, allowing for relatively stable comparisons between test scores. National anchor norms provide stability to test scores by connecting them to other test scores.

Question 19

National Norms

Answer 19

Norms that are derived from a normative sample that was nationally representative of the population at the time the norming study was conducted.

Question 20

Norm

Answer 20

Test performance data of a particular group of testtakers that are designed for use as a reference when evaluating or interpreting individual test scores.

Question 21

Normative Sample

Answer 21

The group of people whose performance on a particular test is analyzed for reference in evaluating the performance of individual testtakers.

Question 22

Norming

Answer 22

The process of deriving norms. It may be modified to describe a particular type of norm derivation.

Question 23

Norm-Referenced Testing and Assessment

Answer 23

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual testtaker’s score and comparing it to scores of a group of testtakers.

Question 24

Overt Behavior

Answer 24

An observable action or the product of an observable action, including test- or assessment-related responses.

Question 25

Percentage Correct

Answer 25

The distribution of raw scores - more specifically, to the number of items that were answered correctly multiplied by 100 and divided by the total number of items.

Question 26

Percentile

Answer 26

An expression of the percentage of people whose score on a test or measure falls below a particular raw score.

Question 27

Program Norms

Answer 27

“Descriptive statistics based on a group of testtakers in a given period of time rather than norms obtained by formal sampling methods” (Nelson, 1994, p. 283).

Question 28

Purposive Sampling

Answer 28

A sample that is arbitrarily selected because it is believed to be representative of the population.

Question 29

Race Norming

Answer 29

The controversial practice of norming on the basis of racial or ethnic background.

Question 30

Sample

Answer 30

A portion of the universe of people (the intended population) deemed to be representative of the whole population.

Question 31

Sampling

Answer 31

The process of selecting the portion of the universe (the intended population) deemed to be representative of the whole population.

Question 32

Standardization

Answer 32

The process of administering a test to a representative sample of testtakers for the purpose of establishing norms.

Question 33

Standardized Test

Answer 33

Tests that have clearly specified procedures for administration, scoring, and interpretation in addition to norms. They often come with manuals that are as much a part of the test package as the test’s items.

Question 34

State

Answer 34

Something that distinguishes one person from another, but that is relatively less enduring (relative to a trait) (Chaplin et al. 1988).

Question 35

Stratified-Random Sampling

Answer 35

Including people in your sample representing different subgroups, or strata, of the population, all in proportion to the current occurrence of these strata in your intended population, and selecting these people randomly, so that every member of the population had the same chance of being included in the sample.

Question 36

Stratified Sampling

Answer 36

Including people in your sample representing different subgroups, or strata, of the population, all in proportion to the current occurrence of these strata in your intended population.

Question 37

Subgroup Norms

Answer 37

Norms for a portion of a normative sample that was segmented by any of the criteria initially used to select subjects for the sample. For instance, if geographic region was used to select subjects for national norms, subgroup norms would be the norms for people from one of the specific geographic regions that was used.

Question 38

Test Standardization

Answer 38

The process of administering a test to a representative sample of testtakers for the purpose of establishing norms.

Question 39

Trait

Answer 39

“Any distinguishable, relatively enduring way in which one individual varies from another.” (Guilford, 1959, p. 6)

Question 40

True Score Theory

Answer 40

The assumption that a testtaker has a true score on a test that would be obtained but for the action of measurement error.

Question 41

User Norms

Answer 41

“Descriptive statistics based on a group of testtakers in a given period of time rather than norms obtained by formal sampling methods” (Nelson, 1994, p. 283).

Question 42

Age-Equivalent Scores

Answer 42

Norms that indicate the average performance of different samples of testtakers who were at various ages at the time the test was administered.