Norms, Correlation, and Inference

Question 1

Also referred to as age-equivalent norms; norms specifically designed for use as a reference in the context of the age of the test taker who achieved a particular score; contrast with grade norms

Answer 1

Age norms

Question 2

Symbolized by r, an index of the strength of the linear relationship between two continuous variables expressed as a number that can range from -1 to +1. Although different statistics may be used to calculate this, the most frequently used is the Pearson r

Answer 2

Coefficient of correlation

Question 3

A value indicating how much variance is shared by two variables being calculated. This value is obtained by squaring the obtained correlation coefficient, multiplying by 100, and expressing the result as a percentage; the percentage indicates the amount of variance accounted for by the correlation coefficient

Answer 3

Coefficient of determination

Question 4

An expression of the degree and direction of correspondence between two things, when each thing is continuous in nature

Answer 4

Correlation

Question 5

Also referred to as domain-referenced testing and assessment and content-referenced testing and assessment, a method of evaluation and a way of deriving meaning from test scores by evaluating an individual’s score with reference to a set standard (or criterion); contrast with norm-referenced testing and assessment

Answer 5

Criterion-referenced testing and assessment

Question 6

A reference point, usually numerical, derived as a result of judgment, used to divide a set of data into two or more classifications, with some action to be taken or some inference to be made on the basis of these classifications

Answer 6

Cut score or cutoff

Question 7

A system of scoring wherein the distribution of scores obtained on the test from one group of test takers (the fixed reference group) is used as the basis for the calculation of test scores for future administrations; the SAT and the GRE are scored this way

Answer 7

Fixed reference group scoring system

Question 8

Norms specifically designed as a reference in the context of the grade of the testtaker who achieved a particular score; contrast with age norms

Answer 8

Grade norms

Question 9

Also referred to as convenience sampling, the process of arbitrarily selecting some people to be part of a sample because they are readily available, not because they are most representative of the population being studied

Answer 9

Incidental sampling

Question 10

Normative information about some limited population, frequently of specific interest to the test user

Answer 10

Local norms

Question 11

A research tool and the result of combining statistical information across various studies

Answer 11

Meta-analysis

Question 12

The analysis of relationships between more than one independent variable and one dependent variable to understand how each independent variable predicts the dependent variable

Answer 12

Multiple regression

Question 13

An equivalency table for scores on two nationally standardized tests designed to measure the same thing

Answer 13

National anchor norms

Question 14

Norms derived from a standardization sample that was nationally representative of the population

Answer 14

National norms

Question 15

Also referred to as a norm group, a group of people presumed to be representative of the universe of people who may take a particular test, whose performance data on a particular test may be used as a reference source or context for evaluating individual test scores

Answer 15

Normative sample

Question 16

The process of deriving or creating norms

Answer 16

Norming

Question 17

A method of evaluation and a way of deriving meaning from test scores by evaluating an individual test taker’s score and comparing it to scores of a group of test takers; test scores are understood relative to other test scores on the same test; contrast with criterion-referenced interpretation

Answer 17

Norm-referenced testing and assessment

Question 18

(1) An extremely atypical plot point in a scatterplot; (2) any extremely atypical finding in research

Answer 18

Outlier

Question 19

A widely used statistic for obtaining an index of the relationship between two variables when the relationship between the variables is linear and when the two variables correlated are continuous (that is, theoretically can take any value)

Answer 19

Pearson r, or Pearson coefficient of product-moment correlation and the Pearson correlation coefficient

Question 20

An expression of the percentage of people whose score on a test or measure falls below a particular raw score; a converted score that refers to a percentage of test takers; contrast with percentage correct

Answer 20

Percentile

Question 21

The raw data from a test’s standardization sample converted to percentile form

Answer 21

Percentile norms

Question 22

The arbitrary selection of people to be part of a sample because they are thought to be representative of the population being studied

Answer 22

Purposive sampling

Question 23

The controversial practice of norming on the basis of race or ethnic background

Answer 23

Race norming

Question 24

A straightforward, unmodified accounting of performance, usually numerical and typically used for evaluation or diagnosis

Answer 24

Raw score

Question 25

The analysis of relationships among variables to understand how one variable may predict another

Answer 25

Regression

Question 26

A group of people presumed to be representative of the total population or universe of people being studied or tested

Answer 26

Sample

Question 27

A graphic description of correlation achieved by graphing the coordinate points for the two variables

Answer 27

Scatterplot or scatter diagram

Question 28

The analysis of the relationship between one independent variable and one dependent variable

Answer 28

Simple regression

Question 29

This index of correlation may be the statistic of choice when the sample size is small and both sets of measurements are ordinal

Answer 29

Spearman’s rho or rank-order correlation coefficient and the rank-difference correlation coefficient

Question 30

In regression, an estimate of the magnitude of error; the lower the degree of correlation, the higher the standard error of the estimate

Answer 30

Standard error of the estimate

Question 31

A process of test development wherein the test is administered to a representative sample of test takers under clearly specified conditions and the data are scored and interpreted, to establish a context for future test administrations with other testtakers

Answer 31

Standardization

Question 32

The process of developing a sample based on specific subgroups of a population in which every member has the same chance of being included in the sample

Answer 32

Stratified-random sampling

Question 33

The process of developing a sample based on specific subgroups of a population

Answer 33

Stratified sampling

Question 34

Norms for any defined group within a larger group

Answer 34

Subgroup norms

Question 35

Also referred to as program norms, descriptive statistics based on a group of test takers in a given period of time rather than on norms obtained by formal sampling methods

Answer 35

User norms