ABCN Deck 7

Question 1

The random errors around the true score have a _____ ______ and have a mean over infinite trials of 0. The standard deviation of the random errors around the true score is termed the ___ ___ __ ___.

Answer 1

normal distribution, standard error of measurement.

Question 2

What calculation provides an estimate of the reliability of a measure?

Answer 2

variance of true scores/variance of the observed scores

Question 3

A “tighter” distribution of variability provides (high or low) reliability.

Answer 3

high

Question 4

In a negative skew, scores tend to cluster at the ____ end of the distribution.

Answer 4

higher

Question 5

In a positive skew, scores tend to cluster at the ____ end of the distribution.

Answer 5

lower

Question 6

_______ is focused on item-level characteristics rather than on the test-level characteristics that classical test theory typically involves.

Answer 6

Item response theory

Question 7

The 3 elements of Baye’s theorem are ___. They produce the ____.

Answer 7

1) prior probability distribution 2) likelihood function 3) available new data; posterior probability.

Question 8

Bayesian methods are used to assess for ____.

Answer 8

noncredible performance.

Question 9

Many measures in ___ and ___ have a positive skew.

Answer 9

motor performance, reaction time

Question 10

the average of the squared difference of each observation in a distribution from the mean.

Answer 10

Variance

Question 11

the standard deviation is the ___ of the ____.

Answer 11

square root, variance.

Question 12

Reliability tells ____.

Answer 12

to what degree individual differences can be attributed to true differences in the attribute being tested, versus chance errors.

Question 13

Reliability ratio?

Answer 13

true variance:total variance

Question 14

Reliability that looks at the stability of scores on repeated administrations of an instrument to the same person.

Answer 14

test-retest

Question 15

reliability that captures both the stability of the test over time and the consistency of responses to different samples of items tapping the same knowledge or performance.

Answer 15

alternate forms

Question 16

reliability that involves splitting the test in many different ways using only a single administration to evaluate internal consistency.

Answer 16

split-half reliability

Question 17

reliability or consistency that involves estimating 2 sources of error: content sampling & heterogeneity of the domain of knowledge/behavior.

Answer 17

inter-item

Question 18

the ___ formula results in the reliability coefficient for internal consistency of a dichotomously scored test and represents the mean of all half-reliabilities resulting from splitting the test.

Answer 18

Kuder-Richardson (KR20)

Question 19

___ is the accuracy with which meaningful and relevant measurements can be made with a test.

Answer 19

Validity

Question 20

___ validity is the degree to which the test covers a representative sample of the knowledge or behavior being studied.

Answer 20

Content

Question 21

___ validity is the degree to which a test measures what it was intended to measure by comparing it to previously validated tests.

Answer 21

concurrent

Question 22

___ validity is the degree to which a test, measurement or protocol successfully measures a psychological theoretical construct or trait.

Answer 22

construct

Question 23

threats to internal validity are related to ___

Answer 23

conclusions drawn from the use of the test.

Question 24

threats to external validity related to ___

Answer 24

limits on generalizability of test results.

Question 25

Threats to internal validity include (3)

Answer 25

history (partially addressed with appropriate norms), testing interval, order of test administration.

Question 26

Threats to external validity (3)

Answer 26

regression to the mean, multiple comparisons (some low scores may be due to chance), situational variables (medication, mood, task engagement)

Question 27

____ validity is demonstrated when two or more approaches to measurement of some trait are positively correlated.

Answer 27

convergent

Question 28

The ____ is a composition of correlation coefficients of 2 or more traits and two or more methods.

Answer 28

multitrait multimethod matrix

Question 29

the ability of a test to correctly identify patients with a disease

Answer 29

sensitivity

Question 30

the ability of a test to correctly identify people without the disease.

Answer 30

Specificity

Question 31

The likelihood ratio of a positive test compares ___ to ___.

Answer 31

true positives to false positives

Question 32

The likelihood ratio of a negative test compares ___ to ___.

Answer 32

false negatives to true negatives

Question 33

Positive likelihood ratio values great than 1 suggest that a positive test result is___.

Answer 33

indicative of the presence of a condition.

Question 34

A negative likelihood ratio between 0 and 1 indicates ___.

Answer 34

few false negatives as compared to true negatives.

Question 35

the probability that a specific individual has a specific condition, given that a test finding was positive, can be calculated using ___.

Answer 35

Baye's theorem.

Question 36

___ validity is the extent to which a test improves the post-test probability with respect to the pre-test probability. It is the positive predictive value of the test minus the baserate of the condition.

Answer 36

incremental

Question 37

If our goal is to identify all persons showing any degree of impairment, we would want to choose a cut-off score that maximizes ___.

Answer 37

sensitivity

Question 38

If you want to minimize false positive errors, such as in effort testing, you would want to choose a cut-off score that maximizes ___.

Answer 38

specificity

Question 39

As the reliability of a test decreases, the estimated true score is brought ___ to the mean and the confidence band ___.

Answer 39

closer, widens.

Question 40

As the reliability of the test increases, the __ and ___ and therefore the confidence intervals both decrease.

Answer 40

SEE and SEM

Question 41

____ ___ informs us of the statistical significance of the difference between two scores.

Answer 41

Reliable difference

Question 42

The __ __ __ establishes the minimum magnitude of change required for psychometric certainty that two scores actually differ.

Answer 42

reliable change index

Question 43

__ refers to whether an intervention produces the expected result under ideal circumstances.

Answer 43

efficacy

Question 44

measures the benefit of an intervention under real word conditions.

Answer 44

effectiveness

Question 45

The ____ reflects the probability that the measured change is reliable; an observed difference between 2 scores from the same examinee on the same test cannot be attributed to measurement error.

Answer 45

reliable change index

Question 46

Calculation of the RCI is___. An RCI falling more than a z-score of ___ reflects a significant difference in test scores.

Answer 46

a z-score for the difference between the individual tests based on the normal probability distribution. 1.96.

Question 47

Reliability change indexes should be statistically adjusted for practice effects using the _____.

Answer 47

mean change score for the reference group.

Question 48

___ is the process of of utilizing a score profile to determine whether an individual belongs to one group or another.

Answer 48

discriminant analysis

Question 49

a _____ is a capacity shared by all healthy members of the species.

Answer 49

species comparison standard

Question 50

___ require the person's level of ability before the onset of known or suspected neurological dysfunction be determined and used to compare current scores against.

Answer 50

individual comparison standards

Question 51

A negative test score on a test with high sensitivity ____ a diagnosis.

Answer 51

rules out a diagnosis

Question 52

a positive result on a test with high specificity ____ a diagnosis.

Answer 52

rules in a diagnosis.

Question 53

the ____ is the estimate of how much a positive test result will change the odds of having the disease.

Answer 53

likelihood ratio positive

Question 54

the ___ is the change in odds of not having a disease when a test results is negative.

Answer 54

likelihood ratio negative

Question 55

LR > 1 indicates a strong likelihood that___.

Answer 55

a disease is present

Question 56

LR < 0.01 indicates that a test result is associated with ____.

Answer 56

the absence of a disease.

Question 57

the ____ is the probability of the patient having the disease with a positive diagnostic test result.

Answer 57

post-test probability

Question 58

As a rule of thumb, a good diagnostic test will increase the post-test odds to above ___ in populations in which the prevalence rate is low.

Answer 58

0.50

Question 59

When a battery includes 36 variables, based on the full NAB, ___% of the healthy normative sample obtained two or more scores below the 5th percentile. __% had five or more scores below the 5th percentile.

Answer 59

48.5, 15

Question 60

Among individuals with FSIQ 90 to 109, __% to ___% of subjects had at least one score below the 5th percentile.

Answer 60

22-38