Assessment week 4

Question 1

What measurement is the amount of error in any given score?

Answer 1

Standard error of measurement (SEM)

Question 2

True or false: the lower the reliability of the measure, the higher the standard error of measurement (SEM)

Answer 2

True: the reliability of a measure has an inverse relationship with the standard error of measurement (SEM)

Question 3

True or false: larger SEMs have smaller confidence intervals

Answer 3

False: larger SEMs have bigger confidence intervals

Question 4

True or false: the more confident you are, the larger the interval (range)

Answer 4

True: The larger the standard deviation, the larger the confidence interval, and the more confident you are
* So, 95% (2 SD) CI will be larger than 68% CI (1 SD)

Question 5

What measurement allows us to determine if there is a significant difference between two scores on two different domains?

Answer 5

The standard error of difference (SEdiff)

Question 6

What term conveys the consistency of a measure?

Answer 6

Reliability

Question 7

What term conveys how well a measure assesses what it claims?

Answer 7

Validity

Question 8

What type of validity refers to the degree to which evidence and theory support
interpretation of test scores entailed by proposed uses of a test?

Answer 8

Construct validity

Question 9

What type of validity refers to whether the measure contains appropriate items for the construct?

Answer 9

Content validity

Question 10

What type of validity analyzes the interrelationships of items?

Answer 10

Internal structure

Question 11

What type of validity is used to create composite scores?

Answer 11

Internal structure

Question 12

What type of construct validity tests that constructs that are expected to be related are, in fact, related?

Answer 12

Convergent validity.
example: the scores of a self-esteem test and an extraversion test are likely to be correlated—individuals scoring high in self-esteem are more likely to score high in extroversion. These two tests would then have high convergent validity.

Question 13

What type of construct validity tests that constructs that should have no relationship do, in fact, not have any relationship?

Answer 13

Discriminant/divergent validity
Example: if discriminant validity is high, scores on a test designed to assess aggressiveness should not be positively correlated with scores from tests designed to assess intelligence.

Question 14

What is a typical range for a validity coefficient?

Answer 14

0.30-0.40

Question 15

What type of validity measures how well one measure predicts an outcome for another measure?

Answer 15

Criterion-related validity

Question 16

What type of criterion-related validity has a lag between when the measures are given and thus measures if a test accurately predicts what it is supposed to predict?

Answer 16

Predictive validity

Question 17

What type of criterion-related validity is when both measures are given at the same time?

Answer 17

Concurrent validity

Question 18

What measure indicates how confident we are in predicting future performance?

Answer 18

Standard error of the estimate (SEest)
example: predicting college freshman grades based on ACT/SAT scores

Question 19

What quantity indicates how far an individual falls from the average?

Answer 19

Standard deviation (SD)
example: how far above or below the mean a score falls?

Question 20

What is a measure of how confident we are in a person’s score on a given measure at that moment?

Answer 20

Standard error of measurement (SEM)
example: if the person took the same test again, within what range would we estimate the score would be the second time?

Question 21

What measurement determines how well you identify individuals with the issue you are assessing?

Answer 21

Sensitivity

Question 22

What measurement determines how well you do NOT identify individuals that don’t have the issue you are assessing?

Answer 22

Specificity

Question 23

True or false: Specificity is the ability to identify true positives

Answer 23

False: specificity is the ability to identify true negatives

Question 24

True or false: sensitivity is the ability to identify true negatives

Answer 24

False: sensitivity is the ability to identify true positives

Question 25

What type of validity can determine whether a measure gives you information you would not get from a different measure?

Answer 25

Incremental validity

Question 26

What validity-threatening response set is the tendency of survey respondents to answer questions in a manner that will be viewed favorably by others?

Answer 26

Social desirability response set/bias

Question 27

What validity-threatening response set is the tendency of survey respondents to select a positive response option disproportionately more frequently?

Answer 27

Acquiescence response set/bias

Question 28

What validity-threatening response set is the tendency of survey respondents to answer questions in a manner that will be viewed unfavorably by others, or that departs from norms?

Answer 28

Deviant response set/bias