Chapter 5: Measurement Concepts Flashcards

1
Q

A Likert scale is an example of which type of scale of measurement?

A

Ordinal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q
Which correlation is the strongest?
-.87
\+.86
\+.30
.00
A

-.87

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

The correlation of scores from one test administration with another administration
of the same test at a later date would be an example of which type of reliability?

A

Test-retest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

A test developer creates a new instrument to measure depression. He correlates this with an existing assessment that measures self-esteem. The test developer hopes not to find a high correlation to support the new instrument’s validity. Which type of validity is this?

A

Discriminant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

T/F: In order for a test to be valid, it must be reliable.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a nominal scale?

A

Naming or classifying only

Does not possess magnitude, equal internals or an absolute zero

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an ordinal scale?

A

Order or rank of nominal categories Magnitude only

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an interval scale?

A

Equal distance among ranks or intervals; magnitude, equal intervals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a ratio scale?

A

Possesses magnitude, equal intervals, absolute zero

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the key concepts related to reliability?

A

Measurement error
Correlation
Coefficient of determination

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is reliability?

A

How consistently a test measures a variable

The extent to which it eliminates chance and other extraneous factors in its results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Explain Measurement Error

A

Positive or negative bias within an observed score
True score can never be known
Individual error, test error, testing condition error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the formula to show how error impacts scores?

A

observed score (X)=true score (T) + error score (e)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is correlation?

A

The degree to which two sets of measures are related

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is reliability in regard to correlation?

A

Reliability is the relationship of one score with another actual or hypothetical test and an estimate of the test scores, not the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Does correlation indicate causation?

A

No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the types of reliability?

A

Test-retest
Alternate-forms/parallel-forms
Internal consistency (split-half reliability, interitem consistency)
Interrater

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is test-retest reliability?

A

Same individuals, two administrations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is alternate-forms reliability?

A

Consistency of scores of individuals within the same group on two alternate by equivalent forms of the same test

20
Q

What is internal consistency reliability?

A

Consistency of responses to the different items or parts of a test during a single test and administration

21
Q

What are two common measures of internal consistency?

A

Split-half reliability

Interitem consistency

22
Q

What is interrater reliability?

A

The degree of agreement between two or more independent judges

23
Q

How is interrater reliability calculated?

A

By dividing the number of agreements that an event occurred by the number of possible agreements

24
Q

What is validity?

A

The extent to which meaningful and appropriate inferences can be made

25
Q

What are the two types of invalidity?

A

Construct underrepresentation

Construct irrelevant variance

26
Q

What are the types of validity?

A

Face validity (not evidence of validity)
Content validity
Criterion-related validity (concurrent/predictive)
Construct validity (convergent/discriminant)
Treatment validity

27
Q

What is content validity?

A

Representativeness of items from a “population” of items

28
Q

What is criterion-related validity?

A

Calculated by comparing test scores with performance on a criterion measure.
Can be represented or not by a test score

29
Q

What is concurrent validity?

A

Test scores and criterion performance scores are collected at the same time

30
Q

What is predictive validity?

A

Criterion performance scores of interest are collected at a later time

31
Q

What are the base rates of predictive validity?

A

The proportion of people in a population who represent the particular characteristic or behavior that is being predicted

32
Q

What is incremental validity?

A

The extent to which a particular assessment adds to the accuracy of predictions obtained from other tests or other less extensive methods of assessment

33
Q

What are the predictive validity concepts?

A

False negative- predict falsely
False positive- fail to predict
Sensitivity- the accuracy of a cutoff score in detecting those people who belong in a particular category
Specificity- the accuracy of a cutoff score in excluding those without that condition

34
Q

What is construct validity?

A

Explaining the psychological meaning of the variable (construct) measured by the test- factor analysis

35
Q

What is convergent validity?

A

Test correlates positively and strongly with tools it should

36
Q

What is discriminant validity?

A

Test correlates negatively and strongly with tools it should

37
Q

What are the steps in assessment development?

A
  • Test items are written according to the objectives and purpose of the test
  • Items are then checked for cultural bias and other concerns
  • Items are then piloted
  • Tests of reliability and validity are done
  • A scoring system is developed
  • Norms are established
38
Q

Gender, race, political affiliation, mode in a data distribution, or presence or absence of a diagnostic criterion are examples of what scale?

A

Nominal Scale

39
Q

Degree of job satisfaction, university national rankings, and median values or percentile ranks of a data distribution are examples of what scale?

A

Ordinal Scale

40
Q

Temperature, checklist of behaviors, and standard deviation are examples of what scale?

A

Interval Scale

41
Q

What is the simplest scale?

A

Nominal Scale

42
Q

What is the most advanced and precise measurement scale?

A

Ratio Scale

43
Q

Time and height are examples of what scale?

A

Ratio Scale

44
Q

Can no measurement error exist or possible?

A

No

45
Q

What can be calculated to provide more information about the shared variance between two variables?

A

Coefficient of determination