Ch 5

Question 1

Reliability (what is it)

Answer 1

reliable=doesn’t fluctuate
- true score: the ‘real value’ on a given variable
- measurement error: any deviation from the true score

Question 2

Assessing reliability

Answer 2

• reliability is essential
• we can calculate the person product- moment correlation coefficient on the results of the measure taken from the same people several times

Question 3

types of reliability

Answer 3

test
- retest reliability= the same person gets similar scores on repeated tests
- internal consistency reliability= people’s scores on individual tests are similar to each others
- iterrator reliability=comparing 2 observer’s ratings of behavior

• reliability is not the same as accuracy

Question 4

Construct validity

Answer 4

• my measure ‘true?!’ How well does my operational def and measurement match reality? Does it actually measure what it is intended to measure?

Question 5

Indicators of Construct Validity

Answer 5

-
-
-
-
-
-
-
-
-
-
- content validity
- concurrent validity
- convergent validity
- predictive validity
- discrimination validity
- Face validity

Question 6

Content validity

Answer 6

Content validity evaluates how well an instrument (like a test) covers all relevant parts of the construct it aims to measure.

Question 7

Predictive validity

Answer 7

Predictive validity is the degree to which test scores accurately predict scores on a criterion measure.

Question 8

Concurrent validity

Answer 8

does it predict some current behavior

Question 9

convergent validity

Answer 9

scores on this measure are related to scores on other measures of the same/similar constructs

Question 10

discriminant validity

Answer 10

scores on this measure are not related to scores on a measure of some other construct

Question 11

Reactivity of measures

Answer 11

• reactivity: when measuring a variable changes the thing you’re trying to measure

Question 12

Measurement scales

Answer 12

• normal scales: categorical; no numerical or quantitative properties
• ordinal scales: rank order levels of variable from first to last
• interval scales: 0 does not mean nothing, - exists
• ratio scales: zero means nothing, can’t be -

Question 13

Face validity

Answer 13

does it look like what it’s supposed to look like?

Question 14

content validity

Answer 14

Content validity evaluates how well an instrument (like a test) covers all relevant parts of the construct it aims to measure.

Question 15

Predictive validity

Answer 15

Does it predict some future behavior?

Question 16

concurrent valididty

Answer 16

the degree in which the scores on a measurement are related to other scores on other measurements that have already been established as valid.

Question 17

convergent validity

Answer 17

scores on this measure are related to score measures of the same/similar constructs

Question 18

Cronbach’s alpha

Answer 18

calculate the average of all possible split half reliability coefficients

Question 19

item-total correlations

Answer 19

see how well each specific item correlates with the total score. Items that don’t correlate well with the total score can be eliminated