Chapter 5: Measuring Concepts Flashcards
When is a measure reliable?
When it’s consistent and precise, it doesn’t fluctuate much
Any measurement is comprised of what 2 things?
True Score
Measurement error
What is a True Score? What is a Measurement error?
True score- the score on the variable being tested or measured if there was no error
Measurement error- Anything else that affects the true score
Would an unreliable measure have high or low measurement error?
High
What is a correlation coefficient?
Way to assess reliability, a number that tells us how strongly 2 variables are related to one another, most common is the Pearson Product Moment Correlation Coefficient
Summarize the Pearson Correlation method
- Symbolized as r
- Ranges from -1.00 to +1.00
- 0.00 means no relationship
- Stronger relationships = r closer to to +/- 1.00
What are the classifications of r in the Pearson Correlation Coefficient
- 00- no relationship
- 30- weak relationship
- 50- moderate relationship
- 80- strong relationship
- 00- perfect relationship
r=.50, what is the coefficient of determination? What does this mean?
r^2=.25
.25 x 100% = 25%
An r equal to .50 is 25% better than an r equal to 0.00
What is the coefficient of alienation of r=.50
(1-.50^2)
.75 x 100% = 75%
What are 3 ways to assess reliability?
Test-retest reliability, Internal consistency reliability, Interrater reliability
What are the 3 types of internal consistency?
- Split half reliability- Correlate an individual’s total score on the first half of the test to their total score on the second half of the test
- Cronbach’s Alpha- Scores on each item are correlated with scores on every other item
- Item-Total Correlations- Correlate each item with the total score based on all of the items
What is interrater reliability?
When multiple raters agree in their observations of the same thing (Cohen’s kappa)
What do we consider when determining the accuracy of a measure?
Validity
Define construct validity. What are the 6 indicators of it?
Construct validity is how well the operational definitions of variables reflect the true meaning of the variables
- Face validity
- Content validity
- Predictive validity
- Concurrent validity
- Convergent validity
- Discriminant validity
Define reactivity
When awareness of being measured changes an individual’s behavior