Day 6+7 Flashcards
Define reliability
- An indicator of a measure’s internal consistency
- A measure is reliable when different attempts at measuring something converge on the same result
- When the measuring process provides reproducible results, the measuring instrument is reliable
Name 2 types of measuring reliability
1) Test-Retest (Stability)
2) internal Consistency (split-half or chronbachs alpha)
Describe the test-retest reliability
The test-retest method of determining reliability involves administering the same scale or measure to the same respondents at two separate times to test for stability
When is the test-retest reliability ensured?
- If the measure is stable over time, the tests administered under the same conditions each time, should obtain similar results
- > Represents a measure’s repeatability
How relates reliability to validity?
- Good measures should be both precise (i.e., reliable) and accurate (i.e., valid).
- Reliability is a necessary but insufficient condition for validity
- A reliable scale may not be valid
- A reliable but invalid instrument will yield consistently inaccurate results
Define internal consistency
Internal consistency assesses the correlation between multiple items in a test that are intended to measure the same construct
Describe the process of testing internal consistency
- no repeating of test or involvement of other researches needed
- Internal consistency of a multiple-item measure can be measured by correlating scores on subsets
- survey questions with the sames intentions should have similar results and correlate strongly
Describe the split-half method to test internal consistency
- Take half the items from the scale and checking them against the results from the other half
- the answers to the two seperate halfs should be similar and correlate highly
Explain coefficient Alpha
Represents internal consistency by computing the average of all possible split-half reliabilities for a multiple item scale
What does coefficient alpha demonstrate?
whether or not the different items converge
Name the scale of consistency for coefficient alpha
0.80 - 0.96: very good reliability
0.70 - 0.80: good reliability
0.60 - 0.70: fair reliability
Below 0.60: poor reliability
Define validity
- Validity is the accuracy of a measure
- Addresses the problem of whether a measure indeed measures what it is supposed to measure
What happens if a measure lacks validity?
any conclusions based on that measure are also likely to be faulty
Name 3 types of validity
- Face (content) validity
- Criterion validity
- Construct validity
Explain face (content) validity
-refers to the subjective agreement among professionals that a scale logically reflects the concept being measured
Explain the criterion validity (concurrent)
-addresses the question: “Does my measure correlate with measures of similar concepts or known quantities?”
Explain construct variability
Exists when a measure reliably measures and truthfully represents a unique concept and consists of several components. The researcher should have a good, detailed description of the content domain.
Explain concurrent validity
In concurrent validity, we assess the operationalization’s ability to distinguish between groups that it should theoretically be able to distinguish between. For example, if we come up with a way of assessing brand loyalty, our measure should be able to distinguish between people who are loyal to a brand and those who are not.
Name components of construct validity
- Face validity
- Criterion validity
- Convergent validity
- Discriminant validity
- Fit validity
Explain predictive (criterion) validity
In predictive validity, we assess the operationalization’s ability to predict something it should theoretically be able to predict. For instance, we might theorize that a measure of brand loyalty should be able to predict whether the person buy products of the brand.
Explain Convergent validity
In convergent validity, we examine the degree to which the operationalization is similar to (converges on) other operationalizations that it theoretically should be similar to. For instance, to show the convergent validity of loyalty to an American product, we might gather evidence that shows that the program is similar to other American products.