Reliability and validity Quantitative Research Flashcards
Reliability
The replicability or the consistency of a give measure. The extent to which a study is replicable and able to provide similar results through repititions.
Validity
The “truthfulness” of a measure, whether it is really measuring what the study set out to measure.
T/F: There is no possible way to compute a given study’s reliability or validity
True
Internal reliability
Consistency across items/aspects within the study, like ensuring test questions are similarly difficult.
Test-retest reliability
Consistency over time, from one test to the next, like ensuring exams are similarly challenging year to year.
Inter-rater reliability
Ensuring consistency across different researcher’s interpretations/measuring the same items as consistently as possible, such as ensuring IB examiners mark exam questions in a similar way.
External reliability
Refers to how consistently something is measured in replications by other independent researchers.
Test-retest reliability and inter-rater reliability are 2 types of ________ reliability
external
Low reliability can lead to investigation of low _________
validity
Internal Validity
Evaluates the extent of a cause-and-effect relationship being created between the IV and DV. Are the findings a result of the experimental treatment?
External Validity
Evaluates the extent to which results can be generalized to other people, settings or situations beyond the experiment itself.
Why is construct validity called “construct” validity?
Any time a variable is operationalized, there has to be a critical question about how the construct was “translated” and operationalized.
Don’t have to be remember but:
For example, how do we accurately measure the construct of short-term memory?
Validity focuses on accuracy, but how do the 3 branches of validity focus on different aspects of validity?
Internal Validity:
- Focused entirely how accurate is it within a study
External Validity:
Focused how accurate the study is beyond the study
Construct validity:
Focused on how accurately constructs have been operationalized in a study
Internal validity is a function of _______ and _______
procedure and design
External validity is a function of __________ and __________
Sampling and artificiality
