Validity Flashcards
Mastery
Validity
* In science and statistics, validity is the extent ….
- The word “valid” is derived from the Latin …, meaning strong.
- Measurement Validity
- Is the measure …
- Is the measurement …
- Study Validity
- Are the methods …
- Are the results …
- Are the results…
- Internal Validity
- Are the ….
- Study …
- External Validity
- the extent to which …
Validity
* In science and statistics, validity is the extent to which a concept, conclusion, or measurement is well-founded and corresponds accurately to the real world.
- The word “valid” is derived from the Latin validus, meaning strong.
- Measurement Validity
- Is the measure measuring what it is intended to measure?
- Is the measurement accurate?
- Study Validity
- Are the methods of the study valid?
- Are the results of the study true?
- Are the results free of bias?
- Internal Validity
- Are the changes in the dependent variable(s) really
cause by the independent variable? - Study validity
- External Validity
- the extent to which you can generalise the findings of a study to other situations, people, settings, and measures
Controlling threats to Internal Validity
* study design?
* blinding?
* placebo?
* # of control groups?
* assignment?
* purposeful sampling?
- External Validity (….)
- Can the conclusion…
- … inferences?
Controlling threats to Internal Validity
* Random assignment – required for cause and effect
* Study design
* Placebo
* Single blind/Double blin
- External Validity (application)
- Can the conclusion be applied to others in the
population or other populations? - Unbiased inferences?
Threats to external Validity
* sample?
* random?
* pre?
* many times?
* environment?
Controlling threats to external validity
* Selection?
* Study design
Threats to external Validity
* Selection of sample. representative of the study, only students? or entire population?
* Controlled environment of experimental procedures
* Pre-testing
* Multiple treatment interference
Controlling threats to external validity
* Random Selection
* Study design (Internal Validity
Four Basic Types
of Measurement Validity
The APA (American psychological association)
Identify four types of validity:
1) Logical validity (Face)
2) Content validity
3) Criterion validity
* Concurrent
* Predictive
4) Construct validity
Four Basic Types of Measurement Validity
The APA (American Psychological Association)
Identify four types of validity:
LCCC
1) Logical validity (Face)
2) Content validity
3) Criterion validity
* Concurrent
* Predictive
4) Construct validity
🃏 Validity of Measurement
→ Does the test…
✅ Logical (Face) Validity
Based on….
A … judgment of whether a test….
Also called surface or appearance validity
Not scientifically …, but adds …
🃏 Validity of Measurement
→ Does the test measure what it claims to measure?
✅ Logical (Face) Validity
Based on common sense and appearance
A subjective judgment of whether a test looks like it measures what it should
Also called surface or appearance validity
Not scientifically rigorous, but adds credibility
🃏 Content Validity
→ Does the test …
Based on….
Checks if the test …
Evaluates whether the questions…
Verified by … who review the items for relevance and coverage
🃏 Content Validity
→ Does the test fully cover the concept or content it’s supposed to measure?
Based on expert opinion
includes all the important topics or skills it’s supposed to cover—nothing important is left out.
It means the questions should match exactly what you’re trying to measure.
Verified by subject-matter experts (SMEs) who review the items for relevance and coverage
🃏 Criterion Validity
→ How well does the test …
… to a …
Shows how well the test predicts or matches …
Two types:
Concurrent Validity: …
Predictive Validity: …
🃏 Criterion Validity
→ How well does the test relate to a gold standard or real-world outcome?
Compares test scores to a recognized standard
Shows how well the test predicts or matches real performance
Two types:
Concurrent Validity: test and criterion measured at the same time. Example: A new depression questionnaire is given to patients at the same time as a well-established clinical interview. If scores match closely, it has high concurrent validity
Predictive Validity: test predicts future outcomes. Example: SAT scores are used to predict college GPA. If high SAT scores actually lead to high GPAs, the SAT has good predictive validity.
🃏 Construct Validity
→ Does the test actually measure…
✅ Key Points:
Measures …. (called constructs)
- How well an instrument ….
Checks if the conceptual definition (what the construct means) matches the ….
🃏 Construct Validity
→ Does the test actually measure the hypothetical concept it claims to (like anxiety, intelligence, or motivation)?
✅ Key Points:
Measures abstract concepts (called constructs)
- How well an instrument measures the characteristic being investigated
Checks if the conceptual definition (what the construct means) matches the operational definition (how it’s measured in the study)
✅ Content Validity
✅ Criterion Validity
✅ Construct Validity
✅ Face Validity
