Research Methods- Types of validity Flashcards
Validity -
The extent to which an observed effect is genuine - does it measure what is was supposed to measure, and can it be generalised beyond the research setting within which it was found?
Face validity -
A basic form of validity in which a measure is scrutinised to determine whether it appears to measure what it is supposed to measure
- for instance, does a test of anxiety look like it measures anxiety?
Concurrent validity -
The extent to which a psychological measure relates to an existing similar measure.
Temporal validity -
The extent to which findings from a research study can be generalised to other historical times and eras. A form of external validity.
Ecological validity -
The extent to which findings from a research study can be generalised to other settings and siutations. A form of external validity.
What is validity in psychological research?
Validity refers to whether a psychological test, observation, or experiment produces a legitimate result that genuinely represents what is being measured and can be generalized to the real world.
What are the two main types of validity?
The two main types of validity are internal validity (whether the observed effect is due to the manipulation of the independent variable) and external validity (whether findings can be generalized beyond the research setting).
Can a study be reliable but not valid?
Yes, a study can produce reliable (consistent) data that is not valid. For example, a broken scale may consistently show a weight 7lbs higher than the actual weight, making it reliable but not valid.
What is internal validity?
Internal validity refers to whether the observed effects in an experiment are due to the manipulation of the independent variable and not influenced by other factors, such as demand characteristics.
What is a threat to internal validity?
A major threat to internal validity is participants responding to demand characteristics, where they act in a way they believe is expected, rather than naturally.
What is external validity?
External validity refers to the extent to which findings from a study can be generalized to other settings, populations, or time periods.
Is ecological validity solely about the naturalness of the setting?
No, ecological validity also depends on the task’s realism (mundane realism). Even in a natural setting, an unrealistic task (e.g., memorizing word lists) can lower ecological validity.
What is ecological validity?
Ecological validity concerns whether findings from a study can be generalized to everyday life, particularly focusing on the naturalness of the setting and the task used.
What is temporal validity?
Temporal validity refers to whether findings or concepts from a study or theory remain true over time. For example, Asch’s conformity findings may have been influenced by the conformist culture of the 1950s.
What is face validity?
Face validity is a basic form of validity where a test or measure appears, at face value, to measure what it is supposed to measure. It can be assessed by experts or through simple observation.
What is concurrent validity?
Concurrent validity is demonstrated when the results of a new test closely match those of a well-established test. For example, a new IQ test’s results should correlate highly (e.g., +0.80) with an established test like the Stanford-Binet.
How can validity be improved in experimental research?
Validity can be improved by using control groups, standardizing procedures, and employing single-blind or double-blind designs to reduce participant reactivity and investigator effects.
What is a single-blind procedure?
In a single-blind procedure, participants are unaware of the study’s aims to reduce demand characteristics and improve validity.
What is a double-blind procedure?
In a double-blind procedure, both participants and researchers are unaware of the study’s aims, reducing both demand characteristics and investigator effects.
How can validity be improved in questionnaires?
Validity can be improved by including lie scales to detect social desirability bias, ensuring anonymity, and using clear, unambiguous questions.
How can validity be improved in observational research?
Validity in observations can be improved by ensuring behavioral categories are clear, non-overlapping, and cover all possible behaviors. Covert observations also enhance ecological validity by reducing reactivity.
What is interpretive validity in qualitative research?
Interpretive validity refers to the extent to which the researcher’s interpretation of events matches the participants’ perspectives. It can be demonstrated through coherent reporting and direct quotes from participants.
What is triangulation in qualitative research?
Triangulation involves using multiple sources of evidence (e.g., interviews, diaries, observations) to enhance the validity of qualitative research findings.
Why are qualitative methods often considered to have higher ecological validity?
Qualitative methods, such as case studies and interviews, provide depth and detail that better reflect participants’ real-life experiences, making them more ecologically valid.
