Validity Flashcards
internal/ experimental validity
- concerns the legitimacy + what is being measured in the actual study
- the extent to which a test study is investigating the effect of the IV on the DV
- researcher must make sure they are measuring what they intend to measure
factors that reduce internal/ experimental validity
- investigator effects
- demand characteristics
- confounding variables
- social desirability bias
- lack of operationalisation
investigator effects
the influence/ bias of the investigator on the study
- unintentional effect on participants + outcome of research
demand characteristics
when parts know the aim of the study and change their behaviour to affect the outcome - comply or ‘screw you’ effect
confounding variables
variables that have affected the DV apart from the IV
social desirability bias
when participants change their behaviour to be seen as socially desirable/ likeable/ not be judged
- affect DV + results gained
lack of operationalisation
not operationalised properly can result in low internal validity
ways of assessing internal validity
- concurrent validity
- face validity
assessing internal validity - concurrent validity
- way of establishing the internal validity of a new test
- scores gained from new test can be compared against an older, established test = validity is known
- if scores from both tests are similar and a positive correlation coefficient of +0.8 or greater is found, then the new test is judged as having high internal validity
assessing internal validity - face validity
- way to measure whether the test or measuring instrument is measuring what it should e.g. a questionnaire
- One or more researchers/experts in the field can examine the test items/questions to see whether they are measuring what it set out to
- do this by looking at the questions on a questionnaire and seeing, “on the face of it” whether the questions appear to be measuring what they should.
ways of improving internal validity
- concurrent validity
- face validity
- reducing investigator effects
- reduce demand characteristics
- confounding variables
improving internal validity - concurrent validity
- Concurrent validity can be improved (depending on the research method used)
- For instance if low concurrent validity is found on a questionnaire, then the researcher could remove questions that seem irrelevant or ambiguous
- then test the concurrent validity again
improving internal validity - face validity
- Face validity can be improved (for a questionnaire) by an expert in the field examining all of the questions on the questionnaire
- They might decide that some of the questions are not a good measure of the topic being investigated
- e.g. IQ, and they then might improve/rewrite/re-word certain questions again
- helps improve face validity.
improving internal validity - reduce investigator effects
- double blind procedure
- standardised instructions
- remove researcher so they’re not with parts at all = self administered
improving internal validity - reduce demand characteristics
- double blind procedure
- single blind procedure