4- validity Flashcards
1
Q
what is internal validity
A
- concerns legitimacy and what is being measured in the study
- the extent to which a test/study investigates the true effect of the IV on the DV
- researcher must observe what they intend to
2
Q
what factors reduce internal/experimental validity
A
- investigator effects (characteristics of researcher affect participants and results)
- demand characteristics (participants guess aim of study and change behaviour)
- confounding variables (external variables have not been well controlled and effect DV)
- social desirability bias (participants try to portray themselves positively by behaving unnaturally)
- lack of operationalisation (variables not been defined and measured properly)
3
Q
what are the 2 ways to asses internal validity
A
- concurrent validity
- face validity
4
Q
what is concurrent validity
A
- establishing internal validity of a new test by comparing scores to those from an older, established test where validity is known
- if scores are similar (correlation coefficient >0.8) then new test has high internal validity
5
Q
what is face validity
A
- way to measure if test/instrument is measuring what it should
- experts in the field examine test items/questions to see if they measure what they set out to
- done by looking at questions ‘on the face of it’ (quick look over questions)
6
Q
how to improve concurrent validity
A
- remove questions that seem irrelevant or ambiguous and then test concurrent validity again
7
Q
how to improve face validity
A
- expert in the field examines all of the questions
- might decide some aren’t a good measure and may improve them or rewrite certain questions
8
Q
what other factors help improve internal validity
A
- reduce investigator effects (standardised instructions/ remove researcher)
- reduce demand characteristics (double/single blind trials)
- confounding variables (do experiment in controlled/lab setting)
9
Q
what is external validity
A
- refers to factors outside the research setting
- how well results can be generalised to other settings, people and time eras
10
Q
what are the 2 types of external validity
A
- ecological (generalise results to other settings/contexts and if study is high in mundane realism it may increase ecological validity but setting of research must be assessed)
- temporal/times (findings are true over a period of time)
11
Q
how do you assess external validity
A
- meta-analysis (findings from studies with the same hypothesis compared and consistent findings = high ecological validity)
- consider environment the study was conducted in (naturalistic to have high ecological validity, lab=low ecological validity as it is artificial)
- how dependent variable was measured (task should have high mundane realism)
- if participants were behaving naturally (shouldn’t be aware of true aim as demand characteristics occur and this effects DV so low validity)
12
Q
how do you improve external validity
A
- reduce demand characteristics (double blind procedure (psychologist and participant don’t know aim) or single blind (participants don’t know aim))
- use naturalistic settings to improve ecological validity (e.g. field experiments or covert observations so participants behave more naturally)