Reliability And Validity(RM) Flashcards
What is internal reliability?
The extent to which a measure is consistent within itself
How can internal reliability be demonstrated or checked using?
Split half method: the rest is randomly divided into two so that each half of equivalent
If participants score are similar on both halves it shows internal reliability
What is item analysis?
A measure of Internal reliability- performance on each item is compared with the overall scores. A good positive correlation = high internal reliability
What is external reliability?
Describes the extent to which a measure varies from one use to another
What is one way in which external reliability can be tested?
Test re-test- the person is tested twice over a period of time, similar scores suggest high external reliability
What is inter-observer reliability?
The ratings from more than one person are correlated to check for agreement (if correlation is low it could be due to poorly designed behavioural categories or poorly trained observers
What is inter-interviewer reliability?
Different interviewers should produce the same result when interviewing the same person or the same interviewer should provide the same results when interviewing the same person in two occasions (if not suggests interviewers are behaving differently)
What is replication (external reliability)?
Any research study should produce similar findings if repeated
What is internal validity?
Describes the extent to which a study measures what it intends to measure
What is internal validity about?
How other variables are controlled and the extent we can be certain that any changes in DV were due to the manipulation of the IV rather than the extraneous variables
The more controlled the experiment is, the higher the internal validity
How does experimental realism affect internal validity?
This refers to when a participant does not believe in the experimental set up and they may simply act so the results are meaningless
(Higher the experimental realism- the more the participant is involved in the task as if it was real)
How does mundane realism affect internal validity?
This refers to things that are similar to everyday activities
In what three ways can internal validity be assessed?
Face validity- the items look like they measure what the test says it measures
Criterion validity- do people who do well in the test do well on other related things?
Predictive validity- do people who perform well on the test go on to be good at things you would expect them to be good at?
What is external validity?
Describes the extent to which the findings from a study can be generalised to everyday life and situations other than the context of the study
Whatโs ecological validity?
Describes the extent to which the findings of a study can be generalised from the setting in which it was conducted, to other settings