Research Methods Flashcards
What is test retest reliability?
The measure is administrated to the same group of people twice, if the results on the two tests are similar we can assume it’s reliable.
How can we measure reliability?
- Test retest reliability
- Split half reliability
- (Most common) inter-rater reliability
Split half reliability?
Splitting a test into two halves and comparing the scores in both halves. If the results are similar we can assume reliability.
Internal validity?
Refers to things that happen inside the study. Whether we can be certain it was the IV that effected the DV.
Population validity?
The extent to which the sample represents the population
Generalisability issues(validity issues)?
If lacking in realism we are unable to generalise as it doesn’t effect real life.
However even if it does have realism if it has low population validity we can’t generalise.
External validity?
How well results can be generalise beyond the experimental setting
RIGHT TO WITHDRAW
Should have the right to withdraw at any point. After participants have taken part in a study, or after debriefing (for instance, in observational studies), participants have the right to retrospectively withdraw any consent they have given and to request that any data relating to them is destroyed.
After participants have taken part in a study, or after debriefing (for instance, in observational studies), participants have the right to retrospectively withdraw any consent they have given and to request that any data relating to them is destroyed.
Mundane realism(validity)?
Refers to how well the task in an experiment reflects real life. If an experiment has this it is high in ecological validity
Ecological validity?
Refers to how well the experimental situation represents real life.
Participant variables(anything to do with differences in the participants eg age/gender/intelligence/skill/experience etc) how to overcome?
Use repeated measures and independent design aka repeat the experience using the same people in each different condition.
What is validity?
Validity refer to the extent to which a test measures what it claims to measure.
Content validity?
(Used with questionnaires and interviews) Examines the content of a text. Whether the method used measures what it claims to measure e.g IQ test actually measuring intelligence not just ability to solve puzzles.
Concurrent validity?
How well the measure used agrees with the existing measure.
How to ensure concurrent validity?
Testing participant with both new text and the established test. If the test has high agreement with the two it is said to have concurrent validity.
Construct validity?
Whether the method actually measures all parts it was aiming to e.g using a maths test to test intelligence doesn’t account for linguistic ability or spatial awareness.
How to ensure construct validity?
Define what it is that it is aiming to measure and ensure that all parts of the definition is being measured.
How to ensure ecological validity?
Take place in participants natural environment.
How to ensure mundane realism?
Make sure the tasks are realistic to life.
Weaknesses of laboratory study?
- Leading questions could be asked
- Low in mundane realism and therefore low in ecological validity.
- Often low in population validity
How to ensure population validity?
Use of sample of many races ages genders etc.
Investigator effects/experimenter bias(the behaviour and language of the experimenter. Eg the way they ask a question may act as a cue for the p) overcome?
Don’t use a researchers who designed the study to give questions. Use someone who doesn’t know the aims.
Demand characteristics (p’s search or cues as to how to behave. Often something can communicate to them and they guess the aims or act how they believe is demanded of them) overcome?
Using independent measure or mislead them on the aim of the study.
Strengths of field experiments?
- Higher mundane realism. Leading to higher ecological validity.
- Reduced demand characteristics aims are less apparent
- Reduced chance of participant effects.
- The experimenter can control the IV
Strengths of a laboratory study?
- quantitative data is collected and this is objective.
- Standardised procedure means they’re easily replicable.
- Lots of control over extraneous variables
- Cause and effect relationship can be established.
Weaknesses of field experiment?
- Harder to control extraneous variables which may reduce internal validity.
- Still a risk of demand characteristics.
- Ethical as they may be deceived and not give fully informed consent.
- Harder to replicate leading to issues of reliability.
Repeated measures (same p’s in each condition of experiment) strengths?
- Participant variables are accounted for and and stopped from becoming extraneous variables.
- Fewer participants required