Research Methods A2 L1 - 4 (analysis, case study, reliability, validity) Flashcards
Content analysis:
Systematic research technique for analysing data, where the researcher creates a coding system of predetermined categories that can be applied to the content
What is a pilot study often used to test?
Coding system to ensure they don’t overlap but are separate
What type of data does content and thematic analysis generate?
Content: Quantitative
Thematic: Qualitative
Thematic analysis:
Use of themes to collect new sets of data
Theme:
An idea that reoccurs from interviews
Stages of content analysis:
1) Sampling –> role/event sampling
2) How is data being recorded?
3) Analyse/categorise data
4) Tally up amounts
Strengths and weaknesses of content analysis: (+3, -2)
+ Reliable way to analyse quantitative data –> coding units are not open to interpretation
+ Trends and patterns can be identified due to quantitative data
+ Not time consuming
- Causality cannot be established because it merely describes the data
- Cannot extract any deeper meaning for data patterns arising
Case studies:
Detailed investigation of single individual or group
Aim of case studies:
Be scientific and objective in their methodology
What different types of data can be collected from case studies?
Qualitative and quantitative data
Strengths and weaknesses of case studies: (+3, -2)
+ Good use of research to support key theories
+ Use of qualitative data
+ Allows study of cases that would usually be deemed impractical or unethical
- Individual differences between people that cannot be generalised
- Difficult to replicate as it is just one individual
How can psychologists assess for reliability in observations?
- Test retest method
- Pilot study
How can psychologists improve reliability in observations?
- Inter observer reliability
How can psychologists assess for reliability in self-reports?
Test retest
How can psychologists improve reliability in self-reports?
- Altering questions used in the interview
- Inter researcher reliability
How can psychologists assess for reliability in experiments?
Test retest
How can psychologists improve reliability in experiments?
Standardisation of instructions
Test retest method: (4)
- Conduct the observation/experiment/ self-report once and collect the results
- Repeat again a few weeks later w/ same pps in same way
- Compare the results
- If results are similar, there should be a correlation coefficient of 0.8 or more
Pilot study: (4)
- Conduct small trial of observation
- May include standardised instructions, debriefing and planning procedures
- Operationalised categories
- Minimises human error and variation
How can inter observer reliability be improved and what should the results show?
- Use more than one observer
- Ensuring behavioural categories were operationalised properly
- Further observer training about which behaviour should be observed
- Correlation coefficient of 0.8 or more
How should reliability be improved if results from pilot study are not clear?
Give more training to observers
What factors should be considered when reviewing the questions used in the interview?
- Type of data required –> qualitative/quantitative affects whether open/closed questions are asked
- Ambiguity –> avoid vague questions
- Double barrelled questions –> Avoid 2 in 1 questions
- Leading questions
- Complexity –> avoid jargon
How can reliability be improved through standardisation of instructio?
If experiment is conducted twice:
- repeat same procedures twice
- use operationalised variables
Internal validity:
Extent to which a study is investigating the true effects of independent variable and dependent variable
Factors that can reduce internal validity: (5)
- Investigator effects
- Demand characteristics
- Confounding variables
- Social desirability bias
- Lack of operationalisation
Give 2 examples of internal validity:
- Face validity
- Concurrent validity
How can concurrent validity be assessed?
- Scores from new test can be compared against an older, established test where validity is already known
- If positive correlation coefficient
How can face validity be assessed?
One or more experts in the field examine test questions and see whether the questions appear to be measuring what they should ‘on the face of it’
How can concurrent and face validity be improved?
Remove/rewrite/re-word irrelevant questions
External validity:
- Refers to factors outside of research setting
- How well can results gained be generalised to other settings, people and time eras
Types of external validity:
1) Ecological validity
2) Temporal validity
Ecological validity:
Ability to generalise findings of piece of research to other settings
Temporal validity:
Results of study can be generalised to people in today’s contemporary society
