Research Methods Flashcards
What are case-studies?
An in-depth investigation, description and analysis of a single individual, group, institution or event.
They tend to be longitudinal.
Data may be collected from the individual themselves, or those close to them.
This data can be qualitative or quantitative, though it tends to be more qualitative - interviews, observations ect. produce qualitative data, while psychological tests may produce quantitative data.
It can involve the analysis of unusual individuals or events
What are some benefits of case studies?
. Provide rich, detailed insight - preferable to the more ‘superficial’ forms of data which might be provided from an experiment, as case studies collect data from a long period of time as opposed to a brief moment - likely to increase the validity of the data
. Enables the study of unusual behaviour - some behaviour’s are conditions are rare and can’t be studied using other methods eg. the case of HM. Being able to study unusual behaviour can help us understand ‘normal’ functioning
. Can be used to generate hypotheses for future research
What are some limitations of case studies?
. Prone to researcher bias - Conclusions are based on the subjective interpretation of the researcher, which can reduce the validity of the study
. Participants accounts may be biased - Personal accounts tend to come from participants and family members, who may be prone to inaccuracy/memory decay, especially if it is childhood stories being recounted. This means evidence provided may be low in validity
. Limited generalisability - often study unique individuals eg. with certain medical conditions - can’t be applied to wider population
What is content analysis?
An observational research technique that enables the indirect study of behaviour through the examination of the communications people produce. These communications can appear in spoken form interactions (conversations), written form (emails) or examples from the media (TV, magazines). The aim is to summarise these communications so that overall conclusions can be drawn. It is composed of Coding and Thematic analysis
What is coding?
The first stage of content analysis. Some data sets may be extremely large, so information is categorised into meaningful units. This then allows for each instance of the chosen categories to be counted up eg. how many times a particular word or phrase appears in a text. It produces quantitative data.
What is a thematic analysis?
A form of content analysis which produces qualitative data. It is focused on the identification of themes (ideas which recurrent) within a piece of communication. It tends to be more descriptive than coding
What is the final step of thematic analysis?
When the researcher is satisfied that their chosen themes represent the communciation they have chosen, they may collect a new set of data to test the validity of the themes and categories. Assuming the themes explain the new data adequately, a final report is drawn up
What are some strengths of Content analysis?
. Allows researchers to bypass the ethical issues associated with psychological research - Much of the material an analysist hopes to study is pre-existing in the public domain, so there are no issues in terms of obtaining permission. This may also provide greater external validity, and ‘sensitive’ data is provided with consent.
. Flexible - can produce both quantitative and qualitative data, depending on research aims
What are some limitations of Content analysis?
. May be affected by the researchers subjective interpretations - Content analysis tends to involve an indirect study of communications, where they are studied outside of the context they were given in. This creates a danger of the researcher attributing their opinions and motivations to the ‘author’ and their communications that weren’t originally present. As such, it may suffer from a lack of objectivity, especially when thematic analysis is used as it tends to be more descriptive
— However many modern researchers to tend to be aware of the risk, and reference their biases in their final reports
What is reliability?
How consistent a form of measurement or it’s findings are - if a particular measurement is made twice and produces the same result, it can be described as reliable
How can reliability be assessed?
. Test-retest method
. Inter-observer reliability
What is test-retest reliability?
A method of assessing reliability which involves administering the same test on the same person/group on different occasions. If the test is reliable, the results obtained should be the same, or at least similar.
There must be sufficient time between the test and retest in order to ensure that the participant can’t recall their answers, but not so long that their attitudes/opinions/abilities may have changed.
Example - Two sets of scores from a questionnaire are obtained on two different occasions, and correlated. If the correlation is significant and positive, we can assume the test has high reliability
What is inter-observer reliability?
The extent to which there is agreement between observers in their observations of a behaviour. Observers watch the same sequence of events, but record their observations privately. This may take place before the actual research, in a pilot study, in order to check that behavioural categories are being applied in the same way. Alternatively, a comparison of events may be reported at the end of the study.
The data collected by the observers is correlated to assess reliability.
In content analysis, this is referred to as inter-rater reliability. In interviews, it is inter-interviewer reliability
What is the correlation coefficient for reliability?
It should be exceed +80
How can reliability be improved in Questionnaires?
A questionnaire that produces low test-retest reliability may require some items to be deselected or rewritten eg. some open questions which are open to misinterpretation are replaced with closed questions, which may be less ambiguous
How can reliability be improved in Interviews?
Ideally, the same interviewer would be used for each interview within the study. However this may not always be possible. Instead, all interviewers must be properly trained, so that they are not asking leading or ambiguous questions. Structured interviews can improve reliability, as the interviewer is controlled by a fixed list of questions.
How can reliability be improved in Observations?
Reliability can be improved by ensuring all behavioural categories have been operationalised (making abstract concepts measurable). Categories should not overlap (eg. hugging and cuddling) and all possible behaviours should be covered on the checklist
Observers should also be trained in using behavioural categories, and should be able to discuss behavioural categories with eachother so categories can be applied more consistently
How can reliability be improved in Experiments?
Procedures are the focus of reliability in experiments. In order to achieve reliability, researchers must use standardised procedures (establishing consistent methods of obtaining data
What is validity?
The extent to which an observed effect is genuine - whether a psychological test, observation or experiment produces a legitimate result. It can be further divided into:
. Internal validity - whether the researcher has measured what they intend to measure
. External validity - The extent to which findings can be applied beyond the research setting - how far it accurately applies to the wider world
What is Internal validity?
Whether the findings/observed effects in a piece of research are due to the manipulation of the independent variable, rather than another factor.
Demand characteristics can severely limit internal validity, as participants behaviour is down to what they see as the researchers expectations, rather than the IV
What is External validity?
The extent to which findings can be generalised beyond the research setting to other populations, settings and time periods
. Ecological validity - A form of ecological validity concerned with applying findings to other settings and situations. It is not necessarily the setting of the research that affects this eg. field, lab - the task can also lower ecological validity eg. using word lists to test memory
. Temporal validity - A form of ecological validity -
The extent to which the findings of a piece of research, or concepts from a particularly theory, can be applied to other time periods and eras
How can validity be assessed?
. Face validity - Whether a test, scale, or measure appears to measure what it is supposed to measure. This can be determined by ‘eyeballing’ the measuring instrument, or having it checked by a professional eg. does a test of anxiety look like it measures anxiety?
. Concurrent validity - Where the results obtained from a psychological measure are close to, or match, the results from another recognised and well-established test. Close agreement between the two sets of data indicates that the new test has high concurrent validity - if the correlation score exceeds +80
How can the validity of Experiments be improved?
. Using a control group - Allows researcher to better assess whether changes in the dependent variable were due to the effects of the independent variable
. Using standardised procedures - Minimises the impact of participant reactivity and investigator effects - single/double blind procedures may also be used to achieve this
How can the validity of Questionnaires be improved?
Many questionnaires and psychological tests incorporate a lie scale within questions. This assesses the consistency of the participants response, and aims to control the effects of social desirability bias. Validity can also be enhanced by assuring patients that all data will remain anonymous