all research methods Flashcards
1.2.1 (AO1) social psychology: questionnaires
give an overview of questionnaires
A questionnaire is a method of data collection, which requires participants to answer a list of questions. Although they are usually conducted either online or on paper (usually through the post), they can be conducted over the phone. In psychology they are known as self-report measures. This is because PP’s are reporting the information that we require from them instead of researcher’s having to manipulate anything. The typical format of a questionnaire is dependent on the researcher and their aim, usually straight-forward questions come first then followed by more complex questions. Questions gathering personal data are placed at the end so that they do not take up the time of the respondent, who may get bored too quickly. For ethical and practical reasons, questionnaires mustn’t be too long. A pilot survey is usually carried out, perhaps using friends and family as respondents, this tests questions for clarity and allows the person conducting the survey to make sure that the required information can be gathered. Data from a questionnaire are analysed and the analysis and their responses can fit into one of the PP’s designs (e.g. repeated measures, matched pairs, independent groups design).
(AO1) social psychology: questionnaires
what are open & closed-ended questions?
Questionnaires involve closed-ended questions like, ‘Children must receive vaccines: Agree or Disagree?’ or open-ended questions such as, ‘How do you think others see you?’ Open-ended questions give the respondent a chance to state their attitudes and opinions and give an extended, detailed response whereas closed-ended questions are limited to two answers.
open-ended questions produce qualitative data, closed-ended questions produce quantitative data.
(AO1) social psychology: questionnaires
what is qualitative & quantitative data?
questionnaires tend to gather both qualitative and quantitative data, like interviews.
qualitative data involves ideas and opinions. people give extended responses.
quantitative data involves numbers (e.g. saying ‘yes’ or ‘no’ answers) or percentages (e.g. percentage of someone saying they would offer a job to someone from the same school they did not know).
- open-ended questions produce qualitative data, closed-ended questions produce quantitative data.
(AO3) social psychology: questionnaires
strengths & weaknesses of quantitative/qualitative data
QUALITATIVE DATA
STRENGTHS
- A strength is that they give detailed information about a subject and allow in-depth analysis, which can lead to useful understanding. This is also important because respondents can say accurately what they think about an issue, which increases validity.
WEAKNESS
- One weakness of qualitative data is that they are hard to analyse in order to compare responses. Answers might be different so it means they are difficult to categorise and the results can be long and hard to summarise.
QUANTITATIVE DATA
STRENGTHS
- A strength is that they can be fairly quickly and easily analysed and averages, percentages and other statistics can be calculated. this data can be represented in graphs, charts or tables that can be easily and effectively communicated to others.
- Another strength is reliability. Quantitative data comes from closed-ended questions, which is reliable because it means that the respondents are all answering the same set of questions and giving the same answers (out of a few options) meaning the questions all carry the same meaning.
WEAKNESSES
- One weakness of quantitative data is the risk that respondents may be lying. This manifests itself in a few ways:
(1) demand characteristics: where an individual may respond in a way that they think will help the researcher find what they are looking for. Quantitative data tends to come from controlled studies and are more likely to suffer from DC’s than quantitative data because there is a clear aim, hypothesis and there are more likely to be clues to show what the study is investigating which may influence the respondent.
(2) social desirability bias: when respondents may say what they think is socially acceptable to say in order to appear better in front of a social group.
(3) lying: if questions are listed so respondents are likely to be answering ‘no’ to the questions, the respondent may continue to answer ‘no’ out of habit, which skews the validity of the data.
1.2.1 (AO3) social psychology: questionnaires
what research supports the use of the questionnaire method?
ADORNO ET AL. (1950) His California F-scale was an example of a questionnaire where he got PP’s to answer a set of questions which showed him how far respondents agree with statements that coordinate with an authoritarian personality level. These could also be re-tested for consistency, which upholds the value of questionnaires as reliable.
COHRS ET AL. (2012) used standardised questionnaires to test personalities such as right-wing authoritarianism (RWA), which increases the reliability of the data in their research.
(AO3) social psychology: questionnaires
strengths & weaknesses of closed & open-ended questions
closed-ended questions
STRENGTHS
- One strength of closed-ended questions is that all respondents give standard answers (e.g. yes, no, agree, disagree) which means numbers can be generated (quantitative analysis) for instance, by counting how many people responded with yes or no and scoring their ratings. Analysis can then be compared fairly with another set of data and percentages and averages can be calculated.
- Another strength of closed-ended questions is that the questions are the same for all respondents, the set of answers and the question wording. If the meaning is the same for all respondents, then the questionnaire is more reliable therefore, using questionnaires with closed-ended questions is reasonably reliable.
WEAKNESSES
- A weakness of closed-ended questions is that it forces the respondent to choose from a set of answers. The respondent may not agree with the prompts (e.g. ‘unsure’ or ‘no’) meaning it may not be accurately measuring their true response. This means that their answers are therefore, not valid.
open-ended questions
STRENGTHS
- One strength of open-ended questions is that respondents are allowed to give detailed responses, rather than being forced into giving an answer from a limited set of options. This means their answers are more informative to the researcher who intends to analyse them and are more valid because it provides what the respondent actually wants to share.
WEAKNESSES
- One weakness of open-ended questions is that they are much more difficult to analyse, because the data is qualitative it is difficult for researchers to calculate averages or formulate tables/graphs for this research.
- A second weakness is that respondents fail to complete their answers to open-ended questions or they become less detailed as the questionnaire progresses. This is because it is time-consuming and may result in the respondent becoming lazy, which affects the overall validity of the study because their answers may lack accuracy.
(AO3) social psychology: questionnaires
evaluation of questionnaires
STRENGTHS
- A strength of questionnaires is that they can be repeated accurately because they use: (i) the same set procedures, (ii) the same questions are asked to all of the PP’s, which meas that they are replicable by administering the questionnaire again.
- Questionnaires can be sent via post, which means that they are free from potential researcher bias. This is a strength because it shows that the researcher isn’t able to skew the PP’s responses, meaning that the data is valid and accurate.
WEAKNESSES
- Self-report data may be subject to social desirability bias or demand characteristics. If PP’s bias their responses, it is possible that the reliability and validity of the data is inaccurate.
- Although questionnaires follow a standardised procedure that may seem replicable, the way in which it is administered or delivered may influence the results. For instance, one evening a young female may ask PP’s to take part in the questionnaire in a local shopping centre whereas a male may ask PP’s to take part in their questionnaire at a night club. Differences may arise depending on the situation in which they ask.
1.2.2 (AO1) social psychology: interviews
give an overview of interviews
interviews involve asking questions but interviews involve a researcher carrying them out and although there is a series of questions, these can be varied according to responses. the aim of an interview is to find out some detail from a respondent according to the aim of the study. interviews tend to involve a personal situation, often face-to-face although they can be over the phone or online. the face-to-face element allows researchers to expand or clarify if the respondent is unsure. there are different types of interviews:
(1) structured interview
(2) unstructured interview
(3) semi-structured interview
1.2.2 (AO1) social psychology: interviews
why might an interview be used instead of a questionnaire?
- if some questions are to be explored in more depth
- when the respondent may need some reassurance
- when access is difficult
*access refers to reaching the PP, which may be difficult physically (e.g. if data is gathered from a child, a mental health patient or from a nusiness venture etc.)
1.2.2 (AO1) social psychology: interviews
explain the different types of interviews
(1) structured interview
- closed and predetermined so that the respondent has no options and does not lead the direction of the interview.
a structured interview follows a set format. it is a questionnaire administered by an individual. there might be extra instructions for using the questionnaire such as where and how to expand on the answers. structured interviews are useful at gathering quantitative as well as qualitative data and results can be compared between respondents. structured interviews can be carried out on the phone, face-to-face or via the internet. it is most likely to be strongly planned and therefore, more replicable and possibly yields more valid data.
(2) unstructured interview
- means open for the respondent to lead the questions and the course of the interview.
an unstructured interview involves questions that are not in a set format and which allow the interviewer to explore the area with further questions arising from the respondents answers. unstructured interviews are useful when depth and detail are required and perhaps, less is known by the topic in question so that issues can be explored. qualitative data are gathered.
(3) semi-structured interview
- means some fixed questions and some structure, regarding what will be asked - there is room for the respondent to lead the direction of the questions.
a semi-structured interview has set questions, some of which can be explored further by the interviewer. the semi-structured interview can produce qualitative and quantitative data and can offer insight as well as data that can be compared between the respondents. a semi-
1.2.2 (AO1) social psychology: interviews
what type of data is gathered in interviews?
qualitative data.
interviews are usually used when depth and detailed information is required (e.g. cognitive interviewing in policing); therefore, they are likely to contain information like age, gender, personal data etc.
1.2.2 (AO1) social psychology: interviews
what must you do with your notes after conducting an interview?
they must be transcribed in full so that the data is readily available for analysis.
1.2.2 (AO1) social psychology: interviews
ethical & practical issues when conducting an interview
PP’s must be involved in each stage:
- that they must see the schedule before the interview
- they must agree to the chosen format for recording the interview
- they must see the full transcript (copy) og yhe interview and agree with what was said or had occurred.
1.2.2 (AO3) social psychology: interviews
evaluate interviews as a research method
STRENGTHS
- the interviewer can explain questions and explore issues by asking further questions in contrast to a questionnaire, which is limited to the questions written down and the limited space available. when a researcher needs to explain further issues, it is useful.
- interviews obtain in-depth and detailed data that are likely to be valid because it comes from the interviewee themselves. the data are ‘real-life’ and ‘true’ therefore, more likely to be valid.
- if the interview is recorded, it can be tested and analysed by another researcher which increases inter-rater reliability as the researchers come to an agreement.
WEAKNESSES
- when asking questions, interviews may unconsciously pose researcher bias in the way they ask the question. for example, they may put a certain emphasis on the way they speak such as ‘You are not prejudiced are you?’ which may influence the way in which the respondent responds. researcher bias may also manifest itself dependant on the gender of the interviewer, respondent may give different answers if the researcher is male or female.
- researcher may find it difficult to interpret their responses when analysing the data and forming themes because it is so detailed and broad. this may mean it is difficult to maintain objectivity as the themes gathered may be subjective based on the interview.
(AO3) comparing questionnaires and interviews
RELIABILITY
(S: structured questions) are the same for each respondent, meaning that they are standardised and therefore more replicable which is likely more reliable.
(W: interviews) each person interviewed separately in different settings and on different occasions and perhaps by a different person means it is difficult to replicate and test for reliability.
VALIDITY
(W: structured questions) are with forced choice answers and are likely to be less valid and yield less true data as they force PP’s to choose from limited options.
(S: interviews) questions can be explained and explored; therefore, likely to give valid and ‘real-life’ ‘true’ data.
SUBJECTIVITY
(S: questionnaires) structured format means it is less open to researcher bias in the analysis and closed questions do not require interpretation meaning it is objective. open questions are likely to give short answers, which gives clearer themes.
(W: interviews) open to bias in analysis as generating themes requires interpretation, which gives rise to subjectivity but analysis can be objective if the steps are made clear.
1.2.4 (AO1) social psychology: sampling
what are the 4 different types of sampling techniques?
random sampling is when PP’s are ‘randomly’ recruited free from researcher bias (e.g. by picking names out of a hat that consist of the target population)
stratified sampling is when certain groups need to be represented in a study abd so sample is done to ensure that these groups are found in the sample. the proportion of the sample should match the proportions of the group themselves.
volunteer sampling is when the PP’s select themselves by putting themselves forward as volunteers (e.g. by responding to a researcher’s advertisement)
opportunity sample is using whoever is available with no constraints.
1.2.4 (AO3) social psychology: simple random sampling
evaluate the use of simple random sampling
STRENGTHS
- there is no bias in the way PP’s are chosen, everyone has the opportunity to be chosen and no one is systematically excluded from the sample. therefore, the sample is likely to be representative of the target population.
- it is clear to everyone how the sample was chosen. each step of the process can be explained and understood. with random sampling, any possible bas can be explained mathematically and worked out; therefore, it adds to the scientific procedure of the study meaning results and conclusions can be more widely recognised.
WEAKNESSES
- it is difficult to ensure that everyone in the target population/sampling frame is available to be included in the sample, which may cause bias.
- even with random sampling, when everyone has an equal chance of being chosen, there can be bias. for example, if the hypothesis was to examine obedience in male and female soldiers, it is likely that a random sample would not include any female soldiers, which may not be useful.
1.2.4 (AO3) social psychology: stratified sampling
evaluate the use of stratified sampling
STRENGTHS
- each group is bound to be represented so conclusions about differences about those groups can be drawn.
- stratified sampling is an effective way to ensure that there is representation from each group.
WEAKNESSES
- it is difficult to know how many of each group to choose in order to make sure that the findings are generalisable.
- the groups set in the study may not be important groups. having the groups already decided means that some people will be ruled out as PP’s, meaning that the sample is not representative.
1.2.4 (AO3) social psychology: volunteer sampling
evaluate the use of volunteer sampling
STRENGTHS
- it is more ethical than other methods (e.g. simple random sampling) because the PP’s come to the researcher rather than the researcher seeking them out.
- volunteers are interested and therefore, perhaps less likely to give out biassed information or to go against the researcher’s instructions. there is less likely to be social desirability bias or demand characteristics umless they are so keen to know what the researcher is doing. it is an advantage to have willing volunteers to take part in a study.
WEAKNESSES
- it takes a long time to get a sufficient number of PP’s because the researcher has to wait for volunteers to apply (time consuming).
- because the PP’s select themselves, they might be similar in some way (e.g. a similar personality type) this means the findings may lack generalisability as a self-selected sample may not represent the wider population.
1.2.4 (AO3) social psychology: opportunity sampling
evaluate the use of opportunity sampling
STRENGTHS
- it tends to be more ethical because the researcher can judge if the PP is likely to be upset by the study or if they are too busy to take part. other forms of sampling do not give this information readily.
- the researcher has more control over who is asked, so finding PP’s should be quick and efficient because access is not a problem.
WEAKNESSES
- there is more of a chance of bias than other methods. one source of bias, is that researchers have more control over who is chosen and may be biased towards people who are easy to access, such as people they know, they may be biased to choose people who look like themselves, similar age, gender etc. which leads to a biased sample.
- those who are p. 1.2.4 (AO1) social psychology: sampling
PM)V%P002 icked are available and willing to take part in the study, so they are self-selectex;POI) / v d. this would rule out anyone who is unavailable or unwilling, which again causes bias. .
1.2.6 (AO1) social psychology: thematic analysis
explain
some respondents present their answers to open-ended questions in different ways and their answers can take different directions. this enables themes to be generated once the data is analysed and this is known as thematic analysis.
thematic analysis means the researcher identifies a limited numebr of themes that reflect their data, by going into a great detail studying their data to develop the themes. coding refers to interpreting and grouping data.
phases of thematic analysis
1. GATHER- qualitative data is gathered using a suitable gathering tool (eg interview or questionnaire)
2. JOURNAL- a reflexive journal is kept throughout. this is to log the process of carrying out a thematic analysis so that the process is kepy transparent and can form a part of the final report.
3. PREPARE- transcribe the data carefully, using no interpretation and prepare the data ready for analysis. this can mean typing notes out into one doc or photocopying notes so they are readily available,
4. APPOINT- appoint coders. the researcher can be a coder but doesn’t have to be. coders might not know the aim of the study, which can help and reduce bias.
5. FAMILIARISE- the data must become well known and familiar to the coders
6. IDEAS- each piece of data has to be identified as an idea and shortened what is said to something more manageable.
7. IDENTIFYING THEMES- from the ideas, the coder will generate themes (eg, ‘nature’ or ‘nurture’ as themes)
8. NAMING THEMES- the themes are then named and the analysis can be reviewed to check when the data fit and to reconsider ideas in light of the themes generated.
9. RELIABLITY/VALIDITY CHECK- review the journal to look for interpretation and put that right so the data are valid. multiple coders can reduce the issue of subjectivity by using inter-rater reliablity to generate consistent themes.
10. REPORT THE RESULTS
1.2.6 (AO3) social psychology: thematic analysis
evaluate the use of thematic analysis
STRENGTHS
- thematic analysis is a way of reducing a large amount of data into a manageable summary and conclusion, without losing validity of the data. if the analysis is done well.
- it encourages the researcher to derive themes from the data rather than to impose pre-selected themes. this is likely to achieve better validity.
WEAKNESSES
- researchers often do not explain fully how they arrived at the theme and so a study is not easily judged for its validity.
- another weakness is that identifying some themes may be easy but identifying a limited number of themes that represent the data is much more difficult and requires time and skill from the researcher. the weakness is that it is time-consuming and requires skill.
- the researcher might have themes in mind when they do initial coding, so there may be doubt with the validity. the themes might come from the researcher rather than the data itself, this is a problem because the validity can be questioned as it may be affected by researcher bias.
what is an animal experiment?
an animal experiment has an independent variable (IV) that is manipulated to see the effect on the dependent variable (DV). there are strong controls like: environment of the study, age, type of animal, gender etc. the aim is to control all the variables except the IV so that it can be shown that a change in the IV has caused any change in the DV.
2.2.2 (AO1) cognitive psychology: independent and dependant variables
explain both
variables are whatever is likely to affect the experiment. they include:
- what is being tested
- what is being measured
- what else is likely to affect the results
(IV) independent variable is changed and manipulated by the researcher.
(DV) dependent variable is measured by the researcher and changes as a result of manipulating the IV.
2.2.3 (AO1) cognitive psychology: experimental and null hypotheses
explain both
experimental hypothesis is generated, which is a statement of what is expected. the experimental hypothesis is also known as the alternative hypothesis (alternative to the null hypothesis) and is called ‘experimental’ when the research method is an experiment.
null hypothesis states that any difference or relationship expected is due to chance meaning there is no relationship or difference as predicted.
2.2.4 (AO1) cognitive psychology: directional (one-tailed) and non-directional (two-tailed) tests and hypotheses
explain both
hypotheses can be directional or non-diretional.
directional hypothesis states the direction that is expected. it is clear in the directional hypothesis, which way the results are expected to go.
- one tailed.
non-directional hypothesis does not make the claim, the results can go either way.
- two-tailed.
2.2.8 (AO1) cognitive psychology: situational and participant variables
explain both
there are other variables that may affect the results of a study and these are known as extraneous variables. examples of EV’s that have to be controlled in an experiment are:
participant variables are those connected with the PP, for example: age, gender, experience and mood of the PP’s.
situational variables are connected with the situation in which the study takes place. for example: temperature, noise, interruptions and light.
2.2.6 (AO1) cognitive psychology: operationalisation of variables, extraneous variables and confounding variables
confounding variables are when an extraneous variable is not controlled in a study and it therefore, affects the results of the study.
extraneous variables might affect the result so they should be controlled for.
operationalisation when a variable is defined by the researcher and a way of measuring that variable is developed for the research.
2.2.10 (AO1) cognitive psychology: experimenter effects, demand characteristics and control issues
- double/single-blind technique
experimenter effects are things about the experimenter that affect the results, rather than change the IV. cues or signals that might affect the PP’s response could include: tone of voice, verbal or non-verbal cues such as gestures or facial expressions. to avoid this, it is best to get someone else to conduct the experiment rather than the designer.
- (e.g. milgram’s confedarate and ‘experimenter’ in his original 1963 study)
double-blind technique the PP’s are not aware which group they are in or what the study is about. the study is carried out by someone other than the person who knows who is doing what. neither the PP’s or the person running the study knows precisely what is expected.
single-blind technique the PP are not aware of what is expected or the condition that they are in but the person carrying out the study is. the single-bind technique stops PP’s expectations (demand characteristics) from affecting the results but does not stop experimenter effects (researcher bias).
- DOUBLE-BLIND TECHNIQUE IS BETTER!
2.2.5 (AO1 & AO3) cognitive psychology: experimental and research designs: repeated measures
when designing a study that uses an experiment or another research method, a decision has to be made in terms of what design to use.
repeated measures design
this is when the PP’s do all of the conditions in a study and all of the conditions are ‘repeated’.
STRENGTHS
- One strength of repeated measures design is that the same PP’s do all the conditions so PP variables are controlled. Each PP does all conditions, so any feature will affect both or all conditions and therefore, will cancel out. for example, it doesn’t matter what characteristics or individual differences a PP has because it has been the same in every condition meaning its cancelled out.
- Another strength is that more data can be gathered because each person does all the condition in comparison to independent groups design. repeated measures may be a better alternative because it is less costly and possibly more ethical.
WEAKNESSES
- One weakness of repeated measures is that there might be order effects. Whichever, condition PP’s do first might be their best performance simply because they are less tired than when undertaking the task in the next condition (fatigue effect). Or PP’s might do the second task better because they know what to do and are better acquainted with the task (practice effect). An order effect can skew the results of the study and therefore, the conclusions drawn from it.
- Another weakness is that there might be demand characteristics which occur when the PP’s responses are affected by what they guess the study is about. They might try and do what they think the researcher wants to find or to please the researcher, which skews the results of the study.