7. research methods Flashcards
self report techniques
the participant reveals personal information about themselves in response to a series of questions
interview
participants give information in response to direct questioning from the researcher
questionnaire
participants give information in response to a set of questions that are sent to them
open questions
the question is phrased in a way that allows the participants to answer in any way they choose. this produces qualitative data
open questions AO3
― strength: As the participants have the freedom to choose their responses, this can be argued to lead to more valid responses
― limitation: Qualitative data makes data analysis between large numbers of participant responses much more difficult, making it harder to spot patterns in responses
closed questions
the question is phrased in a way that limits participants’ responses to only a few fixed options. this produces quantitative data
closed questions AO3
― strength: Quantitative data allows easy data analysis between large numbers of participant responses, making it easier to spot patterns in the data set
― limitation: As the participant’s responses are limited to a fixed set, this can be argued to be less valid as responses may just be the best fit, not how they really feel
avoiding complex terminology
participants may not understand the terms used. if feeling too embarrassed to ask for an explanation, or unable to answer some questions, they may guess the meaning which results in inaccurate responses
rewording question
using a skilled interviewer means questions that participants don’t understand can be reworded, this should be in a way that doesn’t change the question’s meaning so responses can be compared to other participants
leading questions
these bias the responses in one direction. to avoid this, questions should be written in a way that doesn’t suggest a ‘correct way’ of responding
piloting questions
running a small scale version of the interview or questionnaire can identify things that are confusing, give away the aim, or don’t produce a useful/detailed enough response. these can then be changed before the larger-scale study
filler questions
questions that are not linked to the research aim, but can be added to interviews to put the participant at ease and build rapport before more challenging questions. or can be added to interviews or questionnaires to act as red herrings and help hide the research aim, reducing demand characteristics
structured interview
the interviewer reads out a list of prepared questions as they are written
structured interviews strengths (AO3)
― the interviewer does not have to be highly trained to conduct the interview
― the interview responses are easy to compare because of the same questions used
structured interviews limitations (AO3)
― responses by the participants can’t be followed up with additional questions that can provide more detail
unstructured interview
no set list of questions, an open conversation about a topic
unstructured interview strengths (AO3)
― rapport is more likely, the participant feeling more comfortable to answer
― interesting responses can be followed up with additional questions
unstructured interview limitations (AO3)
― highly trained interviewer to think up appropriate questions in the moment
― every interview will be very different, making comparisons difficult
semi-structured interview
combination of prepared questions with ability to ask additional questions
semi-structured interview strengths (AO3)
― the interview responses are easy to compare because of the same questions used
― interviewer can ask follow up questions in response to interesting answers
― rapport is more likely, the participant feeling more comfortable to answer
semi-structured interview limitations (AO3)
need a highly trained interviewer to think up appropriate questions in the moment
self report techniques strengths (AO3)
― when the same set of questions are used they are very easy to replicate
― the use of closed questions allows data analysis; and the use of open questions gives the participant the opportunity to freely report their experience
self report techniques limitations (AO3)
― suffer from bias, such as social desirability bias: participants responding in a way that makes them look good in front of the researcher
other examples of bias in self-report techniques
― demand characteristics: often easy for the participant to work out the aim from the questions, which results in the participant answering in a way they think the researcher wants
― researcher bias: the researcher interpreting responses to open questions in a way that confirms their research hypothesis/their beliefs
― investigator effects: the personal characteristics of the interviewer, or the body language used by the interviewer, influencing the responses given by a participant
questionnaire strengths (AO3)
― don’t require a trained interviewer and can be distributed easily, making collecting a large amount of data a cheap and easy process
― when using closed questions, researchers can compare many thousands of responses easily
questionnaire limitations (AO3)
― questions the participants don’t understand cannot be rephrased
― questionnaires are often not taken seriously, this can result in acquiesce bias (the participant responding yes to every question)
interviews strengths (AO3)
― can rephrase questions that are difficult to understand
― can build rapport making it more likely the participant will take the interview seriously
interview limitations (AO3)
― requires an interviewer, this significantly increases the cost per participant especially if the interviewer needs to be trained
― interviewer effects, the personal characteristics of the interviewer can alter the response of the participants
repeated measures design
― the same participants complete two or more experimental conditions
― produces related data, each participant’s score in one condition can be paired with a data point in the other condition
repeated measures strengths (AO3)
― needs half the participants compared to independent groups design for the same amount of data
― participant variables between the conditions is not a problem as the participants take part in both conditions
repeated measures limitations (AO3)
demand characteristics & order effects
― participants are more likely to work out the aim than in independent group design as they take part in both conditions, meaning increased demand characteristics
― order effects: participant peformance can improve or worsen between the conditions due to factors like practice or fatigue
independent groups design
― different participants complete two or more conditions of the experiment
― participants are randomly allocated to each condition (to avoid researcher bias)
― produces unrelated data, the individual data points in any one condition cannot be paired with any of the data points in the other condition
independent group design strengths (AO3)
― participants are less likely to work out the aim than repeated measures design as they only take part in one condition, meaning reduced demand characteristics
― no order effects as participants only take part in one condition
independent group design limitations (AO3)
― independent groups design needs double the participants compared to repeated measures for the same amount of data.
― participant variables between the conditions is a problem as the participants take part in only one condition
matched pairs design
― different participants complete in each of the two or more conditions of the experiment.
― participants are first assessed and ranked on a characteristic and then the top two participants, then each following two, are randomly assigned to separate conditions
― produces related data, each participant’s score in one condition can be paired with a data point in the other condition
matched pairs strengths (AO3)
― reduced participant variables as participants are matched on a relevant characteristic
― no order effects as participants only take part in one condition
matched pairs limitations (AO3)
― matched pairs design takes longer to set up than other experimental designs
― matched pairs design needs twice as many participants as a repeated measures design
― participants are similar but not identical so there may still be some participant variables between conditions that influence the dependent variable
laboratory experiments
the experimenter controls environmental factors (e.g. noise and temperature) as well as the experience each participant has by using standardised procedures
laboratory experiments strengths (AO3)
high internal validity & replication
― Lab experiments have high control over confounding and extraneous variables. This means the researcher can ensure that any effect on the dependent variable is likely the result of manipulation of the independent variable. Thus we can be more certain about demonstrating cause and effect due to a high internal validity
― Replication is more possible than in other types of experiment because of the high level of control. Lab experiments ensure that new extraneous variables are not introduced when repeating an experiment. Replication is vital to check the results of any study to see whether the finding is valid and not just a one-off.
laboratory experiments limitations - generalisability & demand characteristics (AO3)
― Lab experiments may lack generalisability. The lab environment may be rather artificial and not like everyday life. In an unfamiliar context, participants may behave in unusual ways, therefore behaviour cannot always be generalised beyond the research setting (low external validity)
― Participants are usually aware they are being tested in a lab experiment, which may give rise to ‘unnatural behaviour’ (demand characteristics) as tasks may not represent every day experience (low mundane realism)
field experiments
defined by conducting the experiment in naturalistic settings. This change in location is an attempt to avoid the artificial nature of lab studies
field experiments strengths (AO3)
higher mundane realism
― Field experiments have higher mundane realism than lab experiments because the environment is more natural. Thus, field experiments may produce behaviour that is more valid and authentic, especially as participants may be unaware they are being studied (high external validity)
field experiments limitations (AO3)
increased realism > replication & ethical issues
― There is a price to pay for increased realism due to the loss of control of confounding variables. This means cause and effect between the IV and the DV in field studies may be much more difficult to establish and precise replication is often not possible
― There are also important ethical issues. If participants are unaware they are being studied, they cannot consent to being studied. Therefore, such research might constitute as an invasion of privacy
natural experiments
the two levels of independent variables occur in the real world without the influence of the researcher. the researcher simply records the change in the dependent variable between the two levels of independent variable
natural experiments strengths (AO3)
― natural experiments provide opportunities for research that may not otherwise be undertaken for practical or ethical reasons
― Natural experiments often have high external validity because they involve the study of real-world issues and problems as they happen, such as the effects of a natural disaster on stress levels
natural experiment limitations (AO3)
randomisation in experimental conditions & demand characteristics
― Participants may not be randomly allocated to experimental conditions. This means the researcher might be less sure whether the IV affected the DV. In the study of Romanian orphans, the IV was whether children were adopted early or late. Lots of other differences, such as those who were adopted late may also have been less sociable than some of the other children, which may have made them less appealing for prospective parents
― Such research may be conducted in a lab and therefore may lack realism and demand characteristics may be an issue
quasi experiment
participants cannot be randomly assigned between levels of IV, often because the level of IV is an innate characteristic of the participant
quasi experiment strengths (AO3)
― Quasi experiments are the only way to experimentally study factors that are pre-existing characteristics of participants
― Quasi experiments also share some strengths of a lab replication
quasi experiments limitations (AO3)
― Participants cannot be randomly allocated to conditions and therefore there may be confounding variables
target population
― every member of the group that the investigator plans to study
― researchers conduct their experiments on a smaller sample of participants, taken from the target population. the results of that sample are assumed to apply to all members of the target population (called generalisation)
― whether the results can be generalised or not depends on how representative the sample is of the target population, meaning the sample used in the study shares characteristics with the members of the target population
random sampling definition and how to conduct
each member of the target population has a mathematically equal chance of being in the experiment’s sample
― the researcher needs a full list of the entire population, and all names are entered into a container
― a number of names equal to the sample is pulled from the container
random sampling strengths (AO3)
― a random sample avoids researcher bias as the researcher cannot choose the participants they want to form the sample, avoiding the possibility the researcher picks participants they feel are likely to give a preferred result
random sampling limitations (AO3)
― by chance participants could be picked that produces an unrepresentative sample. for example, too few members of one gender or with no members of a minority group
― it can be difficult and time-consuming to get a full list of a large target population
systematic sample definition and how to conduct
participants are chosen from a list of the target population. every Nth participant is chosen to form the sample
― the researcher needs a full list of the entire target population
― the researcher reads down the list selecting every Nth participant to form the sample
― the process continues until the sample required is chosen
systematic sampling strengths (AO3)
― avoids researcher bias as the researcher cannot choose the participants they want in their sample
― if there is an existing list of the target population, it can be a quick method of selecting a sample
systematic sampling limitations (AO3)
― by chance this method could result in an unrepresentative sample (too few members of one gender or with no members of a minority group)
― if the target population is very large, getting a full list could be difficult
opportunity sample definition and how to conduct
the researcher directly asks available members of the target population to take part in the research. this is likely to be individuals the researcher has easy access to and is familiar with
― researcher directly asks any members from within the target population to take part in the research
― any individuals who agree to take part are added to the sample until the number of participants required is met
opportunity sample strengths (AO3)
― this is the fastest way to get a sample for psychological research, reducing the time it takes to conduct research and likely reducing the cost involved compared to more complex sampling methods