Research Methods Flashcards
What are the independent and dependent variables?
- Independent = what you change
- Dependent = what you measure
What are extraneous and confounding variables?
- Extraneous = nuisance variables that may make it more difficult to detect an effect
- Confounding = change with the IV, so we cannot be sure if any observed change in the DV is due to the CV or IV
What are demand characteristics?
Refers to any cue from the researcher or research situation that may reveal the aim of study, which changes participants’ behaviour
What are investigator effects?
Any effect of the investigator’s behaviour on the outcome of the research (the DV) and also on design decisions
What is standardisation?
Using exactly the same formalised procedures for all participants in a research study, otherwise differences become EVs
What is a pilot study?
A small-scale trial run of an investigation to “road-test” procedures, so that research designs can be modified
What are single blind and double blind procedures?
- Single-blind = a participant doesn’t know the aims of the study so demand characteristics are reduced
- Double-blind = participant and researcher don’t know the aims of the study to reduce demand characteristics and investigator effects
What is an independent groups design?
One group does Condition A and a second group does Condition B. Participants should be randomly allocated to experimental groups
How is no order effects a strength of independent groups?
- Participants are only tested once so can’t practice or become tired
- This controls CVs
How is participants not guessing aims a strength of independent groups?
- Participants only tested once so are unlikely to guess research aims
- Therefore, behaviour may be more “natural” (higher realism)
How are individual differences a weakness of independent groups?
- The participants in the two groups are different, acting as EVs/CVs
- May reduce validity of the study
How are independent groups being less economical a weakness?
- Need twice as many participants as repeated measures for same data
- More time spent recruiting which is expensive
What is a repeated measures design?
- Same participants take part in all conditions of an an experiment
- The order of conditions should be counterbalanced to avoid order effects
How is individual differences a strength in repeated measures?
- The person in both conditions has the same characteristics
- This controls CVs
How is fewer participants a strength of repeated measures?
- Half the number of participants is needed than in independent measures
- Less time spent recruiting participants
How are order effects a weakness of repeated measures?
- Participants may do better or worse when doing a similar task twice
- Also, risk of fatigue/practice effects
- Reduces the validity of the results
How is the participants guessing aims a weakness of repeated measures?
- Participants may change their behaviour (please you/screw you effects)
- This may reduce the validity of the results
What is a matched pairs design?
Two groups of participants are used but they are also matched to each other based on characteristics that matter for the experiment
How are participant variables a strength of matched pairs?
- Participants matched on a variable that is relevant to the experiment
- This controls participant variables and enhances validity of the results
How is no order effects a strength of matched pairs?
- Participants are only tested once so no practice or fatigue effects
- This enhances the validity of the results
Matching isn’t always perfect. How is this a weakness of the matched pairs design?
- Matching is time-consuming and can’t control all relevant variables
- Cannot address all participant variables
How are more participants a weakness of matched pairs?
- Need twice as many participants as repeated measures for same data
- More time spent recruiting, which is expensive
What is a laboratory experiment?
- Lab experiments are conducted in highly controlled environments
- This is not always a lab - it could be a classroom, for example, where conditions can be well controlled
How is high control over CVs and EVs a strength of lab experiments?
- Means that the researcher can ensure that any effect on the DV is likely to be the result of manipulation of the IV
- Thus, we can be more certain about demonstrating cause and effect (high internal validity)
How is replication a strength of lab experiments?
- Possible due to high level of control
- This ensures new extraneous variables are not introduced when repeating an experiment
- Replication is vital to check the results of any study to see whether the finding is valid and not just a one-off
Lab experiments may lack generalisability. How is this a weakness of lab experiments?
- Lab environment = artificial and not like everyday life. Participants may behave in unnatural ways due to the unnatural environment, so behaviour cannot always be generalised (low external validity)
How are demand characteristics a weakness of lab experiments?
- Participants are usually aware they’re being tested in a lab experiment (though they may not know why)
- This may give rise to unusual behaviour, such as demand characteristics
How is low mundane realism a weakness of lab experiments?
- The tasks participants are asked to carry out may not represent everyday experience, e.g. recalling meaningless words
- This leads to low mundane realism
What is a field experiment?
- In field experiments, the IV is manipulated is a natural, more everyday setting
- The researcher goes to the participants’ usual environment
How is high mundane realism a strength of field experiments?
- Environment is more natural
- So field experiments may produce behaviour that is more natural and authentic
- This is especially the case as participants may be unaware they are being studied (high external validity)
How is loss of control over CVs and EVs a weakness of field experiments?
- A price to pay for increased realism is loss of control of variables
- This means cause and effect between the IV and DV in field studies may be much more difficult to establish and precise replication is often not possible
How are ethical issues a weakness of field experiments?
If participants are unaware they are being studied, they cannot consent to being studied and such research may lead to an invasion of privacy
What is a natural experiment?
- Natural experiments are like a lab or field experiment in that researchers measure effects of an IV on a DV
- HOWEVER, the researcher has no control over the IV and cannot change it - someone or something else causes the IV to vary, e.g. before and after a natural disaster
- It’s the IV that is natural, not necessarily the setting. The DV may also be naturally occurring
How is high external validity a strength of natural experiments?
- They involve the study of real-world issues and problems as they happen
- They also provide opportunities for research that may not otherwise be undertaken for practical or ethical reasons (e.g. Rutter’s Romanian orphans studies)
Participants may not be randomly allocated to experimental conditions (this only applies to independent measures). How is this a weakness of natural experiments?
- This means the researcher might be less sure whether the IV affected the DV. For example, in the study of Romanian orphans, the IV was whether the children were adopted early or late
- HOWEVER, there were lots of other differences between these groups, e.g. those who were adopted late may have been less sociable than the other children, which may have made them less appealing for potential parents
What is a quasi experiment?
- The IV is based on an existing difference between people (e.g. age or gender). Nobody has manipulated this variable and the IV cannot be changed, unlike in a natural experiment
- As with a natural experiment, the DV may be naturally occurring (e.g. exam results) or may be devised by the experimenter and measured in the field or a lab
What are the strengths and weaknesses of quasi experiments?
- They’re often carried out under controlled conditions and therefore share some strengths of a lab experiment (e.g. replication)
- Like natural experiments, quasi experiments cannot randomly allocate participants to conditions, so there may be confounding variables
- The IV is not deliberately changed by the researcher, so we cannot claim that the IV has caused any observed change
Define population in terms of sampling
The largest group of people that a researcher is interested in studying, e.g. college students from the North West
Define sample
It’s usually impossible to include all members of the population in the study, so a smaller group is selected (the sample)
Outline generalisation in terms of sampling
The sample that is drawn should be representative of the population, so generalisations can be made
Outline bias in terms of sampling
Most samples are biased in that certain groups (e.g. men, students etc.) may be overrepresented or underrepresented
Outline the process of random sampling
- Lottery method - all members of the target population are given a number and placed in a hat or computer randomiser is used
- Every person in the target population has an equal chance of being selected
How is random sampling being potentially unbiased a strength?
It means CVs / EVs are controlled, which enhances internal validity
How is random sampling being time consuming a weakness?
- Complete list of the population is hard to get
- Also, some participants may refuse to participate
Outline the process of systematic sampling
- Participants are selected using a set “pattern” (sampling frame)
- Every nth person is selected from a list of the target population (e.g. every 3rd person)
How is systematic sampling being unbiased a strength?
The first item is usually selected at random, making it an objective method
How is time and effort a weakness of systematic sampling?
A complete list of the population is required, which takes time, so may as well use random sampling
Outline the process of stratified sampling
- Sample reflects proportions of people in certain subgroups (strata) within a population
- Strata are identified, e.g. gender or age groups. The relative percentages of the subgroups in the population are reflected in the sample
How is stratified sampling being a representative method a strength?
The characteristics of the target population are represented, so generalisability is more likely than other methods
Stratification is not perfect. How is this a weakness of stratified sampling?
Strata cannot reflect all the ways in which people are different, therefore complete representation is not possible
Outline the process of opportunity sampling
- Sample = people who are most available, i.e. the ones who are nearest or easiest to obtain
- Ask people nearby, e.g. students in your class or people who walk past you in a shopping centre
Opportunity sampling is a quick method. How is this a strength?
It’s convenient because you just make use of the people who are closest. This makes it cheaper and one of the most popular sampling methods
How is opportunity sampling being inevitably biased a weakness?
- The sample is unrepresentative of the target population as it is drawn from a very specific area, e.g. one street in one town.
- This means that the findings can’t be generalised
Outline the process of volunteer sampling
- In a volunteer sample, participants select themselves
- This is done through advertising, e.g. advert in a newspaper
How is participants being more willing to participate a strength of volunteer sampling?
Participants have selected themselves and know how much time and effort is involved, therefore likely to engage more than people stopped in the street
How is volunteer bias a weakness of volunteer sampling?
Participants may share certain traits, e.g. want to be helpful, so respond to cues, making generalisations limited
Outline the 4 principles of the BPS code of conduct
- RESPECT - informed consent, confidentiality, deception only to protect the integrity of the research, right to withdraw
- COMPETENCE - caution in making knowledge claims
- RESPONSIBILITY - harm and debriefing
- INTEGRITY - honest and accurate
What is the issue of obtaining informed consent?
Allows informed judgement about whether to take part HOWEVER it may reveal the aims of the study
What is presumptive consent?
- Rather than getting consent from the participants themselves, a similar group of people are asked if the study is acceptable
- If this group agrees, then consent of the original participants is “presumed”
What is prior general consent?
- Participants give their permission to take part in a number of different studies - including one that will involve deception
- By consenting, participants are effectively consenting to be deceived
What is retrospective consent?
- Participants are asked for their consent (during debriefing) having already taken part in the study
- They may not have been aware of their participation or they may have been subject to deception
What is the issue of deception?
Deliberately misleading or withholding information so consent is not informed HOWEVER, mild deception is okay
What should be done at the end of a study to deal with the issue of deception?
Participants should be given a debrief, which should include :
- The true aims of the investigation
- Details that weren’t given during the study, e.g. existence of other groups or conditions
- What their data will be used for
- Their right to withdraw data
What is the issue of protection from harm?
Participants should be at no more risk than they would be in everyday life
What 3 things should be done in order to deal with the issue of protection from harm?
- Participants should be given the right to withdraw at each stage of the research process
- Should be assured that their behaviour was normal during debriefing
- Researcher should provide counselling if participants suffered physical or psychological harm
What is the issue of privacy and confidentiality?
We have the right to control information about ourselves - if this is invaded, confidentiality should be respected
What 4 things should be done to deal with the issue of privacy and confidentiality?
- If personal details are held, these MUST be protected (a legal requirement)
- Usually, no personal details are recorded
- Researchers refer to participants using numbers, initials or false names
- Participants’ personal data CANNOT be shared with other researchers
Define the floor effect
Sometimes the task is too hard, and the researcher may get a floor effect, because none of the participants can score at all / can’t complete the task - ALL PERFORMANCES ARE LOW
Define the ceiling effect
When the task is so easy that all participants achieve virtually full marks or top performances and are “hitting the ceiling”
Outline the observational technique
- A way of seeing or listening to what people do without having to ask them
- Observation is often used within an experiment to assess the DV
The observational technique captures what people do. How is this a strength of the observational technique?
- People often act differently from how they say they will in self-report methods
- Observations are useful as they give insight into spontaneous behaviour
There is a risk of observer bias with the observational technique. How is this a weakness and how can it be reduced?
- Researcher’s interpretation of the situation may be affected by expectations
- Bias can be reduced by using more than one observer
Outline the naturalistic technique for observation
Takes place where the target behaviour would normally occur
How is high external validity a strength of the naturalistic technique for observation?
- In a natural context, behaviour is likely to be more spontaneous
- Therefore, it’s more generalisable to everyday life
How is low control of variables a weakness of the naturalistic technique for observation?
- There may be uncontrolled CVs / EVs
- This makes it more difficult to detect patterns
Outline the controlled technique for observation
Some manipulation of variables including control of CVs / EVs
The controlled technique for observation can be replicated. How is this strength?
- More easily replicated due to standardised procedures
- Findings can be checked to see if they occur again