7. Research Methods Flashcards
Name the stages of the experimental/scientific method
- observe
- State expectations
- Design a study - See if your expectations were correct
What are the types of experiment?
- Laboratory experiments
- Field experiment
- Quasi experiments
- Natural experiments
What is a laboratory experiment ?
- In a very highly controlled environment
- Researchers manipulate the IV
- They control the IV and DV
- This is the least valid and most realistic
What is a Field experiment?
- takes place in a natural, everyday setting
- researchers manipulate the IV and record the effect on the DV
What is a Quasi experiment?
- almost an experiment
- IV is based on an existing difference between people eg. gender
- no-one manipulates the IV but the DV is controlled
What is a natural experiment?
- take advantage of pre-existing IV
- IV is naturally occurring it would happen if the researcher wasn’t there. The DV is all not controlled.
- This is the most valid but least realistic.
Which of the types of experiment are most valid and most realistic? place in order
Least to most valid:
Most to least realistic:
Lab
field
Quasi
Natural
What are two weakness’ to laboratory experiments?
- Artificial and often involved a contrived situation. As a result, participants may not behave naturally, leading to lower ecological validity
- There is the possibility of participant effects, investigator effects and demand characteristics because of the artificial cal situation.
Give two strengths of laboratory experiments.
- well controlled so extraneous/confounding variables are minimalised. This means that there is higher internal validity.
- Can be easily replicated to see if the same results occur, demonstrating external validity.
Give four weakness’ to field experiments.
- more time consuming and therefore more expensive than laboratory experiments
- Less control over extraneous / confounding variables than lab experiments which reduces internal validity.
- Many of the lab experiments also apply eg. IV may lack realism
- Participants not being aware that they are being studied leads to a major ethical issue.
What are two strengths to field experiments?
- Less artificial than lab experiments and usually higher in mundane realism and therefore ecological validity
- Participants are usually not aware of being studied so their behaviour is more natural.
What are 2 strengths of natural experiments?
- Allow research to be done where the independent variable can’t be manipulated for ethical or practical reasons
- Enables psychologists to study the ‘real’ problems such as the effects of a disaster on health, so there is increased mundane realism and ecological validity.
What are 4 weakness’ of natural experiments?
- cannot demonstrate casual relationships because the independent variable is not deliberately manipulated
- random allocation of participants to conditions is not possible. There may be confounding variables that are uncontrollable which compromises internal validity.
- the same may have unique characteristics, such as being part of a particularly helpful and pro-social community, meaning that the findings can’t be generalised to others to other groups of people.
- can only be used where conditions vary naturally
What are 5 weakness’ of quasi experiments?
- can only be used where conditions vary naturally
- participants may be aware of being studied, thus reducing internal validity
- The dependent variable may be a fairly artificial task, reducing mundane realism and ecological validity
- random allocation of participants to conditions is not possible. therefore there may be confounding variables that can’t be controlled which compromises internal validity
- Cannot demonstrate causal relationships because the independent variable is not deliberately manipulated
What is a strength to quasi experiments?
It allows comparison between different types of people.
What are the types of validity ?
- Internal validity
- control validity
- construct validity
- mundane realism
- external validity
- Ecological validity
- Population validity
- historical validity
Define - internal validity
what happens inside the study
Define - control validity
If the independent variable caused the effect. (however if any other factors caused an effect on the dependant variable)
Define - construct validity
how solid the idea behind the study actually is (if another test gives better results than it lacks construct validity)
Define - mundane realism
the extent that the study reflects the real-world
Define - external validity
how well you can generalise from research participants to people, places and times outside the study these can all be effected by internal validity
Define - ecological validity
how well you can generalise to different places and settings
Define - population validity
how well you can generalise to different people or populations
Define - historical validity
how well you can generalise to different times
What are three ethical issues when conducting research?
- people under 16 - obtain informed content - debrief after telling any deception and allowing withdrawal of data
What are three aspects of internal validity?
- Whether the IV produced the change in the DV - Whether the researcher is really testing what she of he intended to test - Whether the study possessed (or lacked) mundane realism.
What are the three types of external validity?
- ecological - population - historical
Define - Hypothesis
A statement of what the researcher believes to be true.
What is a confederate ?
An individual in a study who is not a real participant and has been instructed how to behave by the investigators
Define - diectional hypothesis
States the direction of the predicted difference between two conditions or two groups of participants
Define - non-directional hypothesis
Predicts simply that there is a difference between two conditions or two groups of participants, without stating the direction if the difference
What is a pilot study?
A small-scale trial run of a study to test any aspects of the design, with the view of making improvements.
When would you use a directional hypothesis?
When past research (theory or a study) suggests that the findings will go a certain direction as it makes sense to frame the hypothesis in the direction indicated.
When would you use a non-directional hypothesis?
When there is no past research or past research is contradictory. More appropriate if exploring a new area where informed expectations about how people might behave have yet to be established through research.
Why are pilot studies done?
In order to find out if certain aspects of the design do or don’t work. These use a few typical participants and sabe investing a large amount of time and money into a full scale experiment.
Define - Counterbalancing
An experimental technique used to overcome order effects when using a repeated measures design. Counterbalancing ensures that each condition is tested first or second in equal amounts.
Define - Experimental design
A set of procedures used to control the influence of factors such as participant variables in an experiment.
Explain the independent groups design
When participants are allocated to two (or more) groups representing different levels of the IV. Allocation is usually random techniques.
Explain the matched pairs design
Pairs of participants are matched in terms of key variables such as age and IQ. One member of each pair is allocated to one of the conditions under test and the second person is allocated to the other condition.
What is an order effect?
In a repeated measures design, an extraneous variable arising from the order in which conditions are presented eg. a practice effect or fatigue effect.
Define - Random allocation
Allocating participants to experimental groups or conditions using random techniques.
Explain the repeated measures design
Each participant takes part in every condition under the test ie. each level of the IV.
Define - Demand characteristics
A cue that makes participants unconsciously aware of the aims of the study or helps participants work out what the researcher expects to find
Define - investigator effects
AKA investigator / experimenter bias Anything that an investigator does that has an effect on a participants performance in a study other than what was intended. This includes direct effects and indirect effects. Investigator effects may act as a confounding or extraneous variable.
Define - Direct effects
As a consequence of the investigator interacting with the participants.
Define - Indirect effects
As a consequence of the investigator designing the study
Define - Bias
A systematic distortion
Define - generalisation
Applying the findings of a particular study to the population
What is opportunity sample?
A sample of participants produced by selecting people who are most easily available at the time of the study
What are the types of sampling?
- Opportunity - Random - Stratified - Systematic - volunteer
Define - population
The group of people that the researcher is interested in. The group of people about whom generalisations can be selected.
What is random sampling?
A sample of participants produced by using a random technique such that every members of the target population being tested has an equal chance of being selected.
What is stratified sampling?
A sample of participants produced by identifying subgroups according to their frequency in the population. Participants are then selected randomly from the subgroups / levels.
Define - sampling
The method of participants, such as random, opportunity and volunteer sampling, or to sample behaviours in an observation such as an event or time sampling
What is systematic sampling?
A sample obtained by selecting every nth person. This can be a random sample if the first person is selected using a random method; you then select every nth person after that.
What is volunteer bias?
A form of sampling bias (distortion) because volenteer participants have special characteristics, such as usually being more highly motivated than randomly selected participants.
What is volunteer sampling?
A sample of participants that relies solely on volunteers to make up the sample. Also called a self-selected sample.
What is another name for volunteer sampling?
Self-selected sample
What are the limitations of the independent group designs?
- You need more participants than a repeated measures design in order to end up with the same amount of data. - One of the tests may be more difficult than the other so that is why the same participants do better in one condition - No control of participants variables. Which could act as a confounding variable.
What are the stengths of the independent group designs?
- participants are unlikely to guess the aims of the experiment because they only take part in one group. therefore they are less likely to show demand characteristics so the results are more likely to be valid - There would be no order effects because each participant only does one condition - It doesn’t matter if one test is more difficult than the other because different participants take part in the different groups. - Because there are different participants in each of the conditions, they can be tested at the same time, saving time and effort.
What are the limitations of the repeated measures design?
- The order of the conditions may affect performance (an order effect) - As participants do all the conditions, they may guess the aim of the experiment, which may affect their behaviour. - One of the tests may be more difficult than the other so that is why the same participants do better in one condition - A gap may be needed between conditions to counter the effects of boredom or fatigue. Each condition may also need different materials
What are the strengths of the repeated measures design?
- Controls participants variables because the same participants are in all conditions - You only need half the participants as an independent group and match pairs design.
What are the limitations of the match pairs designs?
- Very time consuming and difficult to match participants on key variables. The researcher probably has to start with a large group of participants to ensure that they can obtain matched pairs on key variables. - It is not possible to control all participants variables because you can only match on variables known to be relevant, but it could be that others are important
What are the strengths of the match pairs designs?
- controls some important variables (ones that the researcher can think of before the experiment)
How can you combat weaknesses of the repeatable measures design?
Counterbalancing - ABBA to deal with order effects - avoiding participants guessing the aims of a study, a cover story can be presented about the purpose of the test.
How can you combat weaknesses of the independent groups design?
Randomly allocate participants to conditions which (theoretically) distribute participant variables evenly.
How can you combat weaknesses of the matched pair design?
- Restricting the number of variables to match on to make it easier and quicker. - Conduct a pilot study to consider key variables that might be important when matching
What does counterbalancing do?
Ensures that each condition in a repeated measures design is tested first or second in equal amounts, if participants do the same memory test in the morning then in the afternoon we might expect they would get better as they have practiced - this is called an order effect. To combat you should have two conditions and so AB BA or ABBA to get an average over all.
What are the two types of counterbalancing?
AB BA - do A then B or B then A ABBA - Do A then B then B then A
what are three ways you can deal with problems of demand characteristics and investigator effects?
- Single blind design - Double blind design - Experimental realism
Define - single blind design
The participant is not aware of the research aims and/pr of which condition of the experiment they are receiving. This prevents the participant seeking cues about the aims and reacting to them
Define - Double blind design
Both the participant and the person conducting the experiment are ‘blind’ to the aims and/or the hypothesis. therefore the person conducting the investigation is less likely to produce cues about what he/she expects.
Define - Experimental realism
If the researcher makes an experimental task sufficiently engaging the participant pays attention to the task and not the fact that they are being observed.
Define - Participant variables
Any characteristic of individual participants. They only occur in independent group designs as they are controlled in the other designs. Eg. Age, Intelligence, motivation, experience and gender.
Define - situational variables
Features of a research situation that may influence participants’ behaviour and thus act as EV or CVs. They are only CV if they vary systematically with the IV.
What are the strengths of opportunity sampling?
- Easiest method - as use the first suitable participants - Less time consuming
What are the limitations of opportunity sampling?
- Inevitably biased as sampling is drawn from a small part of the population
What are the strengths to random sampling?
- Unbiased as all members of the target population have an equal chance of selection
What are the limitations of random sampling?
- Need a list of all the members of the population and then contact all of those selected which is very time consuming
What are the strengths of stratified sampling?
- Likely to be more representative and there is a proportional and randomly selected representation of the subgroups.
What is the limitation of satisfied sampling?
- Very time consuming to identify subgroups, randomly select then contact - Also some subgroups may be less inclined to help than others.
What is the strength of systematic sampling?
- Unbiased as participants are selected using an objective system.
What is the limitation of systematic sampling?
- Not truly unbiased/random unless you select a number using a random method and start with this person then every nth person - Also the list may be in an order so wouldn’t give a generalised response
What is the strength of volunteer sampling?
- Gives access to a variety of participants which may make the sample more representative and less biased.
What is a limitation of volunteer sampling?
- sample is biased in other ways because participants are likely to be more highly motivated and/or with extra time on their hands. They might be more highly motivated to be helpful, or more broke and needing the money offered for participation. This could result in volunteer bias
What are the three types of random techniques?
- The lottery method 2. Random number table 3. Random number generators
What is the lottery method?
Draw numbers ‘out of a hat’
How is the lottery method taken out?
- Obtain a list of all the people in the population. This may simply be the names of all the people in your school 2. Put the names in a lottery barrel or hat. 3. select the number of names required
What is a random number table?
A printed table of numbers.
How is a random number table made?
- Every member of the population is given a number 2. The starting position in the table is determined blindly by placing your finger anywhere. 3. If your population is less than 100 you only need to look at two digit numbers.
What is a random number generator?
A calculator with the function of generating a random number.
How do you generate a random number?
- Number every member of the population 2. Using for example excel type = RAND(100) to get a random number 1-100.
What are ethical issues?
Conflicts about what is acceptable. Everyone conducting an experiment is expected to be aware of their responsibility to ensure participants are treated in an ethically appropriate way.
What is the BPS?
British Psychological Society It outlines the ethical standards that must be abided by.
What are the BPS standards? and explain.
- Respect for the dignity and worth of all persons. Including standards of privacy and confidentiality and informed consent. 2. Competence - high standards should be maintained in the psychologists professional work. 3. Responsibility - They have a responsibility to their client, the general public and to the science. This includes protection from physical or psychological harm as well as a debriefing. 4. Integrity - Honest and accurate including reporting the findings and any limitations and bringing incidents of misconduct to the attention of the BPS.
What were the BPS standards?
- Respect 2.Competence 3. Responsibility 4.Integrity
What is informed consent for researchers?
Revealing the true aims of the study or at least telling participants what is actually going to happen. However this may cause participants to guess the aim of the study and so they may not always want to reveal the true aims or even the full details of what is going to happen.
What is informed consent for the participants?
The believe they should be told what they will be required to do in the study so that they can make an informed decision about whether they wish to participate. They say it is a basic human right. This also means they can predict the risks or benefits of taking part in any study.
Explain deception from the researchers point of view.
It may be necessary to hide the true aims otherwise participants may alter their behaviour and the study could be meaningless. A distinction should be made between withholding some details and providing false information.
Explain deception from the participants point of view.
It is unethical as they should not deceive anyone without good reason. They may be able to give consent without all the details and so may be caused harm. They may also lead to the belief that psychologists are untrustworthy.
What did Diana Baumrind state?
1985 Argued deception was morally wrong on the basis of three generally accepted ethical rules in western society: - The right to informed consent - The obligation of researchers to protect the welfare of the participant - The responsibility of researchers to be trustworthy
Define - Confidentiality
Concerns the communication of personal information from one person to another, and the trust that the information will be protected.
Define - Deception
A participant is not told the true aims of a study, eg. what participation will involve, and thus cannot give truly informed consent.
Define - Informed consent
Participants must be given comprehensive information concerning the nature and purpose of the research and their role in it, in order that they can make an informed decision about whether to participate.
Define - Privacy
A person’s right to control the flow of information about themselves.
Define - Protection from harm
During a research study, participants should not experience negative physical or psychological effects, such as physical injury, lowered self-esteem or embarrassment
Define - Right to withdraw
Participants can stop participants in a study if they are uncomfortable in any way. This is especially important in cases where it not possible to give fully informed consent. Participants should also have the right to refuse permission for the researcher to use any data they produced.
Explain the right to withdraw from the researchers perspective
if participants do leave during the study this will bias the results because the participants who have stayed are likely to be more obedient, or they might be more hardy - leading to a biased sample.
Explain the right to withdraw from the participants perspective
It is important as if they feel uncomfortable or distressed they should be able to withdraw. This is especially important if they have been deceived and or if it is not the way it had been previously believed. This right is often compromised by payment and so it may become harder to withdraw.
Explain the protection from physical and psychological harm in the eye of the researcher
Some of the more important questions in psychology may involve a degree of distress to participants. It is also hard to predict the outcome of certain procedures and so the guarantee is hard.
Explain the protection from physical and psychological harm for the participants
Nothing should happen to them during a study that causes harm. There are many ways that physical or psychological harm can be caused and it is seen as acceptable if the risk of harm is no greater than a participant would be likely to experience in ordinary life and if the participant is in the same state after the experiment as before it t, unless they have been given their informed consent to be treated otherwise.
Explain what confidentiality is in the view of the researcher
It is difficult to protect confidentiality as the researcher wishes to publish his findings. They may make a point of guaranteeing anonymity however it is sometimes easy to know who was involved in the study.
Explain what confidentiality mean for the participant
The data protection act makes confidentiality a legal right. It can only be acceptable for personal data to be recorded if the data are not made available in a form that identifies the participant.
What does the data protection act do?
This makes confidentiality a legal right. It can only be acceptable for personal data to be recorded if the data are not made available in a form that identifies the participant.
Explain what privacy means for the researcher
It may be difficult to avoid invasion of privacy when studying participants without their awareness for example a field experiment
Explain what privacy means for the participants
People do not expect to be observed by others in certain situations eg. when the privacy of their own homes, while they might expect this when sitting on a park bench in public.
State the strategies to deal with ethical issues
- Ethical guidelines (code of conduct) - Cost-benefit analysis - Ethics committees - Punishment
How do ethical guidelines prevent ethical issues?
The BPS regularly update its ethical guidelines. The current version is the code of ethics and conduct (BPS 2009). The intention of such guidelines is to tell psychologists which behaviours are not acceptable and to give guidance on how to deal with ethical dilemmas
How does cost-benefit analysis help combat ethical issues?
We can judge the costs against the benefits to make sure that the results we get with out-way any problems caused by doing the experiment.
In what ways can we do cost-benefit analysis?
- Participants point of view - (where we list distress and lost of time versus payment and feeling of contribution) - Society at large - value of improving peoples lives versus the possibility that individuals may be harmed - Group of which the individual belongs - When investigating cultural differences it may not cause harm to the individuals as finding may bias treatment of the individuals cultural group (for good or bad)
How can ethics committees help combat ethical issues?
They must approve any study before it begins. It looks at all possible ethical issues raised in any research proposal and how the researcher aims to deal with them, weighing up the benefits of the research against the possible costs.
How can punishment’s combat ethical issues?
They may decide to bar the person from practicing as a psychologist. However it is not a legal matter and so they cannot be sent to jail.
What is the BPS code of ethics and conduct?
The BPS code of ethics identifies ethical issues but also relates them to a conduct.
What is the BPS’s view on informed consent?
It says that a failure to make full disclosure prior to obtaining informed consent requires additional safeguards to protect the welfare and dignity of the participants.
Which people may need special safe-guiding procedures in order to gain informed consent?
- Research with children (under 16) - Or if they have impairments that limit understanding and or communication to the extend of not being able to give consent.
What is the BPS’s view on deception?
The central principle is the reaction of participants when deception is revealed; if this leads to discomfort, anger or objections from participants then the deception is inappropriate
What in the eyes of BPS would make deception inappropriate ?
If this leads to discomfort, anger or objections from participants
What is BPS’s view on protection from harm?
If harm, unusual discomfort or other negative consequences for the individuals future life might occur, the investigators must obtain the disinterested approval of independent advisors, inform the participants and obtain the real informed consent from each of them
What are the drawbacks of ethical guidelines?
- Inevitably rather general as the virtual impossibility of covering every conceivable situation that a researcher may encounter. - They also absolve the individual researcher of any responsibility because the researcher can simply say ‘i followed the guidelines’
What is the Canadian’s approach on ethical guidelines?
They present a series of hypothetical dilemmas and invite psychologists to discuss these.
What is the strength of the Canadian approach on ethical guidelines?
It encourages debate, whereas the BPS and APA approach tends to close off discussions about what is right and wrong because the answers are provided.
What is the drawbacks of cost-benefit analysis?
- It is difficult to predict noth costs and benefits prior to conducting the study. - This difficulty continues after. - It is hard to quantify each eg. a persons distress cost.
What did Diana Baumrind argue in terms of the cost-benefit analysis?
1959 - It solves nothing as you simply exchange one set of dilemmas for another. - Said to legitimise unethical practices - Eg. suggesting deception and harm are acceptable in many situations provided the benefits are high enough
How can you deal with informed consent?
- Participants askes to formally indicate their agreement to participate. This should contain comprehensive information concerning the nature and purpose of the research and their role - Or you can gain presumptive consent - They must also offer the right to withdraw
What are the limitations of methods to deal with informed consent?
- The full information may invalidate the purpose of the study - It does not guarantee that participates really understand what they are getting themselves in for - Presumptive consent may just be what they think will be okay but this may be different when the participant actually experiences it
How do you deal with deception?
- The need for deception should be approved by an ethics committee, weighing up benefits against costs - The participants should be fully debriefed after the study. - This should give them an opportunity to discuss concerns and to withhold their data from the study - This is a form of retrospective informed consent.
What are the limitations with the methods of dealing with deception?
- Cost-benefit decisions are flawed as they involve subjective judgements and some may not be apparent until after the study - Debriefing doesn’t turn the clock back they may feel embarrassed or have a lowered self-esteem after the study
How can you deal with the right to withdraw?
- Participants should be informed at the beginning of the study that they have the right to withdraw at any point of the study without giving a reason.
What are the limitations of dealing with the right to withdraw?
- Participants may feel they cant as it may spoil the study - In many studies the participants are paid of rewards in some way and so they may not be able to withdraw.
How can we deal with protection from harm?
- Avoid any risks greater than experiences in everyday life - Stop the study if harm is suspected
What are the limitations of the methods to protect from harm?
Harm may not be apparent at the time of the study and only judged later with hindsight
How can we deal with the problem of confidentiality?
Researchers should not record the names of any participants and should use numbers or false names.
What are the limitations of the method to combat confidentiality?
Sometimes possible to work out who the participants are using information that has been provided. Therefore, confidentiality may not be possible
How can we combat the problem of privacy?
Do not study anyone without their informed consent unless it is in a public place and public behaviour
What are the limitations with the methods of combatting privacy?
There is no universal agreement about what constitutes a public place