research methods Flashcards
aim
a general expression of what the researcher intends to investigate.
independent variable
the aspect of the experiment that the researcher changes or manipulates.
dependent variables
the data that the researcher measures
extraneous variables
a variable other than the IV that may affect the DV and should therefore be controlled.
hypothesis
a prediction or a testable statement about what the researcher thinks will happen.
null hypothesis
predicts there will be no difference between the groups.
alternative hypothesis
predicts a difference or a relationship between groups/ conditions.
(alternative) directional hypothesis
predicts a difference/ relationship between groups/ conditions and states the direction of the difference.
(alternative) non-directional hypothesis
predicts a difference/relationship between groups but does not state the direction of the difference.
lab experiment
artificial experiment
controlled/standardised procedure
researcher manipulates IV i measure the effect of the DV
p’s know they are in a study
field experiment
IV is manipulated.
carried out in a natural environment.
p’s don’t know they are in an experiment.
natural experiment
in a natural environment.
IV is naturally occurring (eg natural disaster).
quasi experiment
in either lab or natural environment.
IV is something that naturally occurs within a person (characteristic).
cannot randomly allocate p’s to conditions.
internal validity
how much the IV affects the DV alone and caused a changed
mundane realism
the extent to which the TASK is representative of that behaviour in the real world.
ecological validity
the extent that the results can be generalised to another setting
demand characteristics
cues in the environment that may reveal the aim of the experiment causing participants to change behaviour.
experimental designs
refers to how participants are organised across the conditions
independent groups
each participant takes part in one condition only
repeated measures
each participant takes part in both conditions
matched pairs
each participant only takes part in one condition only, but participants are matched on variables considered relevant (age, gender,IQ)
experimental realism
whether an experiment has a psychological impact and “feels real” to participants.
confounding variables
variables apart from the IV that have affected the DV
uncontrolled variables
variables that cannot be controlled for. eg participants mood
situational confounding variables
features of the experimental situation
participant confounding variables
are do to with differences between participants
other types of extraneous variables
researcher bias, demand characteristics, order effect.
investigator effects
where a researcher acts in a way to support their prediction. this can be particular problem when observing events that can be interpreted in more than one way.
random allocation
each person has an equal chance of being put into either condition
standardised procedure
the process in which procedures used in research are kept the same, allows for replication to determine reliability.
randomisation
presenting any stimuli in an experiment in a “random manner” to avoid it having an effect on the DV, prevents order effects and situational extraneous variables.
single blind test
participants don’t know which condition of a study they are in, prevents demand characteristics.
double blind test
neither participants nor investigators know which condition the participants are in, prevents researcher bias.
target population
the group of people the researcher wants to study.
a sample
a small group of people who represents the target population and who is studied.
random sampling, how is it done?
where every member of the target population has an equal chance of being chosen.
how:
1. need a sampling frame, a complete list of all members of the target population is obtained.
2.all the names are assigned a number.
3.sample is selected randomly.
opportunity sampling, how is it done?
recruiting anyone who happens to be available at the time of your study.
how:
•researcher goes somewhere they are likely to find their target population and ask people to take part.
volunteer sampling, how is it done?
when people actively volunteer to be in a study by responding to a request which has been advertised by the researcher.
how:
p’s self select by responding to an advert
systematic sampling, how is it done?
involves selecting names from the sampling frame at regular intervals.
how:
1. list of people in the target population organised.
2. a sampling system is nominated.
3. researcher then works through the sampling frame until the samples complete.
stratified sampling, how is it done?
participants are selected from different subgroups in the target population in proportion to the subgroups frequency in the population.
reliability
refers to the extent to which something is consistent.
test-retest reliability
measures test consistency; the reliability of a test measured over time.
inter-rarer reliability
the degree of agreement among raters.
validity
refers to the extent to which something is measuring what it is claiming to measure.
external validity
refers to the extent the results can be generalised to other settings.
population validity
describes how well the sample can be generalised to a POPULATION as a whole.
temporal validity
refers to whether the findings are still valid TODAY.
lab experiment advantages
•can control extraneous variables increasing internal validity.
•standardised procedure so replication can be done to see if the findings are reliable.
lab experiment disadvantages
•low ecological validity.
•lack mundane realism.
•p’s knowing they are being tested could cause demand characteristics.
field experiment advantages
•environment is natural so higher ecological validity.
•p’s don’t know they are being tested reducing demand characteristics.
field experiment disadvantages
•less control of extraneous variables decreasing internal validity.
•ethical issues if p’s are unaware they are in an experiment.
natural experiment advantages
•provides opportunities that might not otherwise be available.
•high ecological validity as it’s a real-life event.
natural experiment disadvantages
•difficult to establish the cause.
•event may happen very quickly.
•p’s may not be randomly allocated.
quasi experiment advantages
•carried out in often controlled conditions
quasi experiment disadvantages
•p’s cannot be randomly allocated resulting in participant confounding variables.
independent groups strengths
• reduced demand characteristics.
•minimises order effects. eg no practise/fatigued
independent groups weaknesses
•participant extraneous variables
•less economical/ time consuming as you need more p’s
repeated measures strengths
•participant extraneous variables are controlled for
•less p’s needed so less time consuming/expensive
repeated measures weaknesses
•order effects
•demand characteristics
matched pairs strengths
•order effects and demand characteristics
•participant extraneous variables are reduced
matched pairs weaknesses
•the p’s cannot be truly matched.
•time consuming and expensive.
matched pairs weaknesses
•the p’s cannot be truly matched.
•time consuming and expensive.
random sampling advantage
lack of researcher bias
disadvantages of random sampling
•impractical (time and effort).
•not completely representative.
advantages of opportunity sampling
•simple and easy to conduct.
•field/natural experiments must use those available.
disadvantages of opportunity sampling
•unrepresentative.
•researcher bias.
advantages of volunteer sampling
•most convenient.
•reach a wider audience.
disadvantages of volunteer sampling
•biased sample
eg particular interest, altruistic
advantages of systematic sampling
•no researcher bias.
•simple (with sampling frame).
disadvantages of systematic sampling
•not completely random so not representative.
advantages of stratified sampling
•most representative.
disadvantages of stratified sampling
•knowledge of population characteristics required.
•time consuming.
construct validity
refers to the degree to which a test measures what it claims, or purports, to be measuring.
concurrent validity
asks whether a measure is in agreement with a pre-existing measure that is validated to test for the same concept.
predictive validity
the degree to which a test accuracy predicts a criterion that will occur in the future.
face validity
where you apply a superficial and subjective assessment of whether or not your study or test measures what it is supposed to measure.
case study
involves the detailed study of a single individual or a small group of people
what kind of data is collected in a case study
qualitative
what methods are used within a case study
uses a mixture of research methods: interviews,observations,questionnaires or psychological testing to asses what they are capable of
trigangulation
using more than one method to check the validity of the findings
how can a case study be so powerful
one single case study can refute a whole theory
longitudinal study
they follow the individual or group over an extended period of time
strengths of longitudinal study
allows to look at changes over time
limitations of longitudinal study
ps may drop out, which can lead to a small sample size (attrition rate)
Strengths of case studies
✓ They offer high levels of validity as they go into depth and give a rich insight.
✓ They allow multiple methods to be used (triangulation) = increasing validity.
✓ They allow researchers to study events or complex psychological areas they could not practically or ethically manipulate.
✓ Efficient as it only takes one case study to refute a theory.
Limitations of case studies
-Researcher bias: researchers can become too involved and lose their objectivity - misinterpreting or influencing outcomes.
-Lack of control: there are many confounding variables that can affect the outcome.
-As they are unique they can be difficult to replicate and therefore lack scientific rigour.
What is observation
A researcher will simply observe behaviour of a sample and look for patterns.
Like all non-experimental methods, in an observation we cannot draw cause and effect relationships.
How can observation be used
Observations are used in psychological research in one of two ways, a method or a technique.
Participant reactivity
a type of reactivity in which individuals modify an aspect of their behavior in response to their awareness of being observed.
Inter-rate reliability
To make observational data more objective and unbiased, there should be at least two observers. They should then compare their data at the end. The correlation should be as close to 1.0 (0.8 minimum) to have good reliability.
Naturalistic observations
observation of behaviour in its natural setting. The researcher makes no attempt to influence the behaviour of those being observed. It is often done where it would be unethical to carry out a lab experiment.
Strengths of naturalistic observation
⇒ High levels of ecological validity as carried out in a natural setting
⇒ P’s are less likely to be affected by demand characteristics as they are unaware they are being studied
Limitations of naturalistic observation
⇒ Little control over EVs - hard to establish causality
⇒ Replication is often not possible - cannot check reliability of the findings
Controlled observation
This refers to an observation-taking place in a controlled setting, usually behind a one way mirror so they cannot be seen.
Strengths of controlled observations
⇒ There is less risk of extraneous variables effecting the behaviour as it is in a controlled environment
Limitation of controlled observation
⇒ The setting is artifical and therefore may lack ecological validity
Structured observation
The observer creates a behaviour checklist in order to code the behaviour they are observing. They can use time or event sampling.
What is a behavioural checklist
researchers will use a standardised behaviour checklist to record the frequency of those behaviours. The target behaviour is split up into a set of behavioural categories
Criteria for behavioural checklist
⇒ Be observable (record explicit actions)
⇒ Have no need for inferences to be made
⇒ Cover all possible components behaviours
⇒ Be mutually exclusive/ not overlap (not having to mark two categories at the same time)
What is a pilot study
A pilot study allows you to practise using the behaviour checklist/ observation schedule.
Event sampling
counting each time a particular behaviour is observed.
Strength of event sampling
Useful when the target behaviour or event happens infrequently and could be missed if time sampling was used.
Limitation of event sampling
if the situation is too busy and there is lots of the target behaviour occuring the researcher could not record it all
Time sampling
recording behaviour at timed intervals
Strength of time sampling
The observer has time to record what they have seen
Limitation of time sampling
Some behaviours will be missed outside the intervals - observations may not be representative.
Strengths of structured observation
⇒ The behavioural checklist (coding system) allows objective quantifiable data to be collected which can be statistically analysed
⇒ Allows for more than one observer (due to checklist) which can increase the reliability (inter-observer reliability)
Limitation of structured interviews
⇒ The pre-existing behavioural categories can be restrictive and does not always explain why the behaviour is happening
Unstructured observation
The observer note down all the behaviours they can see in a qualitative form over a period of time. No behavioural checklist is used.
Strength of unstructured observation
⇒ They can generate in-depth, rich qualitative data that can help explain why the behaviour has occurred
⇒ Researchers are not limited by prior theoretically expectations
Limitations of unstructured observation
⇒ The observer can get drawn to eye catching behaviours that may not be representative of all behaviours occurring
⇒ More subjective and less comparable across researchers
Overt observation
Participants are aware that their behaviour is being studied, the observer is obvious.
Strengths of overt observation
⇒ It will better fulfil ethical guidelines (compared to covert)
Limitations of overt observation
⇒ Participants know they are being observed and therefore they may change their behaviour (participant reactivity)
Covert observation
Participants are unaware that their behaviour is being studied – the observed is covered.
Strength of covert observation
⇒ P’s do not know they are being observed and therefore their behaviour is more likely to be natural (higher validity)
Limitation of covert observation
⇒ It can break many ethical guidelines as deception is used it may cause the p’s some psychological harm
Participant observation
The observer becomes involved in the participant group and may not be known to other p’s.
Strength of participation observation
⇒ Being part of the group can allow the researcher to get a deep understanding of the behaviours of the group (increasing validity).
Limitations of participant observation
⇒ The presence of the researcher might influence the behaviour of the group.
⇒ The researcher may lose objectivity as they are part of the group.
Non-participant observation
The observer is separate from the participant group that are being observed.
Strength of non-participant observation
⇒ Researchers observations are likely to be more objective as they are not influenced by the group
Limitation of non-participant observation
⇒ It is harder to produce qualitative data to understand the reasons for the behaviour
self reports
methods of gathering data where participants provide information about themselves
eg thoughts, feelings or opinions can be done in written or oral form: questionaires, interviews
what is psychometric measure
tests that have been assessed for validity and reliability
Strengths of self report
⇒ It allows ppts to describe their own experiences which provides rich
(qualitative) data about complex human behaviour
⇒ It can help explain the reasons behind behaviour (answers the why)
⇒ It can be an easy way to gather a large amount of data and therefore increase generalisability
⇒ You can ask people hypothetically what they would do without having to set up an experiment and observe behaviour
Limitations of self report
⇒ Ppts may try to come across in most socially acceptable way (social desirability bias) which can lead to giving untruthful responses and lowering the validity of the results
⇒ It is only useful if the ppt is willing to disclose the information
⇒ Self report relies on ppts to have the introspective ability to understanding their own thoughts and feelings
⇒ Acquiescence bias is often present - people tend to agree with statements
⇒ Ppts may misinterpret the questions (subjective)
What are questionnaires
Questionnaires are a written self-report technique where participants are given a pre-set number of questions to respond to. They can be administered in person, by post, online or to a group of participants simultaneously (in an experiment).
How does questions in a questionnaire be designed
Questions should progress logically from the least sensitive to the most sensitive and from the more general to the more specific. The researcher should ensure that the answer to a question is not influenced by previous questions.
What are closed questions
is when there are only a certain amount of choices available to answer. Closed questions give quantitative data and are easier to analyse.
What are open questions
produce qualitative data as they allow participants to give a full, detailed answer and there is no restriction on what the participants can say. Open questions could lead to ideas for further investigation. Respondents can find open questions less frustrating than forced choice
Standardised instructions
- These are a set of written or recorded instructions that are given to the participant to ensure that all ppts receive them in the same way.
- It is used as a control to standardise the procedure to increase the reliability and validity of the research.
What are filler questions
- Questions put into a questionnaire or interview to disguise the aim of the study.
- The purpose is to reduce demand characteristics.
Strengths of questionnaires
⇒ Social desirability bias is reduced as no interviewer is present and questionnaires are often anonymous
⇒ A large amount of data can be collated very quickly which can increase the representativeness and generalisability
⇒ Data can be analysed easier than interviews (if mostly quantitative)
Limitations of questionnaires
⇒ The options given may not reflect the p’s opinion and they may b forced into answering something which does not fit - lowering validity of the findings
⇒ The quantitative data produces less rich data than interviews
What is an interview
are self-report techniques that involve an experimenter asking participants questions (generally on a one-to-one basis) and recording their responses.
What are structured interviews
has predetermined questions. It is essentially a questionnaire that is deliver face-to-face (or over the phone).
What are unstructured interviews
has less structure. They may start with some predetermined questions and then new questions may develop during the interview depending on the answers given.
What are semi-structured interviews
is a mix of structured and unstructured and is often the most successful approach.
What is an interview schedule
Most interviews involve an interview schedule, which is the list of questions that the interviewer intends to cover. This should be standardised for each participant to reduce the contaminating effect of interviewer bias.
What is an interview transcript
Any audio recordings must be turned into written data which is called an interview transcript. This must protect anonymity.
What considerations need to be taken doe interviews
The interviewer should conduct the interview in a quiet room, away from other people, as this will increase the likelihood that the interviewee will open up.
What are the strengths of structured interviews
⇒ Standardised question means it can be replicated
⇒ Reduces differences between interviewers (consistency = higher reliability)
⇒ Quick to conduct
What are the limitations of structured interviews
⇒ Interviewers cannot deviate from the topic or elaborate points
⇒ Mainly produces quantitative data which lacks insight
What are the strengths of unstructured interviews
⇒ More flexibility allows for the collection of rich data which offers a deeper insight and for the interviewer to follow up, explore more or seek clarification
What are the limitations of unstructured interviews
⇒ Difficult to analyse as they produce lots of qualitative data. The researcher should demonstrate reflexivity.
⇒ Interviewees may not be truthful due to social desirability bias which lowers the validity of the findings
What is a correlational study
investigate whether there is a relationship or association between two variables (co-variables).
How do correlational studies differ from the experimental method
With experiments the researcher controls or manipulates the IV to measure the effect on the DV and therefore causality can be established. In correlational research there is no manipulation of one variable and thereofroe causaloty cannot be established.
There may be third intervening variables and we cannot establish which direction the relationship is.
How do you write a hypothesis for correlational research
When writing a hypothesis for correlational research you are stating whether
there is going to be a relationship or association between x and y.
Null = there will be no correlation
Directional = state whether it is positive or negative Non-directional = there will be a relationship / association
Data collection in correlational studies
● Secondary data e.g. population growth, people in employment
● Observational data e.g. the number of times someone displays a behaviour
● Questionnaires e.g. a standardised measure
● Brain scanning technologies e.g. amygdala activation
What graph is used to plot correlational data
Scatter graph
What does correlational data mean
The scatter of dots indicates the degree of correlation between the co-variables.
Perfect positive correlation = 1
High positive = 0.8
Low positive = 0.3
No correlation = 0
(Same for negatives)
What is a curvilinear relationship
Some relationships are curvilinear. This is where as one variable increases so does the other but only up to a certain point, after which, as one variable continues to increase the other decreases.
As a correlation coefficient would be 0
Strengths of correlational studies
● They can be used when it would be impractical or unethical to manipulate variables using another method
● It can make use of existing data (secondary), and so can be a quick and easy way to carry out research
● Often, no manipulation of behaviour is required. Therefore, it is often high in ecological validity because it is real behaviour or experiences.
● Correlations are very useful as a preliminary research technique, allowing researchers to identify a link that can be further investigated through more controlled research.
Limitations of correctional studies
Correlation does not equal causation - no cause and effect relationships can be inferred e.g. one variable cannot be said to cause an increase or decrease in the other variable. The relationship could be explained by a third intervening variable. Correlations are open to misinterpretation.
Normal distribution
A probability distribution bell-shaped curve. It is the predicted distribution when considering an equally likely set of results
0.5 = normally distributed
A positive skew
Where most of the distribution is concentrated towards the left of the graph resulting in a long tail on the right
Whale is going home
Rule with the mode, median and mean for positively skewed data
The median and mean is higher than the mode
Negative skew
Most of the data is concentrated on the right, resulting in the long tail of an anomaly scores on the left
Whale is going away from home
Rule with the mode, median and mean for negatively skewed data
The median and mean is lower than the mode
What are ethics
Concerned with what is right and wrong
When do ethical issues arise in psychological research and who governs it
- If there are conflicting values between the researcher and that participants
- submitted to the ethical panel at a university, use guidelines from the BPS
Saying to remember up your ethical guidelines
Can Do Can’t Do With Participants
What is informed consent, how should it be dealt with
- ps must be aware of what they are needed to do as part of the study in order to give valid consent, this means revealing the true aims of the study when appropriate
- obtain written consent and give ps an participant information sheet containing all the info they need to make an informed decision
- children/ people without mental capacity = next of kin
What is the right to withdraw and how should it be dealt with
Ps still have the right to leave the experiment at any point in time.
The ps must be made aware of this when they sign the consent form
What is deception, how should it be dealt with
Deliberately misleading or with holding information. Deceiving participants must be kept to a minimum. It will only be allowed to reduce demand characteristics, withholding details to avoid influencing behaviour is acceptable deliberately proving false information is not acceptable
What is a debrief, how should it be done
- if Connor be obtained, eg field experiment, participants must be fully debriefed afterward
- this involves telling the ps about the experiment and then giving them the option of withdrawing their info if they wish during debrief
Right to confidentiality/privacy, how should it be dealt with
- The communication of personal information from one person to another and the trust this will be data protected
- psychologists need to be sure the info they publish will not allow for ps to be identified
- a persons right to control the flow of information about themselves. We expect privacy in certain situation.
- if the research is in a public space the research will be granted permission as long as it does not invade privacy
What is protection from harm, how should it dealt with
- participants should be no worse off when they leave an experiment as to when they arrived
- risk is considered acceptable if it is no greater than what would be experienced in everyday life
- if harm is caused then ps should be signposted to relevant services.
How to write a consent form
Levels of data
The best level of data is interval, the worst is nominal
Nominal data
- Nominal level data is data that can be grouped into categories e.g. favourite lessons.
- There is no logical order to the categories.
- The most appropriate measure of average for this level of measurement is the mode.
Ordinal data
- Ordinal level data is data that is presented in ranked order (e.g. places in a beauty contest) but the values themselves have no meaning e.g. The person who comes 1st is not twice as beautiful at the person who comes 5th (out of ten competitors).
- The data may be subjective e.g. happiness scores.
Interval data
- Interval level data is measured in fixed units with equal distance between points on the scale. For example, time measured in seconds.
- Psychological tests which are standardised (psychometric test) e.g. IQ scores, are classed as interval