Research Methods Flashcards
What is the definition of content analysis?
A technique for systematically analysing various kinds of qualitative data (e.g. texts, films, emails, other media) The data can then be placed into categories and counted (quantitative) or analysed in themes (qualitative - known separately as thematic analysis)
What is time sampling?
Time sampling is a method of sampling behaviour in an observation study and is where an observer records behaviour at prescribed intervals. For example, every 10 seconds.
What is event sampling?
Event sampling is used to sample behaviour in observational research. It is where an observer records the number of times a certain behaviour occurs.
What is coding in content analysis?
- Watch the material and establish potential categories (if there are two psychologists they should do this separately)
- compare categories and agree on set ones.
-Carry out the content analysis separately and count the number of examples that fit into each category to produce quantitative data.
-The psychologists should then compare their answers to look for agreement and use an appropriate statistical test to analyse the reliability of their results.
What is Thematic analysis?
- researchers initially use coding to analyse the data, comparing the categories they find.
- they then find examples of emergent themes.
-Look back at sample and collect new set of data, then represent it appropriately and write it up in a report.
What is Inter-rater reliability ?
psychologists carry out content analysis separately, create categories and then compare their answers. Correlation of +0.8 is reliable.
What is Test-retest reliability?
The psychologist could conduct the content analysis (creating categories, and then recode them (create the categories again) at a later date and compare the two. Correlation of +0.8 is reliable.
What is Internal validity?
Whether the effects observed in a study are due to manipulation of the independent variable and not any other factor.
What is External validity?
Refers to how well you can generalise the results from research participants (apply the findings of a study) to people, places and times outside of the study.
What was Milgram’s 1963 experiment?
Aim: To see how far people would go in obeying an instruction if it involved harming another person.
Procedure: Two roles of either learner or teacher. Teacher is the participant and has to ask the ‘learner’ a series of questions. The teacher had to give an electric shock at each wrong answer, starting at 15V and ending at 450V (lethal)
Results: Two thirds of participants continued to the lethal voltage, and everyone continued to 300V.
What is the evaluation of Milgram’s study?
-Research tends to confirm Milgram’s original findings.
-High cultural validity when done around the world, except with women on women in Australia, which only had 16% obedience.
What is the My Lai study?
The My Lai massacre was where more than 500 Vietnamese citizens were killed in cold blood at the hands of US troops. People were tortured and raped, and it began with the command of Officer Calley. Calley was later the only one arrested for this atrocity.
What is triangulation?
The use of a number of different sources or evidence, e.g. data compiled from interviews with friends and family, personal diaries, observations etc.
Why do observations have a high ecological validity?
Because they use covert observations so there is minimal intervention from the researcher, as they cannot influence the participants behaviour.
What level of measurement is used for nominal data?
Mode
What level of measurement is used for ordinal data?
-Median
-Range
What level of measurement is used for Interval data?
-Mean
-Standard deviation
What is ordinal data?
Data on a numerical scale but without precise spacing e.g. scale of 1-10.
What is interval data?
Data based on a standardised scale with precise intervals e.g. numbers.
What is nominal data?
data that is in categories e.g. dogs, cats, rats.
What is the aim of statistical testing?
To determine the likelihood that the relationship found in the study is significant or due to chance.
What do we mean by ‘probability’
A numerical measure of the likelihood that a particular event will occur ranging from 0 to 1 where 0 indicated statistical impossibility and 1 indicates statistical certainty.
What is a significance level?
The point at which the researcher can claim to have discovered a significant difference or correlation within the data.
What does P<0.05 mean?
The probability that the observed effect (the result) occurred by chance (i.e. would have occurred if there was no difference or association in the data) is less than 5%.
Why can psychologists never be 100% about a certain result?
Psychologists can never be 100% certain about a particular result because they have not studied all members of the population under all possible circumstances.
- What values do psychologists compare in statistical tests?
In any statistical test that psychologists use, they compare the result of their test (the calculated value) to a critical value for the significance level that the psychologist has chosen.
What are the two types of hypothesis?
- null hypothesis (nothing will happen)
- alternative hypothesis (something will happen)
What are the two types of alternative hypothesis?
- directional hypothesis (predicting which way research will go)
- non-directional hypothesis (predicting there will be a difference, but not what it is.)
Why would you give a non-directional hypothesis?
if there is no previous research on the subject, or previous research is contradicting.
What is an extraneous variable?
does not vary systematically with the independent variable - any independent variable that may affect the dependent variable if not controlled.
What is a confounding variable?
A form of extraneous variable that varies systematically with the independent variable (big problem!!)
What are participant variables?
The differing individual characteristics of participants in an experiment e.g. age, mood
What are situational variables?
factors in the environment which could unintentionally influence the results of the study e.g. noise, light.
What is randomisation?
leaving variables such as the allocation of participants to tasks, sample selection etc. to chance in order to reduce investigator influence on the study.
What is standardisation?
All elements of procedure are kept identical in all conditions of the study.
What is single-blind design and what does it control for?
Participants don’t know what group they are in - controls for demand characteristics.
What is double-blind design and what does it control for?
neither investigator or participants know the aim of the study - controls for demand characteristics and investigator effects.
What are demand charactertistics?
Any cue from the researcher or research situation that may be interpreted to reveal the purpose of an investigation.
What are investigator effects?
Any effect of the investigators behaviour on the research outcome. This could be design of the study or interaction with participants.
What is the experimental method?
The manipulation of an IV to measure the effect on the DV. Experiments may be laboratory, field, natural or quasi.
What is a laboratory experiment?
occurs in a controlled environment with extraneous variables strictly controlled, measuring the effect of the IV (manipulated by researcher) on the DV.
What is a field experiment?
Occurs in a natural setting with researcher manipulating IV and measuring effects on DV.
What is a natural experiment?
Researcher records effects of change brought about by an IV that would have occurred anyway (e.g. earthquake) on a DV.
What is a quasi-experiment?
Almost an experiment, however the IV is naturally occurring between participants e.g. age
What are the strengths of a lab experiment?
- High control over confounding and extraneous variables (high internal validity).
- High levels of control makes results more replicable.
What are the weaknesses of a lab experiment?
- artificial environment so lacks generalisability.
- demand characteristics.
- low mundane realism.
What are the strengths of field experiments?
- high mundane realism
- participants unaware they’re being studied so high external validity.
What are the weaknesses of field experiments?
- Lacking control of extraneous and confounding variables, makes it hard to see cause and effect.
- Less replicable.
What are the strengths of natural experiments?
- opportunity for research which otherwise couldn’t take place due to ethical issues.
- high external validity.
What is the BPS code of ethics?
A quasi-legal document produced by BPS instructing UK psychologists what behaviours is acceptable concerning participants. Built around four major principles: respect, competence, responsibility, integrity.
What are the strengths of a quasi-experiment?
- easier to replicate as done in a lab condition.
What is temporal validity?
Whether the results of the research would still apply at a different point in time.
What are the weaknesses of natural experiments?
- participants cannot be randomly allocated to conditions, making cause and effect hard to see.
- lack of opportunity for them to occur, also makes results hard to generalise.
What are the weaknesses of a quasi-experiment?
- cannot randomly allocate participants to conditions, so could be confounding variables.
- IV has not been manipulated so we cannot claim any observed change.
What is ecological validity?
How well you can generalise the results of the study to different settings or situations - whether the research tells us what we want to know about.
What is face validity?
Whether a test appears to be effective in terms of its stated aims.
What is a volunteer sample? What is a strength and weakness?
Volunteers who respond via advertising.
+ A variety of variable e.g. age intelligence etc.
- people who volunteer are a certain type e.g. confident extroverted.
What is an opportunity sample? What is a strength and weakness?
Whoever is willing and most readily available.
+ The easiest way of getting a sample.
- may be biased
What is concurrent validity?
Whether the results of the study are in line with well-established measure looking into the same phenomena.
What is stratified sampling?
Composition of sample reflects the proportions of people in subgroups (strata) within the chosen population.
What is random sampling? What is a strength and weakness?
Random selection from target population e.g. drawing names from a hat.
+ Very little bias
- Time consuming
What is systematic sampling? What is a strength and a weakness?
Using an objective system to select participants e.g. every fifth house on a street.
+ Not biased
- Could fall onto an existing pattern e.g. every fifth house is a flat.
What is the strength and weakness of stratified sampling?
+ Most likely to be a representative unbiased sample.
- Time consuming and costly.
What is generalisation?
The extent to which findings can be broadly applied to the general population.
What is the difference between a population and a sample?
population - the group which whom the researcher is interested, from which the sample group is drawn, which is the group who actually participate in the experiment.
What is an experimental design?
How participants are allocated to the different conditions of the experiment.
What are the three different experimental designs? (+ brief description)
- Matched pairs (put in pairs based on potential extraneous variable.)
- independent groups (participants take part in one condition)
- repeated measures (participants take part in both conditions)
How do matched pairs work?
Participants put into pairs based on potential extraneous variable e.g. IQ based on pre-test result. Top two are paired and so on, then each are randomly allocated to either A or B.
Strengths and weaknesses of independent groups?
+ Participants less likely to produce demand characteristics.
+ No order effects
- less economical
- different participant variables in each group.
Strengths and weaknesses of matched pairs?
+ less order effects or demand characteristics.
- participants can never be matched exactly.
- less economical.
strengths and weaknesses of repeated measures?
+ participant variables controlled.
- confounding variable of order effects (could get tired)
- participants could work out aim, leading to demand characteristics.
How can repeated measures weaknesses be overcome?
- counterbalancing (half A->B, half B->A)
- time gap between conditions.
How can independent groups weaknesses be overcome?
- randomly allocate participants to conditions.
How can matched pairs weaknesses be overcome?
- Conduct pilot study to decide key variables for matching.
- restrict number of variables to match on.
What is interval data?
Based on standardised numerical scale with precisely defined units e.g. weight.
What is ordinal data?
Data on a numerical scale but where units are not precisely defined e.g. questionnaire results.
What is nominal data?
data in categories e.g. colours.
What are descriptive stats?
way of using numbers to describe the data you have.