Research Methods Flashcards
What is reliability?
How consistent findings from a controlled investigation are within itself and overtime
What is validity?
Extent to which a study is consistent in measuring what it claims to be, and if the findings can be generalised beyond the setting of study
What are the 2 types of internal validity?
Face validity and concurrent validity
What is face validity?
Extent to which a study appears to measure what it claims to
What is concurrent validity?
Extent to which test produces same results as an established measure
What are the 3 types of external validity?
Temporal validity, ecological validity, population validity
What is temporal validity?
Study generalised across time
What is ecological validity?
Study generalised to other settings or conditions
What is population validity?
Study generalised to other groups of people
What is the word associated with reliability?
Consistancy
What is internal reliability?
How consistent different parts of the test are within itself
What is external reliability?
How consistent a study is when replicated
How is external reliability assessed?
Test-retest reliability or inter-observer reliability
How does test-retest reliability work?
Test is given to participants and after a short interval same/similar test is given again
What should happen for something to have inter-observer reliability
Consistent results between observers/raters
How does inter-observer reliability work?
Observers agree on categories and independently observe/rate people at the same time
To have high reliability/validity, what must comparing date have?
A correlation coefficient of +0.8 or higher when tested for significance using Pearson’s R or Spearman’s Rho at the 5% level
What are ethical issues, and name the 4?
Conflict between participants’ rights and researchers’ need to gain valuable, meaningful and valid findings
Informed consent, deception, protection from harm, privacy/confidentiality
What is deception?
Deliberately misleading/withholding information
How are privacy and confidentiality dealt with?
Privacy- the participant has a right to control information they release
Confidentiality- data protection act, anonymity
What is the British Psychological Society (BPS) code of ethics and what do they do?
Quasi-legal document psychologists have a professional duty to observe. A cost-benefit analysis is done, with the cost being Ψ reputation ruined or participant damage and the benefit being valuable research.
If under 16, can consent be given?
Yes, by a parent
What is done to deal with informed consent?
A consent form
How is a consent form written?
In Verbaitim…
Dear Participant…
-Aim + procedure
-Can withdraw
-Can withdraw data
-Data anonymous
-Ask any questions
-Debrief at the end
Circle YES/NO
Name____
Sign____
Date____
What are 3 alternate ways of consent?
Presumptive consent- similar group consent, so consent of this group is presumed
Prior general consent- participants consent for a number of studies in one
Retrospective consent- consent in debreif
How is deception and protection from physical/psychological harm dealt with?
-full debrief with true aims, all info and right to withhold data
-reassure normal behaviour
-offer provided counselling
What is an aim, and how can one be written?
A general statement stating what the researcher intends to investigate- the purpose of the study
To investigate…
What is a hypothesis?
Stated at the start of a study, it’s a clear, precise and testable statement stating the relationship between the variables to be investigated
What are the 2 types of hypotheses?
Alternative
Null
What are the 2 types of alternative hypotheses?
Directional/one-tailed
Non-directional/two-tailed
What is a directional/one-tailed hypothesis, and when is one used?
Predicts specific outcome
Previous research done or a replication of research
What is a non-directional/two-tailed hypothesis, and when is one used?
There will be a difference… indicates no direction
No research done before or contradictory research
What is a null hypothesis?
Hypothesis that the research hypothesis is tested against, states that the researcher won’t find what they expect
What does operationalisation mean?
Clearly defining variables in terms of how they can be measured
Give 3 ways in which you can operationalise variables
Counting
Rating scales
Time period
What are extraneous variables?
All other variables/features of the research other than the IV/DV/variables studied that have the potential to affect the DV if not controlled. Doesn’t vary systematically with the IV.
What are confounding variables?
An EV that varies systematically with the IV, and affects the DV to the extent where the researcher is unsure if the IV is the true source of change to the DV.
What are the 5 types of confounding variables?
Participant variables
participant effects
Situational variables
Demand characteristics
Investigator effects
What are participant variables?
Individual differences in participants eg: age memory
Give 2 ways participant variables be controlled
Repeated measures design
Random allocation
What are participant effects?
Participant reactivity
Social desirability bias
Hawthorne effect (change due to attention)
Give 2 ways participant effects can be controlled
Single-blind trial
Experimental realism
What are situational variables?
Features of the research environment eg: time
Give 2 ways situational variables can be controlled
Pilot study
Standardised procedure
What are demand characteristics?
Cues that tell the participant what is expected of them/what the investigator hopes to find
Give 4 ways demand characteristics can be controlled
Pilot study
Standardisation
Experimental realism
Matched pairs design
What are investigator effects?
(Un)conscious cues from the investigator that impact the outcome of the study
What are direct investigator effects, and how can these be controlled (2)?
Unconscious cues given during interaction
Double-blind trial
Standardisation
What are indirect investigator effects, and how can these be controlled (3)?
Bias in the research design
Pilot study
Counter-balancing if repeated measure design
Random allocation
What is a pilot study?
A small-scale trial run before an investigation with smaller + similar participants
What is the purpose of a pilot study?
Improves validity + reliability and saves time/money
What do pilot studies do?
Check the research is clear and controlled, any potential issues are identified
Change thinks that don’t work, modify designs/procedures
What is standardisation?
Keeping everything the same for all participants in a condition so the investigation is fair and validity is increased
What are standardised procedures?
Exercising control by ensuring all participants have the same experience
What are standardised instructions?
Exercising control by ensuring all participants have the same instructions in the same way
What should stay the same when using standardised procedures?
Place
Equipment
Materials
Conditions
Time
Instructions
How are standardised instructions written?
Procedures explained
Can ask any questions
Written verbatim
What is the schema for the experimental method?
Difference
Comparison groups
Causal
Bar graph
What is the experimental method?
The only method to make causal conclusions as the IV is directly manipulated to measure the effect on the DV
What is the independent variable (IV)?
The variable manipulated/changes naturally and the direct effect on the DV is measured
What is the dependent variable (DV)?
The variable affected by the IV and is measured, the change should only be caused by the IV
Why do levels of the IV/experimental comparison groups exist?
A comparison needs to be made to determine the effects of the IV on the DV
What are the 2 different types of experimental comparison groups?
Comparison of 2 experimental conditions
Comparison to a control condition
How do you write a directional experimental hypothesis?
IV → DV → IV
How do you write a non-directional experimental hypothesis?
There will be a difference in DV between IV + IV
What are the 4 types of experiments?
Lab
Field
Natural
Quasi
What are the 2 types of true experiments
Lab
Field
What is a lab experiment?
In a highly controlled environment
The IV is directly manipulated to produce a change in the DV
Participants are randomly allocated
What are 3 strengths of a lab experiment?
High internal validity (variable control)
Replication possible increasing validity + reliability
Strong causal relationship
What are 3 weaknesses of a lab experiment?
Low ecological validity + mundane realism
Demand characteristics
Investigator effects
What is a field experiment?
A controlled experiment in a natural/ordinary environment
The IV is directly manipulated to produce a change in the DV
Participants are usually unaware
What are 3 strengths of a field experiment?
High external validity + mundane realism
Reduced demand characteristics as unaware
Casual relationship
What are 3 weaknesses of a field experiment?
Low internal validity + reliability (hard to control EVs + CVs)
Ethical issues (consent + privacy)
Participant variables
What is a natural experiment?
The IV is naturally occurring and the researcher takes advantage of this, will vary
Effect on the DV observed
Tentative causal relationship
What are 3 strengths of a natural experiment?
Allows for research which can’t be done ethically
High external validity
Low demand characteristics
What are 2 weaknesses of a natural experiment?
Low internal validity (no RA)
Low reliability (replication)
What is a quasi-experiment?
The IV conditions already exist in participants
Often controlled in a laboratory
What are 2 strengths of a quasi-experiment?
High internal validity (if controlled)
Can compare when impossible to manipulate variables
What are 2 weaknesses of a quasi-experiment
Participant variables lower internal validity (no RA)
Demand characteristics (if unnatural)
What are the 3 designs for experiments?
Independent groups
Repeated measures
Matched pairs
What is an independent groups design?
Different participants used in each condition
Results are compared
Random allocation used
What are 3 strengths of using an independent groups design?
Order effects avoided
Demand characteristics lowered
Same test used
Although also less economical, what is the main disadvantage of using an independent groups design? How can this be controlled?
Participant variables act as EVs
-random allocation of participants
-matched pairs design
What is a repeated measures design?
All participants experience all conditions with a suitable time interval inbetween
What are 2 strengths of using a repeated measures design?
Participant variables controlled
Fewer participants needed so less time recruiting, more economical
What are 3 disadvantages of using a repeated measures design? How can these be controlled?
Order effects (practice, boredom, fatigue)
-counter-balancing distributes effect
-half do condition 1 then 2, half do condition 2 then 1
Demand characteristics (more opportunity to guess aim)
-single-blind technique
-experimental realism
Different tests used
-random allocation of questions
What is a matched pairs design?
Different but similar participants are used paired on a key variable
How would you match pairs in a matched pairs design?
- Identify suitable variable
- Variable is measured in participants eg: IQ test
- Paired on similarity
- Each participant in pair randomly allocated to condition
What are the strengths of using a matched pairs design?
Order effects avoided
Demand characteristics reduced
Same test can be used
Participant variables controlled
What are 2 disadvantages of using a matched pairs design?
Participant variables (matching not perfect)
-control with pilot study to make sure all PV are considered
Time consuming + expensive as more participants required
How should validity be improved in an experiment?
Control group
Single/double-blind to reduce participant reactivity/investigator effects
Standardisation (also for reliability)
What do correlations do?
Illustrate the strength and direction of the relationship between 2 or more co-variables
What does strength mean in terms of correlations?
Between -1 and 1
Perfect, high, low, no correlation
What does direction mean in terms of correlations?
Positive/negative
What is a correlation coefficient?
A number indicating the strength and direction of the relationship between the co-variables
What are the 4 types of correlations?
Positive
Negative
No correlation
Curvi-linear
What are the 2 reasons as to why a correlation may be used?
Variables cannot be manipulated (eg: for ethical reasons)
Want to investigate relationship, not difference, between variables (maybe before designing an experiment)
What are the 4 reasons why a cause-and-effect relationship cannot be established with a correlation?
- Not an experiment, no IV is manipulated
- No causal conclusions
- Direction of the influence between the co-variables unknown
- May be a third factor affecting the co-variables
How do you write a directional hypothesis for a correlation?
There will be a +/- correlation between … and …
How do you write a non-directional hypothesis for a correlation?
There will be a relationship between … and …
What are 2 strengths of a correlational analysis?
Useful starting point
-assessing strength and direction provides precise quantifiable measure of relation
If it’s strong, may suggest hypothesis for future
Quick + economical
-no control/manipulation
-secondary data
Less time consuming
What are 2 weaknesses of a correlational analysis?
May have flawed methodology
-method used to measure the variables may be flawed
Lowers validity
Cannot demonstrate cause and effect
-none manipulated
-not sure which variable caused change
-may be third untested variable
Base a research design on false, misinterpreted information
What is an observation?
Recording observable behaviour to study complex interactions, often used as a technique within the experimental method
What are the 6 types of observations?
Naturalistic or controlled
Covert or overt
Participant or non-participant
What is a naturalistic observation?
Takes place in the setting the target behaviour would usually occur
All aspects of the environment are free to vary and not interfered
What is a strength and a weakness of a naturalistic observation?
High external validity
Lack of control (low internal validity + reliability)
What is a controlled observation?
Controlled, specific and measureable
ALl aspects of the environment not free to vary
Control over EVs via manipulation
What are 2 strengths and 2 weaknesses of a controlled observation?
Can replicate to improve reliability
High control improves validity
Low ecological validity
Demand characteristics
What is a covert observation?
Participants are unaware they’re being observed
What is a strength and weakness of a covert observation?
Reduced demand characteristics
Ethical issues as may not want to be observed
What is an overt observation?
Participants know they’re being observed and have given consent
What is a strength and weakness of an overt observation?
More ethically acceptable
Increased demand characteristics (decreased accuracy)
What is a participant observation?
The observer becomes part of the group, overtly or covertly
What is a strength and 2 weaknesses of a participant observation?
Increased insight and understanding improves validity
Lack of objectivity as may identify with the group
May influence and decrease natural behaviour
What is a non-participant observation?
The researcher is seperate and records behaviour in a more objective manner
What is a strength and a weakness of a non-participant observation?
More objectivity due to psychological distance, increasing accuracy
Lack of insight
What are behavioural categories?
When a target behaviour is broken into operationalised components via coding
What 5 things should behavioural categories be?
Visible
Objective
Self-evident
Mutually exclusive
Cover all behaviours
What do behavioural categories/behavioural checklists increase?
Reliability
What are the 2 ways to record observational data?
Structured observation
Unstructured observation
What are structured observations?
Target behaviour tallied using pre-determined checklist from a pilot study
What are unstructured observations?
Everything is recorded with no pre-set criteria, usually small scale
What is a strength and weakness of using a structured observation?
Recording is easy + systematic, quantifies information to analyse and compare
If not all behaviour is covered in the checklist, important behaviours ignored reducing accuracy
What is a strength and 2 weaknesses of using an unstructured observation?
Data is rich in depth + detail improving accuracy
Observer bias
Difficult to record + analyse qualitative data
What are the 3 sampling methods for observations?
Continuous recording
Event sampling
Time sampling
What is continuous recording?
Key feature of unstructured observation, all behaviour is recorded although not practical for complex behaviours
What is event sampling?
Recording each time a target behaviour occurs
Useful for complex behaviours, but if the behaviour is too complex, details may be overlooked
What is time sampling?
Recording in a pre-established time frame
Reduces the number of observations made but may be unreprasentitive