Research Methods (cont) Flashcards
content analysis, assessing and improving reliability and validity, probability and significance, features of science, descriptive statistics and display of quantitative data
content analysis
way of analysing and transforming qualitative data into quantitative data
secondary source content e.g. adverts, films, diaries, transcribed verbal communication
ways of categorising data
(content analysis)
top-down
- pre-defined categories before research
bottom-up
- allow categories to emerge from content
- read/watch first, then again
- provides more detail, won’t miss important themes
quantitative analysis
(content analysis)
create coding system and tally each time a behavioural category occurs
should be pre-defined and clearly operationalised
- less subjective, limits misinterpretation
statistical analysis can then be carried out
makes more scientific, reliable, valid
quantitative analysis process
(content analysis)
data collected
examines data to familiarise (bottom-up)
identify coding units
data analysed by applying coding units
tally of each tome coding unit appears
qualitative (thematic) analysis
(content analysis)
familiarise with data
generate initial codes
search for initial emerging themes (lots of different codes to sort in to themes)
review themes, collapse into each other, cross over
define and name
write up
content analysis strengths
reliable
easily replicated, standardisation of coding units and pre-existing secondary data
coded more than once (intra-rater reliability) or by different researchers (inter-rater reliability)
can check for consistency
but, subjectivity may affect findings, define codes differently, decreasing consistency
content analysis strengths
ethical
already in public domain (no privacy issues)
does not involve direct use of participants
less ethical guidelines that may restrict research
but, still some ethical considerations
researcher needs to ensure they have consent of stakeholders to analyse confidential material e.g. medical records
can be difficult - make some topics difficult to investigate
content analysis weaknesses
prone to subjective analysis
involves interpreting qualitative data from secondary sources alongside a coding system
affected by gender or cultural background of researcher
prone to researcher bias
mean
interval / ratio data
adding all scores and dividing by number of scores
if fairly even distribution around centre
mean strengths
accurate and sensitive measure
takes all numbers into consideration
highly representative
is numerical centre point of actual values
used to calculate standard deviation
mean weaknesses
can be skewed by anomalies
rogue scores can significantly increase or decrease mean score
not representative
not always an actual score (e.g. 2.5 children)
not accurate reflection of data set
median
ordinal data (or higher)
middle score when data in ordered list, middle scores averaged
when extreme high or low scores
median weaknesses
may not be an actual score
not representative
not appropriate in small data sets or when there are large differences
median strengths
unaffected by extreme scores
only concerned with middle
more accurate and representative
quick and easy to calculate
mode
nominal data
most common score
can be bi-modal or multi-modal if multiple common scores
least meaningful, especially when multiple modes
mode strengths
unaffected by extreme scores
more representative
always an actual score
accurate representation
mode weaknesses
sometimes doesn’t have a mode or has many
limited usefulness
doesn’t use all data
accuracy questioned
measures of central tendency
how close scores are to average
mean
median
mode
measures of dispersion
how spread out scores are
provide fuller picture
range
standard deviation
analyse how far away scores are from average responses e.g. spread or variability
normally large dispersion is due to individual differences or poor experimental control
range
ordinal data
difference between highest and lowest score
subtract lowest from highest score
range strengths
easy and simple to calculate
takes into account extreme values
range weaknesses
ignores most of data
doesn’t reflect true distribution
easily distorted by extreme values
standard deviation strengths
precise as all values accounted for
accurate representative of distribution
detailed conclusions made
allows for interpretation of individual scores in terms of how it falls from the mean (130 IQ = 2 SD away from the mean)
standard deviation
interval / ratio data
indicates average distances of scores around the mean
takes every score into account
larger SD, more spread out relative to the mean
measures collectively how much individual scores deviate from the mean, presenting this as a single number –> how much data is dispersed
standard deviation weaknesses
complex to calculate
not quick or easy
less meaningful if not normally distributed
standard deviation comments
should comment on the spread
large spread suggests inconsistencies in data, highlighting individual differences
larger SD, more spread out, more variability
smaller SD, more similar the scores
positive, negative and zero correlations
correlations are co-efficients between -1 and 1
closer the figure to 0, the weaker the correlation
closer to 1 or -1, very closely related variables
positive = both co-variables increase together
negative = one increases while the other decreases
zero = no apparent relationship
moderate (0.5), strong (0.7), weak (0.3)
probability
likelihood of an event occurring
expressed as decimal or percentage
inferential statistics necessary to determine whether results are significant or simply due to chance
- show which hypothesis to accept or reject
- use probability of p <= 0.05
likelihood of the data (in terms of difference or relationship found) being due to random chance is less than or equal to 5%.
less than or equal to 5% chance of the null hypothesis being true
type I error
false positive / error of optimism
claims there is a significant difference when there isn’t
claims support for research hypothesis with significant result when caused by random variables and not really significant
level of significance not cautious enough e.g. p<= 0.10
type II error
false negative / error of pessimism
accepts null hypothesis, claiming there is no significance when there is an effect beyond chance
level of significant too stringent e.g. p<=0.01
- used in medical or safety critical situation
scientific process
Psychology follows the scientific method – states a theory and uses observations and experiments to test the hypothesis through laboratory or field experiments. The understanding from research is applied to create evidence-based strategies that solve problems and improve lives.
- Observation / question
- Research
- Hypothesis
- Experiment
- Collect data
- Analysis
- Conclusion
objectivity
- When study is bias free of experimenter and there are operationalised definitions of behaviour being used. Also refers to the validity of a measure.
- Concepts psychologists measure are not always easily measurable e.g. cognitive processes and attachment, obedience, anxiety can only be interpreted.
experimenter bias
Bias in recruitment or allocation of participants
Investigator effects – cues that influence how participants behave
Confirmation bias – selectively attending to factors confirming hypothesis.
Interpretation of results subject to bias – especially with qualitative data.
improving objectivity
Gather objective, quantitative data
Double blind procedure
Operationalise definitions and use well-defined and clear behavioural categories
Standardised procedures and instructions with consistent measures (e.g. videos)
Controls
Representative sample randomly selected
Interrater reliability checks
empiricism
- When information is gained through direct observation rather than argument or belief. We should be able to operationalise IV and DV and directly observe them.
- Increases reliability and validity of data, increasing levels of certainty and confidence in conclusions.
empiricism in the humanistic approach strengths
- Lower levels of Maslow’s hierarchy, as physiological needs are likely to be empirical, as we can see and measure them quite easily.
It becomes harder to measure the higher up the hierarchy we go. - Success of therapy using card sort.
Way of quantifying and operationalising concepts like self-image and ideal self.
Participants place cards with characteristics written on them on a nine-point continuum.
On the initial sort, they had to place them according to how they are at that moment, to measure their true self.
Cards then redistributed according to their ideal self.
Allows for the gap between ideal self and true self to be measured.
empiricism in the humanistic approach weaknesses
- Congruence and self-actualisation are abstract concepts.
Cannot see or measure it.
Difficult to operationalise. - Success of therapy
Subjective experience opposed to empirical research evidence.
empiricism in the biological approach strengths
- Localisation of function and brain lateralisation
Can observe images of the brain and physically see structures and activity levels without having to make inferences.
Processes can be seen and measured quantitatively. - Role of hormones
Can be measured in an objective and quantifiable way.
empiricism in the biological approach weaknesses
- Neurotransmitter levels in the synapse
Measurement not precise enough
empiricism in the learning approach strengths
- Pavlov measured drops of salivation and Skinner measured behaviour of pressing the lever
Quantifiable and can be easily measured and observed
Behavioural responses can be seen - Bandura measured the number of aggressive or non-aggressive imitative or non-imitative acts.
Behaviour is observable
No inferences need to be made in terms of learning of aggressive responses
empiricism in the learning approach weaknesses
- Mediational processes cannot be seen
Must be inferred
Inner mental processes cannot be studied empirically
empiricism in the cognitive approach strengths
- Localisation of function, emergence of cognitive neuroscience
Mental processes now able to be observed via imaging
E.g. PET scans show brain activity / where cognition is occurring.
fMRIs measure blood flow so show indirect neural activity / processing.
Produces images and waves that can be quantified.
empiricism in the cognitive approach weaknesses
- To investigate mental processes, some inference is involved
As mental processes cannot be observed
Unscientific and not empirical
empiricism in the psychodynamic approach strengths
- Could argue that consequences of fixation are observable and measurable
empiricism in the psychodynamic approach weaknesses
Although impossible to establish whether fixation during psychosexual stages is what causes this
* Id, ego and superego, psychosexual stages and the unconscious cannot be observed.
Have to make inferences.