research methods p2 Flashcards
what is reliability
a measure of consistency
what are common measuring devices used in psychology
psychological tests, observations and questionnaires
how are psychological tests found to be reliable
using the same design, procedures and measurements
what is internal reliability
consistency within itself
what is external reliability
measures/ consistency from one use to another
what are the three ways of assessing reliability
test rest, split half and inter-observer reliability
what is the test-retest method
using the same test or questionnaire to same person in different occasions
what are examples of tests using the test retest method
psychometric tests, questionnaires
why should there be sufficient timing between the test and retest
to ensure previous answers are recalled but not too long to the point attitudes are changed
which researcher used the test retest method
beck et al
- studied response of 26 patients. found correlation of 0.93 a week apart
-able to successfully diagnose depression
what is a disadvantage of the test retest method
time consuming to obtain the results
what is inter observer reliability
when different interpretations of behaviours observed can form subjectiveness and bias
why is a pilot study used in inter observer reliability
to ensure that observers are applying behavioural categories
what does the split half method assess
internal consistency
what is the procedure of the split half method
compare results of one half of test with other half
if both show similar results, suggests the test has internal reliability
where is the split half method mainly effective
in large questionnaires
where would split half methods not be suitable
tests that measure different constructs
what are the ways of improving reliability
through the questionnaires, interviews, experiments and observations
how can questionnaires be used to improve reliability
through the test retest method
what will take place if the questionnaire produce low levels of reliability
some items may need to be rewritten or deselected
what is the best way of ensuring reliability in interviews
by using the same interviewer every time
what interviews are less likely to be reliable
unstructured and free flowing interviews
why are lab experiments seen as reliable
they have control over many aspects of procedures
what helps to improve reliability in terms of experiments
standardisation of materials, instructions and procedures
how can the reliability of observations be improved
operationalising the behavioural categories
what is validity
how genuine the measurement is
what is the key to confidence of only the IV affecting the DV in an experiment
controlling extraneous variables
what is internal validity
whether the effects observed in an experiment are due to manipulating the IV
what is external validity
results that can be generalised beyond the study
what is a confounding variable
an extraneous variable that has not been controlled and varies systematically with the IV
what are the two types of external validity
ecological and temporal validity
what is ecological validity
extent to which findings can be generalised to beyond real life situations
what is mundane realism
tasks that are like an everyday task
what is temporal validity
extent to which findings can be generalised to other historical eras
what are the three ways to assess validity
face validity, concurrent validity and predictive validity
what is face validity
other people eyeballing a study and giving their opinion
what people should be used for face validity
people who have an interest in the test
what is concurrent validity
when results formed are close to an established test
what is predictive validity
assessing a study’s internal validitythrough the prediction of later performances in the test
how can experiments improve validity
- control group: assessing whether changes in DV are due to effect in IV
- standardised procedures: minimises demand characteristics
- single blind procedure: participants unaware of study’s aims
- double blind: investigator doesn’t know main purpose, reduces investigator effects
how can observations improve validity
-covert observations: behaviour is more natural and authentic
-broad and ambiguous behavioural categories: validity of data collected has negative impact
how can questionnaires improve validity
using a lie scale: assesses consistency for social desirability bias
- keeping all data anonymous
how can qualitative methods improve validity
- including direct quotes from participants
- triangulation: use of number of different sources as evidence
what is peer review
assessment of scientific work by experts in the same field
what is the result of peer review
increases the quality of the study
when does peer review take place
when a piece of research is submitted to an academic journal for publication
what is the procedure of peer review
carefully work through research, examine any flaws
what is effect of examining flaws in peer research
prevents incorrect data from becoming available for consumption
what are the two types of functions for the process of peer review
- technical function
- subjective function
what is a technical function
ensuring the science is sound
what is a subjective function
ensuring the science is interesting and ground breaking
what is the effect of independent peer evaluation
determines if the research proposal will receive funding
what are the three outcomes of peer review
- research is approved and put forward for publication
-amendments or improvements suggested - work is inappropriate for publication and can be withdrawn
what is the issues associated with peer review
- introduces bias: male dominated research funding committees
- favouring publication of positive results: publication bias
-institutional bias
-peer review is a conservative process
what is a theory
a set of general laws or principles
what is falsifiability
the possibility of data being proven false
who devised the theory of falsifiability
karl popper
what is concluded from theories that survive the most attempts to be falsified
strongest theory
what is the hypothetico deductive method
starting from a theory and using that to generate a hypothesis
how is theory construction tested
gathering evidence via direct observation (empirical method)
what is deduction
the process of deriving new hypotheses from existing theories
what is induction
hypothesis is proposed and tested first before theory is constructed
what is the role of hypothesis testing
making clear and precise predictions on the basis of theories
what is an essential component of a theory
scientifically testing it
why is the cycle of reviewing, refining and testing repeated numerous times
ensures the strength and quality of the hypothesis
what is objectivity
unbiased and factual ideas, not affected by beliefs
what does objectivity tend to produce
quantitative data and standardised instructions
what is objectivity the basis of
the empirical method
what is replicability
the extent to which scientific procedures and findings can be repeated by other researchers
what does replicability focus more on
more on reliability rather than validity
what is a paradigm
a set of shared assumptions and agreed methods within a scientific discipline
when does a paradigm shift occur
as a result of a scientific revolution
