Data recording, analysis and presentation (methodological issues) Flashcards
definition of representativeness
sample : if the sample is diverse and includes people from different ages, genders, occupations, education levels, etc., it will be more representative of the (target) population
definition of generalisability
Result : if the sample used in the research is biased and not very diverse, the results cannot be generalised to everyone in the target population.
the extension of research finding and conclusion to large population
different type of reliability
Internal
External
Inter-rater
Test-retest
Split-half
definition of internal reliability
The consistency of a measuring device (e.g. Does it work
in a consistent [or standardised, and replicable] way
with all participants?)
definition of external reliability
The consistency of a study’s findings (e.g. Would the
same findings be obtained if the study was repeated? Is there a pattern to a study’s findings that has not been distorted by outliers?)
definition of split-half method to check reliability
Compare the score from one half of the questions (e.g. even number Qs) to the score for the other half
of the questions (e.g. odd number Qs) to see if participants scored consistently on both halves.
definition of test re-test method to check reliability
Giving the participants the same test/measure at a different point in time to check whether their two
scores are consistent
defintion of inter- rater reliability
Two or more observers record the behaviour, and then their results are compared to check the level of
agreement in their results (a high correlation between their scores of 0.8 or more would indicate high
inter-rater reliability).
types of internal and external validity
Internal
Face
Construct
Concurrent
Criterion
External
Population
Ecological
definition of face validity
Whether a test appears (on the face of it) to be measuring what it intends to
definition of concurrent validity
Where a test or study measure gives the same results as another test or study that is measuring the same concept
definition of criterion validity
(predictive validity + concurrent v)
Refers to how much one test or measure predicts future performance on another test or measure
definition of construct validity
Refers to whether a test or study
actually measures the concept it sets out to measure (and extraneous variables are controlled for)
defintion of population validity
Refers to the degree to which the
sample used in the research is
representative of a diverse group of
people (of different ages, genders,
occupations, education levels, etc.)
defintion of ecological validity
Refers to how accurately a piece of
research reflects real-life situations
demand characteristics
Demand characteristics occur when participants work out the aim of the research either because it
is obvious, or as a result of a repeated measures design being used. They may then change their
behaviour and act in the way they think the researcher wants them to act.
social desirability
Social desirability refers to when participants change their behaviour to present an image of being a
good member of society or to fit into social norms, rather than showing their true behaviour
researcher/observer bias
to the way the researcher collects and interprets the results of a
research. They may interpret behaviour based on their prior expectations and therefore this would lower the validity of the findings.
researcher/observer effect(s)
the way that participants’ behaviour is influenced by the
presence (and their characteristics) of the researcher
ethical considerations
Respect – informed consent, right to withdraw, confidentiality
Competence (operate within their capability, not giving advice beyond what they are qualified to give)
Responsibility – protection of participant, debrief
Integrity – deception
How can you explain how subjectivity affects reliablity and validity
If results are open to interpretation there is a chance that different researchers will interpret the results differently, therefore there will not be consistency in this interpretation (low inter-rater reliability)
There is a chance the interpretation of results is incorrect and you therefore are not getting results that are accurate.
