scientific processes Flashcards
reliability
extent to which a procedure produces consistently similar findings using the same participants when repeated
factors affecting reliability
poor standardisation of procedure - not found in lab experiments, questionnaires etc
assessing reliability
test-retest reliability
inter-rater reliability
test-retest reliability
extent to which a procedure can be easily replicated using the same participants, so the consistency of findings can be checked
inter-rater reliability
extent to which different researchers are likely to record similar findings using the same procedure
assessed by comparing the results of two raters or researchers who have conducted the same procedure, assessment or coding system. If both raters results are the same then the procedure is said to be reliable
measuring reliability
assessed statistically using a correlation
test-retest results from first and second time the test is done are correlated against each other
inter-rater reliability the recording of the two researchers or raters would be correlated
for results to be reliable, a correlation should be found which can then be analysed using a statistical test (spearmans rho or pearsons) to see if correlation is statistically significant
correlation coefficient of +0.8 or higher is considered reliable
improving reliability
remove extraneous variables
better operationalisation
remove extraneous variables
removing any variable which, if left uncontrolled could randomly affect the DV > research more likely to get the same results when repeated or conducted with two or more researchers
e.g. removing confusion in participants through standardisation of instructions so they behave the same each time the study is replicated
better operationalisation
by more clearly making the IV and DV operationalised the research is more likely to get the same results when repeated or assessed with two or more researchers
e.g. rather than simply recording what participants say, use a standardised scale to record their behaviour to increase the chance all researchers record the behaviour in the same way
validity
two types internal and external
extent to which a study successfully measures what it intended - internal
external - extent to which findings can be applied to different settings, wider populations and over time
factors affecting internal validity
demand characteristics
factors affecting external validity
only using male or female participants
assessing internal validity
face validity
concurrent validity
face validity
extent to which an assessment or test subjectively measures what it intended to at face value
assessed by asking participant to complete the test and then asking them what they thought the test measured and how good a measure it was
if participants can identify the dv then the test has high face validity
concurrent validity
extent to which an assessment or test produces similar results when compared with another established method widely known to be valid
assessed by comparing the results a participant achieved on the new measure from an established one
if results are similar the new measure is said to have concurrent validity
if no similar assessment exists an entirely different method could be used