Reliability in Research, Techniques to Avoid Threats, Assessing Reliability Flashcards
It is the consistency or accuracy of the research method
Reliability
Two time process wherein you test first and then do it again so that you could produce a consistent result when used multiple times with the same participants
Test-Pretest Reliability
Having multiple or different raters to agree their ratings or classifications
Inter-Rater Reliability
Two or more forms of measurement instruments produce similar results
Parallel Forms Reliability
Interpretation o the data is due to personal opinions or beliefs
Observer Bias
Variation in data collection methods that may affect the results
Variability in Data Collection
Changes in the measurement instrument over time that may affect its reliability; questions produced years ago could not be reliable now.
Instrument Decay
Trying to test the measurement instrument with a small sample of participants before conducting the full study; Most commonly used
Pilot Testing
Correlating the measurement instrument or procedure to ensure that it is accurate and consistent
Calibration
Cleaning and verify data to ensure accuracy and consistency
Data Cleaning
Replicating studies using different methods or samples
Data Replication
Conducting regular checks on inter-rater to ensure that raters are consistent in their ratings
Inter-Rater Reliability Checks
Findings ensure that their results are generalizable and trustworthy
Increasing Confidence
Statistical method to estimate the internal consistency of a set of items or scales
Cronbach’s Alpha
Statistical method used to estimate the agreement between rates or coders
Intra-Class correlation Coefficient
