Chapter 9 Flashcards
Checking reliability for quantitative research
- Sample size
- Test-retest
Sample size
The larger your sample, the more accurate. Margin of error: the extent of the error that you will accept.
Test-retest
By repeating the method you can check whether your research is reliable.
Checking reliability for qualitative research
- Inter-rater reliability/ intersubjectivity
- Triangulation
- Iteration
Reliability
The extent to which the research is free of random errors.
Random error
Errors that arise through a coincidental cause, as a result of unexpected factors.
Replicability requirement
It must be possible to replicate the research at another time, by another researcher, using other subjects and under different circumstances.
Inter-rater reliability/intersubjectivity
The extent to which there is agreement between the researchers about the research findings.
Margins of error
The margin that you allow for errors in your research.
Four-eye principle
A kind of feedback that you get by asking colleagues or fellow students to check your research.
Pilot project
Pilot interview or survey.
Member check
The client is involved in examining the research project.
Checking reliability for quantitative and qualitative research
- Standardization
- Pilot interview
- Four-eye principle
- Reporting and justification:
- Member check
Standardization
Designing standards for questionnaires.
Validity
The extent to which the research is free of systematic errors.
Systematic errors
Errors that have a systematic (not coincidental) cause that (consistently) lead to a result that is different to the expected value measurement.
Internal validity
Extent to which accurate conclusions can be drawn from the results.
Mortality
Test subject drop out that leads to the systematic skewing of the results.
Test effect
Research participants react differently because they are taking part in research.
Maturation
Changes during the research that leads to the systematic skewing of the results.
External incident (history)
External incidents that lead to the systematic skewing of the results.
Jeopardized internal validity
- Selection
- Growth
- External incidents
- Instruments
- Mortality
- Test effect
- Maturation
Selection
You only researching the answers from some people, not from everyone your drawing a conclusion from.
Growth
If the research goes on for to long, changes will automatically take place.
Instrumentation
Changes in the measuring instruments that leads to the systematic skewing of the results.
Construct validity
The validity of measuring instruments that are used in surveys and experiments.
‘Measuring what you intend to measure’.
Extend to which you are measuring what you want to measure
External validity/population validity
The extent to which a sample resembles the population in terms of relevent attributes; it determines the statistical generalizability of the research.
Theoretical generalizability
The extent to which the findings can be generalized to apply to other situations and groups that have not been researched.
Statistical generalizability
Extrapolation of the conclusions to the population.
Construct validity
Extent to which you are measuring what you want to measure.
Usability
The extent to which research has practical relevance.
Conceptual usability
The results are used to start a debate on a specific subject.
Instrumental usability
The results are used to draft policies.
Valorization value
The knowledge that you gain with applied research.
