Quality Criteria Flashcards
Quality criteria for research
To be a disciplined inquiry it is important a research achieve quality standards.
Quality criteria for quantitative studies
- relaibility
The extent to which the measurement instruments and procedures produce consistent results .
Accuracy of the data, collection procedures.
Can be threatened due to differences in procedures , changes in test takers raters , and form of tests
-measurement validity
Truthfulness of the interpretation of quantitative data,
The extent to which the results or data of a research depicts the hypothesis.
- research validity
: 💠internal validity - the degree to which the study establishes a credible cause and effect relation within the population of the study.
Blinding, experimental manipulation, random assignment ensure internal validity,
🎱External validity:
The degree to which the results can be generalized to other populations/settings.
Threats to research validity
📍Attrition- participants dropping out during the study
🔭Howthorne effect - change of situation Due to the awareness of being observed.
🦐Practice effect- participants performance on test improve results.
🤖Maturation- impact of physical or mental change that happens during the time.
Experimenter’s bias- behaving differently to achieve results.
History- past events affecting results of a study.
Participants’s desire to achieve results.
Instrumentation- different reactions to different instruments
Quality concerns of Qualitative research
Quality of qualitative research is not as straightforward as it is for quantitative research.
Quality of the research depends on the quality of the data provided by the respondents
Quality of the researcher, Qual research is highly influenced by subjectivity of the researcher. The degree to which the researcher is subjective decides quality of the research.
It is problematic whether the results of qual data. Is an analysis of data or a few chosen arguments that validates a preconceived idea.
Lincon and Guba (1985) taxonomy of quality criteria.
Introduces trustworthiness as a replacement for validity. There are 4 components
- credibility: refers to internal validity.
- transferability - applying the finding of the research to different setting.( external validity)
-dependability- consistency of the findings ( reliability)
- confirmability- neutrality of findings (objectivity)
They are parallel to their quantitative counterparts.
Maxwell’s taxonomy of validity criteria
Identifies the aspect of traditional concept of validity and reliability.
Disagrees that validity of qUal and Quan studies are different. In fact he mentions that the taxonomy might also be helpful for quan studies
Descriptive validity: factual accuracy of the researcher’s account.
- the accuracy of what the researcher has observed, experienced, or secondary sources have obtained
- multiple investigators interpreting data .
Interpretive validity - portraying the participants’ responses accurately.
- discuss the finding with the participants.
Theoretical validity : the findings corresponding with a theory.
Generalizability
Internal- generalizing within the community
External - generalizing to other communities.
Evaluative validity- the truthfulness of the way the researcher interprets data
Strategies to ensure quality in qual studies
Assuring researcher’ s integrity
Building up an image to the audience about the researcher’s integrity.
🩺justifying the steps taken to achieve results
🩸presenting finings in context
🧨addressing researcher bias
📉addressing negative cases and suggesting explanations
Validity and reliability checks
📰 participant feed back - validation interview.
👯♀️- peer review
Design based startegies
- triangulation
- prolonged engagement
-longitudinal researcg
Quality criteria for mixed methods
- Rationale for mixing methods
- rationale for the specific methods
: why each method was chosen
: demonstrate how the methods enhance validity - quality of the research method.
