Week 5 - Intro to Quant Research & Analysis Flashcards
What is involved in rigor of Qual research?
- trustworthiness
- credibility
- dependability
- confirmability
- transferability/fittingness
- authenticity
what is involved in the rigor of Quant research?
- reliability & validity
- internal validity
- reliability
- objectivity
- external validity
define validity
-General definition
-Improves our ability to infer cause-and-effect
relationships
-Improves with control of extraneous factors
-Known threats
-the degree to which it can be inferred that an intervention (IV) rather than confounding factors causes the observed outcome. Confounds can be fatal to a study.
what are examples of validity?
- In a study—are the inferences made by the study accurate?
- In a measurement/tool—does the tool measure what it is supposed to measure?
t/f - Well Constructed Research Study Designs Avoid Multiple Threats to Strong Evidence
true - There are many tradeoffs and factors to consider when prioritizing design decisions to ensure study validity.
what are the 4 types of research validity?
- Internal
- External
- Statistical conclusion
- Construct
what are threats to internal validity?
- History
- Maturation
- Mortality
- Selection bias
- Testing
- Instrumentation
what is external validity?
- the degree to which study results can be generalized to settings or samples other than the group being studied.
- Concerns whether inferences about observed relationships will hold over variations in persons, setting or time. Relates to the generalizability of inferences – a critical concern for evidence-based nursing practice.
what are threats to external validity?
- Selection effects
- Reactive effects
- Measurement effects
t/f - Internal and external validity share an inverse relationship.
true
what is statistical conclusion validity?
- Type I and type II interpretation errors
- the degree to which inferences about relationships from a statistical analysis of the data are correct.
- concerns the validity of inferences that there truly is an empirical relationship or correlation, between the presumed cause and the effect. The researcher’s job is to provide string evidence that an observed relationship is real.
what are threats to statistical conclusion validity?
- Low statistical power
- Excessive homogeneity
- Lack of treatment fidelity
what is construct validity?
-A fundamental criterion for the measurement process in
quantitative research
-the degree to which an abstraction or concept designed by researchers adequately represents higher-order constructs as intended; requires careful attention to what we call things (labels); if studies contain construct errors, the evidence is misleading.
- Involves the validity of inferences “from the observed persons, settings, and cause-and-effect operations included in the study to the constructs that these instances might represent”
what are threats to construct validity?
- reactivity to the study situation
- researcher expectancies
- novelty effects
- compensatory effects
- treatment diffusion/contamination
what is an example of a question you would ask for internal validity?
If there is a true statistical relationship between cause and effect, is it the independent variable or is there an alternative explanation?
what is an example of a question you would ask for external validity?
Do inference concerns about relationships made in the study hold up over variation in persons, settings, contexts, over time? (generalizability)
what is an example of a question you would ask for statistical conclusion validity?
Does a true empirical relationship of cause-effect actually exist?
what is an example of a question to ask about construct validity?
What are the inferences from observed persons, settings, and cause-effect operations included in the study to the constructs these might represent?
what methods are used to control over participant characteristics in quant research?
Randomization Crossover Homogeneity Stratification/Blocking Matching Statistical Control
define temporal ambiguity as a threat of internal validity
when looking at cause and effect, it is important to establish that the cause (IV) preceded the effect (DV). RCT study designs carefully plan for timing and involve data collection over a series of time exposure points, conditions; however correlational and cross-sectional designs this may not be clear (if a data measurement is largely from 1 point in time).
define selection bias as a threat to internal validity
- self selection and convenience sampling (vs randomization) such that retained individuals in a study distort truth estimates.
- encompasses biases resulting from preexisting differences between groups (Most problematic & frequent)
define history as a threat to internal validity
- concurrent events at the same time period unrelated to the study but impact the DV (i.e. COVID-19)
- occurrence of external events that take place concurrently with the independent variable and that can affect the outcomes
define maturation as a threat to internal validity
- there are changes to the DV over time, such that it is no longer the same as when the study started.
- Refers to processes occurring during the study as a result of the passage of time rather than as a result of the independent variable. (relevant in health research – not just referring to age but rather to any changes that occur as a function of time)