Research and Critical Appraisal Skills Flashcards
What are the key steps in statistical hypothesis testing?
- Define null and alternative hypotheses.
- Collect sample data from the population.
- Calculate the test statistic based on sample data.
- Determine the p-value associated with the test statistic.
- Compare p-value to significance level to accept or reject the null hypothesis.
Explain the concepts of Type I and Type II errors in hypothesis testing. How are they denoted? Are they related?
- Type I error: Rejecting null hypothesis when it is true.
- Type II error: Failing to reject null hypothesis when it is false.
- Type I error rate is denoted by alpha (α), typically set at 0.05.
- Type II error rate is denoted by beta (β), related to study power.
- Reducing one type of error generally increases the other.
What is a p-value, and what does it show in statistical hypothesis testing? What doesn’t it show?
- Represents the probability of obtaining observed results under the null hypothesis.
- A small p-value (< 0.05) suggests rejecting the null hypothesis.
- A large p-value (≥ 0.05) suggests failing to reject the null hypothesis.
- Indicates the strength of evidence against the null hypothesis.
- Does not measure the size or importance of the effect.
Describe the importance of confidence intervals in estimating population parameters.
- Provides a range within which the population parameter is expected to lie.
- Reflects the precision of the sample estimate.
- A 95% confidence interval means there is 95% confidence the interval contains the parameter.
- Narrower intervals indicate more precise estimates.
- Helps in understanding the reliability and variability of the estimate.
What is the difference between standard deviation and standard error?
How are they related?
- Standard deviation measures the spread of observations in a sample.
- Standard error measures the accuracy of the sample mean estimate.
- Standard error is calculated as standard deviation divided by the square root of the sample size.
- Standard deviation applies to individual data points, while standard error applies to sample means.
- Standard error decreases with increasing sample size, indicating more precise estimates.
Discuss the clinical relevance of confidence intervals in medical research.
- Indicates the range of plausible effects of an intervention. 2. Helps in assessing the precision of treatment effects. 3. Narrow confidence intervals suggest more reliable results. 4. Wide intervals may indicate uncertainty and variability in the data. 5. Used to evaluate the statistical and clinical significance of findings.
Explain the concept of null hypothesis significance testing (NHST).
- Null hypothesis (H0) states no effect or no difference in the population. 2. Alternative hypothesis (HA) states there is an effect or difference. 3. Uses sample data to test the validity of the null hypothesis. 4. Decision to reject or not reject H0 based on p-value and significance level. 5. Central to evaluating treatment effects and scientific claims.
What are the implications of a statistically significant result (p < 0.05)?
- Indicates strong evidence against the null hypothesis. 2. Suggests the observed effect is unlikely due to chance alone. 3. Does not necessarily imply clinical significance. 4. Results should be interpreted in the context of the study. 5. Further research and replication are needed to confirm findings.
Describe the role of sample size in hypothesis testing.
- Larger sample sizes provide more reliable estimates. 2. Increases the power of the study to detect true effects. 3. Reduces the standard error, leading to narrower confidence intervals. 4. Helps in achieving statistically significant results. 5. Must balance practical considerations and resource limitations.
What is the purpose of using a control group in clinical trials?
- Provides a baseline for comparing the effects of the intervention. 2. Helps isolate the specific impact of the experimental treatment. 3. Essential for assessing the efficacy and safety of new treatments. 4. Controls for placebo effects and other confounding variables. 5. Ensures that differences in outcomes are due to the intervention.
Explain the concept of statistical power in hypothesis testing.
- Probability of correctly rejecting the null hypothesis when it is false. 2. Power is denoted by 1 - β (beta). 3. Higher power reduces the risk of Type II errors. 4. Influenced by sample size, effect size, and significance level. 5. Typically, a power of 0.80 or higher is considered acceptable.
Discuss the importance of randomisation in clinical trials.
- Ensures equal distribution of confounding variables. 2. Reduces selection bias and improves internal validity. 3. Helps achieve comparability between treatment groups. 4. Facilitates blinding and reduces performance bias. 5. Critical for the integrity and reliability of trial results.
What is the relationship between confidence intervals and statistical significance?
- Confidence intervals provide a range of plausible values for the parameter. 2. If the interval includes the null value (e.g., 0 or 1), the result is not statistically significant. 3. If the interval excludes the null value, the result is statistically significant. 4. Confidence intervals offer more information than p-values alone. 5. They help in assessing the precision and clinical relevance of the estimate.
Explain the concept of effect size and its importance in research.
- Measures the magnitude of the treatment effect. 2. Provides information on the practical significance of findings. 3. Can be reported as Cohen’s d, odds ratio, or relative risk. 4. Larger effect sizes indicate stronger associations or impacts. 5. Important for interpreting the clinical relevance of results.
What are the key features of a Randomised Controlled Trial (RCT)?
- Random allocation of participants to intervention or control groups. 2. Double-blinding to minimise bias. 3. Comparison of outcomes between groups. 4. Control of confounding variables. 5. Considered the gold standard for evaluating interventions.
Explain the concept of internal validity in RCTs.
- Accuracy of the results within the study. 2. Extent to which observed effects are due to the intervention. 3. Minimisation of confounding variables. 4. Importance of randomisation and blinding. 5. Threats include selection bias, performance bias, and attrition bias.
What is external validity in the context of clinical trials?
- Generalisability of study results to the broader population. 2. Defined by the inclusion and exclusion criteria. 3. Influenced by participant characteristics and settings. 4. Affected by volunteer bias and loss to follow-up. 5. Ensures applicability of results to clinical practice.
Describe the concept of patient preference in clinical trials.
- Influence of patients’ treatment choices on study outcomes. 2. Can impact recruitment and retention rates. 3. Affects internal and external validity. 4. Needs to be considered in the design of trials. 5. Example: Partially randomised patient preference trial.
What are the advantages of a cohort study?
- Prospective design allows temporal relationships to be established. 2. Suitable for studying multiple outcomes. 3. Can study rare exposures. 4. Minimises recall bias compared to retrospective studies. 5. Provides incidence data.
Explain the concept of confounding in cohort studies.
- A factor associated with both exposure and outcome. 2. Distorts the true relationship between exposure and outcome. 3. Can be controlled through statistical methods like multivariable analysis. 4. Examples include age, smoking, and socioeconomic status. 5. Important to identify and adjust for confounders.