EXITS Flashcards

1
Q

External validity

A

External validity is the extent the results can be generalized to the target population or clinical settings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Internal validity

A

Internal validity is the extent conclusions from the studies can be made, based on the studies design settings and measures.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Construct Validity

A

The extent to which a test measures the theoretical construct the test is supposed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Content Validity

A

The extent to which a test fully measures all the domains of the construct of interest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Criterion Validity

A

That determines the relationship of the scores on a test to a specific criterion, which is usually another validated test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Inter-rater Reliability

A

The extent results are consistent among different raters who are rating the same information.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How to measure inter-rater reliability

A
Cohen Kappa coefficient (for categorical items)
Intraclass correlation coefficient (for continuous items)
0.2-0.4=slight to fair
0.4-0.6=moderate 
0.6-0.8= substantial
>0.8=almost perfect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Test-retest Reliability

A

The extent results are consistent when the test is conducted at two different times with no intervention in between.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Bias

A

Systematic error that arises from the from the design, conduct and analysis of a study, resulting in observed result which deviate from the truth.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the common selection bias for case control study

A

referral, non-responder, volunteer bias, incidence prevalence bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is Hawthorne effect

A

The Hawthorne effect refers to the increase in performance of individuals who are noticed, watched, and paid attention to by researchers or supervisors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is Case Control study

A

Type of analytical observation study used to investigate the relationship between risk factor and outcome
The study is created by having a group of subject with the outcome and matched with a group without the outcome and the differences in previous exposure to risk factors were being investigated.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

(3)Pros and (4)cons of case control study

A

pros: efficient, useful to study rare disease/outcome, use to study a wide range of exposure

Cans: RECALL BIAS, cannot estimate prevalence or incidence, temporal relationship can be uncertain, not efficient for rare exposure, relative risk is measured indirectly (since we cannot estimate prevalence)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Cohort study

A

is a form of longitudinal study that samples a group sharing a exposure to match a group that is not exposed to a risk factor. Both groups are followed up to investigate the diff likelihood of the outcome on the two groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Pros and cons of cohort study

A

Pros
no selection bias
Well suited for rare exposure
Can study multiple diseases from a single exposure

Cons
Very expensive, Long time to complete, if prospective will have loss of followup

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Randomised controlled trial

A

An intervention study in which a group of subjects with similar characteristics are randomised to received one of the several defined intervention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Factorial trial

A

Studying more than 1 intervention and also the effect of their interactions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Cross over trial

A

Study where each subject received two or more study treatment in a specific order. Each subject become his own control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Systematic Review

A

A type of comprehensive literature review which assess and review all the pertinent articles in the field using explicit criteria and pool the results together to answer a clinical question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Meta analysis

A

Quantitative assessment of a systemic review

Which involves pooling the results of independent studies together to produce an overall estimate of effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Confidence Interval

A

A range of values within which the true value lies with a certain level of assurance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Standard Error

A

Standard error is used to calculate the confidence interval of the result.

Standard deviation over square root sample size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Alpha level

A

Is the threshold at which we will accept or reject the null hypothesis.

Typically sets at 5%.
A alpha level of 5% means that the observed results had occurred by chance at most 5% of the time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

P value

A

It represents the likelihood the observed result has occurred by chance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Null Hypothesis

A

States that any observed difference has occurred due to chance, and there is no real difference.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Effect Size

A

Measure of the magnitude of treatment effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

How to measure effect size

A

Typically calculated using Cohen’s D, which is the (difference between the experimental and control means) divided by (standard deviation).

  1. 2: small
  2. 5: moderate
  3. 8: large

Or calculated using correlation coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is another name of effect size

A

standardized mean difference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Central Limit Theorem

A

States that no matter what the probability distribution of a sample is, in a huge sample size, the distribution follows a normal distribution

In a normal distribution, the mean=median=mode and the skew is zero

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Odds

A

Number of times an event is likely to occur over number of times an event is likely not to occur

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Odds Ratio

A

Odds of an event happening in the experimental group over

Odds of an event happening in the control group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Relative Risk

A

Risk of outcome in the experimental group over

Risk of outcome in the control group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Absolute Risk

A

Incidence rate of outcome in the group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Absolute Risk Reduction

A

Actual reduction in risk moving from control group to the experimental group

CER-EER

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Numbers Needed to Treat

A

Numbers of subjects who must be treated with the intervention, compared with the control, to produce 1 beneficial outcome

1/ARR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Clinical Trial, what are the phases

A

Study design which aim to evaluate a treatment effect

Phase 0: Micro-dosing to assess PK
Phase 1: Testing on healthy subject, dosing regime and range, ascertain side effects
Phase 2: Testing on subjects (20-80 ppl), estimate treatment effect and tolerability
Phase 3: Clinical trial phase, test safety and effectiveness compared to alternative treatment
Phase 4: Post-market survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Confounder

A

A variable that is associated with both the exposure and outcome of interest but does not lie in the causal pathway between the exposure and outcome.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

How to control confounders

A
Restriction (exclusion criteria)
Matching
Stratification
Randomization
Statistical adjustment (stratification, multivariate regression analysis, direct standardization)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Matching

A

Technique used to distribute confounding factors evenly

Subjects are chosen in a way that identified confounders are evenly distributed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

Stratification

i) as a form of matching
ii) as a form of statistical adjustment

A

i) Technique used to distribute confounding factors evenly
Subjects are chosen to ensure that identified confounding in strata are evenly distributed

ii) Statistical method that stratified the comparison groups according to the confounding variable. It then combines the effect measures in each strata to yield a summary effect measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Randomization

A

Systematic process of allocating subjects to the study groups in such a way that each subject has an equal chance of being allocated to either group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Types of randomisation

A

1) Simple (no constraint in allocation sequence)
2) Restricted (A sequence is generated to ensure equal ratio among the groups)
3) Block (Ensure that each group has equal numbers of participants in blocks)
4) Stratified
5) Adaptive (The chance of allocation to study group is adjusted according to the existing imbalance in baseline characteristic of the group)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Multivariate regression Analysis

A

A statistical method that describe the relationship between 1 dependent outcome and 2 or more independent variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Power

A

Probability of detecting a difference when a true difference exist.
Typically set at 1-beta=0.8

There is 80% probability that a true difference will be detected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

What increases power

A

Increase sample size, effect size, alpha

dec standard deviation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

Definition Correlation

A

Spearman Rho: Assessment of the magnitude and direction of the association between 2 variables on an interval or ratio scale which is not normally distributed

Pearson R: Assessment of the magnitude and direction of the association between 2 variables which are normally distirbuted

Ranges from +1 to -1 (zero= no relationship)
>0.8: Strong
<0.5: Weak

Represented on scatter plot

47
Q

Coefficient of Determination

A

Measure of how much of the variation of the dependent variable can be explained by the independent variable.
(Linear and normally distributed)
r square = 0.9 x 0.9 = 0.81
81% of the variation in the dependent variable can be explained by the independent variables in the equation.

48
Q

Regression

A

Express the relationship between 2 or more variables in the form of an equation
Assumption: There is a 1-way causal effect between explanatory variables and dependent variable.

Simple linear (1 and 1)
Multiple linear (1 dependent, 2 or more independent – categorical/continuous)
Simple logistic (1 categorical dependent variable with 2 values)
multiple logistic(1 categorical dependent variable with 2 values)
49
Q

Prevalence

A

Number of individuals with the disease in a population

  • at a point of time (point)
  • over a period of time (period)
50
Q

Incidence

A

No. of new cases/disease over a period of time out of the population at risk

51
Q

Type 1 Error

A

False positive

Null hypothesis is rejected when it is actually true

52
Q

Type 2 Error

A

False negative
Null hypothesis is accepted when it is not true
Designated by beta, which is typically set at 0.2

53
Q

Sensitivity

How to inc sensitivity

A

True positive
Number of people with the condition who will be tested positive on the test
Increased with doing other tests (for ruling out)

54
Q

Specificity

A

True negative
Number of people without the condition who will be tested negative on the test
Increased with serial test (for ruling in)

55
Q

Positive Predictive Value

A

Number of people tested positive on the test who actually has the condition

56
Q

Negative Predictive Value

A

Number of people tested negative on the test who actually do not have the condition

57
Q

ROC: Receiver’s operating characteristic

A

Sensitivity (true positive) as y-axis (vert)
1-Specificity (false positive) as x-axis (horizon)
Best option is top left hand corner of the curve
Accuracy of a test is area under the curve, ideally is 1

58
Q

Likelihood Ratio Positive Test

A

How much more likely is a positive test to be found in a person with the condition compared to a person without the condition

59
Q

Likelihood Ratio Negative Test

A

How much more likely is a negative test to be found in a person with the condition compared to a person without the condition

60
Q

Bradford hills criteria

A

Group of principles in determining causal relationship

SSPECTAC + Biological gradient

Strength (strength if association)
Specificity
Plausibility (possibly with explanation)
Experiment evidence (can be done in an experiment)
Coherance (Coherence between epidemiological and laboratory findings increases the likelihood of an effect)
Temporality
Analogy (This criterion uses previous evidence of an association between a similar exposure and disease outcome to strengthen the current argument for causation.)
Consistency

biogical gradiant (dose dependant)

61
Q

Allocation Concealment

A

Method used to prevent selection bias during intervention assignment
It involves protecting the allocation sequence before and until assignment as knowledge of the next assignment may cause selective enrollment

62
Q

Blinding

A

Process whereby participants, accessors/health providers and even data analyst are kept unaware of the intervention allocation after the subjects have been assigned. Preventing performance and ascertainment bias.

Lack of blinding can account for 9% of observed improvement.

63
Q

Placebo Effect/Nocebo Effect Placebo

A

Improvement experienced by subject when they are on placebo treatment, otherwise known as effect of expectation

Negative effect experienced by subject because of the negative beliefs about their treatment

64
Q

Intention To Treat Protocol

A

Statistical analysis whereby all subjects who were randomized at the start will be included in the analysis in the group they were initially assigned to, regardless of the intervention they truly receive or whether they complete the study.

65
Q

Per-Protocol Analysis

A

Statistical analysis whereby only subjects who complied to the protocol through to completion will be included in the final analysis.

66
Q

Imputation Methods (4)

A

Used in intention-to-treat analysis protocol
Method used to replace missing data in order for data analysis to proceed

1.Worst/best case:
All subjects with missing data are assumed to be best/worst case
2. Hot deck:
Outcome from a similar subject will be used to replace the missing data
3. LOCF
4. Sensitivity analysis

67
Q

Issues with Last observation carried forward

What is LOCF

A

The most recently recorded outcome measure is taken to hold for the subsequent outcome assessment.
Can lead to attrition bias esp if attrition due to side effects.
Can also underestimate treatment effect.

68
Q

Sensitivity Analysis

A

Statistical method whereby outcomes are being recalculated under alternative assumptions to determine the impact of various factors on the outcome.

69
Q

Heterogeneity

A

Presence of variability among studies that is more than expected by chance alone

70
Q

How to measure heterogeneity

A

I2, Galbraith plot (type of scatter plot), forest plot, Cochran’s Q

71
Q

Publication Bias

A

Occur when strength and direction differs between published and unpublished studies
Typically happen when small or negative studies not being published, resulting in over-representation of positive result

72
Q

Method to measure publication bias

A

Funnel plot, trim and fill method, Fail-safe number:

How many unpublished data with zero effect size, is required to eliminate a significant overall effect size

73
Q

Random Effect and Fixed Effect Models

A

Type of linear model used in data analysis which assume there is heterogeneity among studies and hence allow for between studies variation

Model used in data analysis whereby the assumption is that there is no heterogeneity among the studies

74
Q

PLacebo

A

similar to specified treatment but has no treatment effect

75
Q

How to account for heterogeneity (3)

A

use of random effect size model, subgroup analysis and sensitive analysis

76
Q

What is transitivity

A

it is a measure of validity of making indirect comparison

There is no systemic difference between included studies

77
Q

What is systemic review

A

a study design where the authors collect a group of study in a systemic fashion. Then it will be statistically review in a meta-analysis

78
Q

What is the advantage of meta-analysis (3)

A

1) with a bigger sample size among different results, the results can be more precise
2) can decrease type 2 error
3) Able to see if effects are consistent across diff clinical population and to investigate whether difference in how the intervention was administered affects outcomes
4) to able to provide a conclusive evidence where smaller studies cannot

79
Q

What are the weakness of metaanalysis (4)

A

1) sources of bias as not controlled by the method
2) A good meta analysis of a bad designed studies will still results in bad statistics
3) High cost and high effort
4) may have chance of being perceptible to publication bias

80
Q

What is a network metaanalyiss

A

a technique for comparing 3 or more intervention simultaneously in a single analysis y combining both direct and indirect evidence across the network of studies

81
Q

What is fidelity score

A

the term fidelity denotes how closely a set of procedures were implemented as they were supposed to have been.

82
Q

What is economy analysis

A

Comparative analysis of alternate course of actions in terms of both their cost and consequences/effects, in an attempt to evaluate choices in resource allocation

83
Q

What is QALY and DALY

A

measure of disease burden

QALY: Arithmetic product of number of extra life years and the measure of the quality of the life years

DALY: Expressed as number of years lost to disability = YLL + YLD

84
Q

ICER

A

Statistic used in cost effectiveness analysis

Defined as:
Difference in cost between 2 intervention
divided by difference in their effect

Average incremental cost associated with 1 additional unit of measure of effect
Ie. 1 QALY about 20-40K (quality adjusted life years)

ICER: Incremental cost-effectiveness ratio

85
Q

John Henry effect

A

bias introduced to an experiment when members of the control group are aware that they are being compared to the experimental group and behave differently than they typically would to compensate for their perceived disadvantage.

86
Q

What are the usual level of bias (5)

A
1) Selection bias: 
Systematic differences between baseline characteristics of the groups that are compared.
can be due to: 
Sequence generation/randomisation.
Allocation concealment.
2) Performance bias.
Systematic differences between groups in the care that is provided, or in exposure to factors other than the interventions of interest.
can be due to: 
Blinding of participants and personnel.
Other potential threats to validity.
3) Detection bias.
Systematic differences between groups in how outcomes are determined.
can be due to: 
Blinding of outcome assessment.
Other potential threats to validity.

4) Attrition bias.
Systematic differences between groups in withdrawals from a study.
can be due to:
Incomplete outcome data

5) Reporting bias.
Systematic differences between reported and unreported findings.
can be due to:
Selective outcome reporting

87
Q

objectively evaluating a RCT

A

objectively evaluating a RCT via Jadads method
range of 0-5

Question Yes No

  1. Was the study described as random? 1 0
  2. Was the randomization scheme described and appropriate? 1 0
  3. Was the study described as double-blind? 1 0
  4. Was the method of double blinding appropriate? (Were both the patient and the assessor appropriately blinded?) 1 0
  5. Was there a description of dropouts and withdrawals? 1 0
88
Q

How to objective evaluate a systemic review

A

” A measurement tool for the ‘assessment of multiple systematic reviews’” (AMSTAR)

89
Q

How to approach positive results that is not expected ?

A
  • due to chance
  • not adequately power, eg not enough sample size.
  • confounding factors: eg low adherence, john henry effect
90
Q

What are the instrument that evaluate quality of

1) RCT
2) Cohort
3) Case Control
4) Cross sectional
5) systemic review and meta-analysis

A

1) Cochrane risk of bias tool, jadad scale, Joanna Briggs institute checklist for randomised control trial
2) Cohort: Newcastle-Ottawa Scale (NOS)for cohort study, joanna Briggs institute checklist for cohort study
3) Case control: Newcastle-Ottawa Scale for case control study, joanna Briggs institute checklist for cohort study for case control
4) Cross sectional, JBI critical apprasal checklist for analytical cross sectional
5) A Measurement Tool to Assess Systematic Reviews (AMSTAR) 2, Risk of Bias in Systematic Review (ROBIS)

91
Q

What is power

A

Power is the probability to detect the deviation of null hypothesis, should the deviation exist

92
Q

What is cross sectional study

A

cross sectional study is a study design that analyse data collected from a sample population at a specific moment/period

93
Q

Pros and cons of cross sectional study

A
Pros
Quick and easy to conduct 
can identify associations betwene variables, can expand research questions 
Less expensive 
No loss to follow up 

Cons
Relation between cause and effect cannot be established
Unable to provide an explanation for findings
Cannot study rare disease
Recall bias, non response bias

94
Q

What is Cronbach alpha

A

measure of internal consistency, that is, how closely related a set of items are as a group.

95
Q

what is internal consistency

A

Internal consistency is a measure based on the correlations between different items on the same test (or the same subscale on a larger test). It measures whether several items that propose to measure the same general construct produce similar scores.

is an assessment of how reliably survey or test items that are designed to measure the same construct actually do so.

96
Q

Nested Case Control

A

Case-control study done in the population
of an ongoing cohort study, thus “nested”
inside the cohort study.

97
Q

what is the pros and cons of nest case control

A

Advantages
● preserves advantages of cohort studies : The study design minimised selection bias compared with a case-control study, Recall bias was minimised compared with a case-control study
● most useful for costly analyses of specimens
● can potentially include fatal cases (as part of the cohort study), which cannot be done in case-control studies
● case and controls are taken from the same cohort

Disadvantages
● reduced precision and power due to sample of controls
● possibility of flaws in the design or implementation

98
Q

What is a scoping review

A

a scoping review is defined as a type of research synthesis that aims to ‘map the literature on a particular topic or research area and provide an opportunity to identify key concepts; gaps in the research; and types and sources of evidence to inform practice, policymaking, and research

99
Q

Rapid review

A

“Rapid reviews are a form of evidence synthesis that may provide more timely information for decision making compared with standard systematic reviews.” (AHRQ) The methods of conducting rapid reviews varies widely, and are typically done in less than 5 weeks

100
Q

Sampling for quanlitative research

A

Sampling
Convenience sampling
A convenience sample simply includes the individuals who happen to be most accessible to the researcher.

Voluntary response sampling
Similar to a convenience sample, a voluntary response sample is mainly based on ease of access. Instead of the researcher choosing participants and directly contacting them, people volunteer themselves (e.g. by responding to a public online survey).

Purposive sampling
This type of sampling, also known as judgement sampling, involves the researcher using their expertise to select a sample that is most useful to the purposes of the research.

Snowball sampling
If the population is hard to access, snowball sampling can be used to recruit participants via other participants. The number of people you have access to “snowballs” as you get in contact with more people.

101
Q

Pros and cons for Intention to treat analysis

A

Pros
preserve sample size
pragmatic more representative of real life, useful for effectiveness trial

cons
Dilution due to underestimate of treatment effect
Overestimation of side effect
Not good for biological efficacy

102
Q

How to do sensitive analysis for qualitative analysis

A
Triangulation, through different method 
member checks (participant views differs from interview view)
respondent validation 
flexibility 
deviant case analysis
103
Q

triangulation definition in qualitative study

A

a qualitative research strategy to test validity through the convergence of information from different sources

104
Q

Study type in qualitative research (4)

A
Study types 
ethnography 
phenomenology 
grounded theory -> data saturation then theoretical sampling 
Case study
105
Q

What is indication bias

A

occurs when the risk of an adverse event is related to the indication for medication use but not the use of the medication itself

106
Q

Issues with suicide study

A

1) ability to consent
2) confidentiality may need to be break
3) ?keeping and treating of results
4) survival bias
5) definition of suicide and self harm are hard to ascertain

107
Q

when we can waise consent for study

A
  • no more than minimal risk to patient
  • if individual’s privacy is assured
  • if waive will not affect the welfare of the research participant
  • consent is not practical
108
Q

ASSENT

A

“Assent” is a term used to express willingness to participate in research by persons who are by definition too young to give informed consent but are old enough to understand the proposed research in general, its expected risks and possible benefits, and the activities expected of them as subjects.

109
Q

pros and cons of cluster randomisation

A

pro:
large sample size
less time and cost
no contamination between interventions

cons
cluster will know which allocation which introduce bias, recruitment, issues with allocation concealment
Similar social demographic within each cluster
Power is reduced

use IntraCluster Correlation between cluster, if too high, need more variation
need multistage randomization

110
Q

what is a pilot study also known as

what is the most crucial thing about pilot study

A

feasibility study

-to make sure they can replicate the methods in the subsequent study, so that the results can be replicated

111
Q

Memory test immediately after intervention should not be done because

A

we need to to test the sustainability of the results

112
Q

what is expectancy effect

What is cointervention bias

A

When someone expects a given result, that expectation unconsciously affects the outcome or report of the expected result.
May need to over estimation of treatment effect
=====================

Co-interventions are additional treatments, advice or other interventions that a patient may receive, and which may affect the outcome of interest.

113
Q

Whats the most important for non inferiority trial

A

must be powered, so that if there is any difference in effect size should there be any sig, inferiority