Quiz on Chapters 9, 10, 11 Flashcards
What are the characteristics of true experiments
- Independent variable must be manipulated by the examiner
- Subjects randomly assigned to groups
- Must have a control group
Describe the process and purpose of random assignment
Process: Use a table of random numbers, Subjects are numbered 01-45, use pairs of digits to identify them from the table, as they are chosen they are assigned to group 1, 2, or 3 on a rotating basis until all have been assigned
Purpose: To ensure that a sample is representative of the parent population and that it is not biased
Describe Various reasons for missing data
- Subjects may drop out or terminate treatment before the study is complete
- Subjects may cross over to another treatment during the course of the study
- Subjects may refuse assigned treatment after allocation
- Subjects may not be compliant with treatment
- Subjects may be excluded after randomization because they don’t meet eligibility criteria
Explain the rationale for intention to treat analysis (ITT)
- Guards against the potential for bias if dropouts are related to outcomes or group assignment and preserves the original balance of random assignment
- This approach is considered reflective of routine clinical situations in which some patients will not be compliant
Describe the purpose of blinding
- Protection against observation bias of patients, treating providers, measuring providers, and data analysts
- Observation bias: Participants knowledge of their treatment or the investigators expectations can influence performance and/or recording and reporting of outcomes
Describe strategies for controlling inter-subject differences in research design
- Selection of homogeneous subjects
- Only Males - Blocking
- Block of Males, Block of Females - Matching
- Matched for age and sex - Using subjects as their own control
- Analysis of Covariance (ANCOVA)
Describe the elements of statistical conclusion validity
- Is there is a relationship between the independent and dependent variables?
- Was there the potential that inappropriate statistical procedures were used for analyzing data, and did this lead to invalid conclusions about that relationship?
Describe the elements of internal validity
- Is there evidence of a causal relationship between independent and dependent variables?
- Refers to the potential for confounding factors to interfere with that relationship
Describe the elements of Construct validity
- To what theoretical constructs can the results be generalized?
- Refers to the theoretical conceptualization of the independent and dependent variables
Describe the elements of External Validity
- Can the results be generalized to other persons, settings, or times?
- Refers to the extent to which results of a study can be generalized outside the experimental situation
Discuss how experimental designs control for threats to internal validity
- Randomization is primary way
- If only 2 levels, counterbalancing is used
- If 3 or more levels, use a latin square
What is the difference between efficacy and effectiveness
Efficacy: The benefit of an intervention as compared to a control or standard program
Effectiveness: The benefits and use of the procedure under “real world” conditions
What is the difference between quasi experimental designs and true experimental designs
Quasi Experimental designs are similar to experimental but they lack randomization, comparison group, or both
Judge the extent to which threats to internal validity limit the application of quasi-experimental designs
While threats to internal validity exist in quasi experimental designs, the rigid structure and rules of the RCT do not represent real world situations, making it difficult for clinicians to apply or generalize research findings. The results of the RCT may not apply to a particular patient who does not meet inclusion or exclusion criteria, or who cannot be randomly assigned to a treatment protocol. Many of the quasi experimental models will provide an opportunity to look at comparison in a more natural context.
Describe a pretest - posttest control group design (independent)
- Used to compare two or more groups that are formed by random assignment
- One group receives the experimental variable and the other acts as a control