Efficacy and Validity Flashcards
How is treatment effectiveness demonstrated?
Treatment effectiveness is demonstrated when there is is clinical improvement from the
treatment in the real-world context
What are ultimate outcomes?
provide a focus and a reason for undertaking treatment, which in
turn guide treatment planning and evaluation
What is personal significance?
self reported improvements that matter to the client in the context of their own lives
What is treatment fidelity?
Treatment fidelity is the degree to which actual implementation of the treatment in the real-world is consistent with the prototype treatment administered in the controlled conditions of the treatment efficacy study
When an application of a treatment in real-world context matches the controlled conditions of the original study, this demonstrates good treatment fidelity
When treatment efficacy is established, the improvement in client performance can be shown to be:
- Derived from the treatment rather than the extraneous factors
- Real and reproducible
- Clinically important
Treatment efficacy research is aimed at demonstrating the benefits of treatment through well-controlled studies with:
- Internal validity
- Statistical significance
- Practical significance
What is efficacy?
Efficacy is generally defined as the benefit of an intervention as compared to a control or standard program.
It provides information about the behavior of clinical variables under controlled, randomized conditions
This allows researchers to examine theory and draw generalizations to large populations
What is the Five Phase Model of Treatment Outcome Research?
- Phase I treatment outcome research – studies are designed to establish whether a therapeutic effect exists in the clinical environment, to estimate its potential magnitude, and to help identify potentially useful treatment protocols
- Phase II treatment outcome research – studies are conducted to determine the appropriateness of the intervention. It helps define for whom the treatment is suitable and for whom it is not.
- Phase III - treatment outcome research studies that are more rigorous experimental designs and greater control is used
- Phase IV- treatment outcome research that explores efficacy of interventions to see of it is effective in the clinic (sometimes called translational research)
- Phase V- treatment outcome research continues to explore effectiveness but with a greater influence on efficiency. These studies identify the types of modifications or applications that are necessary or beneficial for delivering service in a cost-effective manner
What is a type I error?
when the researcher reports a relationship between the intervention and the outcome (or progress) when no relationship (or progress) really exists
What is a type II error?
when the researcher reports that no relationship (or improvement/progress) exists between the intervention and the outcome, when there really was a relationship or improvement
What is content bias?
refers to test stimuli, methods, or procedures reflecting the assumptions that all populations have the same life experiences and have learned similar concepts and vocabulary
What is linguistic bias?
a disparity between the language or dialect used by the examiner, the child, and/or the language or dialect expected in the child’s response
What are 2 measures of validity?
Sensitivity and specificity
What is sensitivity?
One who has the condition will be classified as having the condition
Test sensitivity – refers to how well a test detects a condition that is actually present
What is specificity?
One who does not have the condition will be classified as not having the
condition
Test specificity- refers to how well a test detects that a condition is not present when it is actually not present
