Non-Systems (Research) Flashcards
A physical therapist searches the literature for a reliable and valid questionnaire to measure quality of life in patients with heart disease. The therapist plans to use the questionnaire to assess changes in quality of life before and after participating in a cardiac rehabilitation program. Which questionnaire property is MOST critical to achieve the therapist’s objective?
Responsiveness
What is sensitivity?
- Measure of validity of a diagnostic or screening test based on the probability that someone with a disease will test positive on the test.
- Proportion of people with a dz who have a positive test.
Correctly identifies true (+)
SnOut - if you give a highly sensitive test and it comes back negative you can rule out the dz because it is really good at finding (+).
What is specificity?
- Measure of validity of a diagnostic or screening test based on the probability that someone who does not have a disease will test negative on the test.
- Proportion of people without a dz who have a negative test.
** Correctly identifies (-) **
SpIn - if highly specific test and get a positive then you rule in the likelihood of dz because this test is really good at finding negatives
What is responsiveness?
ability of the instrument to detect change over time. This is an essential attribute when the goal is to assess changes in quality of life before and after participating in cardiac rehabilitation. If the questionnaire is being used to assess the effectiveness of an intervention, the score should change as the patient’s status changes and stay the same if the patient is unchanged.
What is linearity of change?
Refers to the magnitude of the change with respect to the starting score. The extent to which a score changes is a function of the starting score. For example, patients may experience substantial changes in joint ROM if their initial ROM is limited because there is more to be gained.
Reliability
Reproducibility or repeatability of measurement
Overall consistency of the measurement. This determines the reproducibility of a study.
Test-retest reliability
How likely are you going to get the same result on the same test performed again?
IntERrater reliability
Consistency or equivalence of measurements made by more than one person.
Indicates the agreement of measurements taken by DIFFERENT examiners
What is the homogeneity of ratings among various researchers?
IntRArater reliability
The consistency or equivalence of repeated measurements made by the SAME person over time.
How likely is a single researcher going to get the same result?
Validity
Degree to which a useful or meaningful interpretation can be inferred from a measurement.
The ability to come as close the truth as possible
How closely does the result match the known truth or Gold standard test?
Internal validity
Focus on cause and effect relationships
Specifically on is there evidence that given a statistical relationship between the independent variable and dependent variable in a experiment, one causes the other.
External validity
Extent to which results of a study can be generalized beyond the study sample to persons, settings, and times that are different form those employed in the experimental situation.
Concerned with the usefulness of the information outside the experimental situation
Level of evidence
Listed best to least good
1A – Systematic review of RCTs
1B – Individual RCT (narrow confidence interval)
2A – Systematic review of cohort studies
2B – Individual Cohort study
2 C – “Outcomes” research (ecological studies)
3A – Systematic review of case-control studies
3B – Individual case-control study
4 – Case series
5 – Expert opinion
Qualitative vs Quantitative
Qualitative - pertaining to a targets behavior or characteristics (case study)….not necessarily testing something more just describing.
Quantitative - numeric analysis of relationships and test results
- statistical analysis
- suggesting correlation
Quantitative Studies (Research design)
numeric analysis of relationships and test results
- statistical analysis
- suggesting correlation
- Descriptive design - observation data collection
- Correlation design - observation data collection relates several variables
- Quasi-Experimental Design - Seeks causality (doesn’t manipulate variable)
- Experimental design - classic RCT where the independent variable is manipulated