Final Flashcards
Threats to internal validity (8 points)
History, maturation, instrumentation, testing, statistical regression, intact groups, selection, mortality
Threats to external validity (4 points)
Selection bias, reactive effects of experimental arrangements, reactive effects of testing, multiple-treatment interference
How to counter threats to internal validity?
Use true experimental designs
What are the true experimental designs?
Pretest-posttest randomized control group design, pretest-only randomized control group design, Solomon randomized four-group design.
Nippold Article (9 points)
Focuses on treatment studies. Studies must be duplicable, target the right participants and ensure there is no interference, collect a baseline, include a control group, have matched experimental and control groups, control for test-retest reactivity, show improvements that generalize beyond treatment setting, control for placebo effect, have no conflict of interest.
Gillam and Gillam
PICO, Level of evidence, Must weigh internal evidence levels with external evidence levels (student-parent and clinician-agency vs. what the research says)
PICO
Patient, Intervention program, Comparison treatment, Outcome
Levels of evidence
1= RCTs and SRs, 2=Nonrandomized studies, multiple baseline designs, SRs, 3=Studies of multiple cases who receive same treatment, 4=Single case studies, 5=Expert opinion
Social validation
Are results meaningful? Can others notice the difference?
Content validity
Appropriateness of the content of a measure. Broad sample of content is better than a narrow one, important material should be emphasized, questions should be written to measure the appropriate skills.
Face validity
Opinion of experts on measure
Criterion validity
Comparing results of a test with a meaningful criterion that relates
Predictive validity
The extent to which a test predicts the outcome it is supposed to predict.
Construct validity
Using subjective judgements to create a hypothesis that is tested using empirical methods.
Judgmental-empirical validity
Indirect evidence
Criterion-related validity
Direct evidence
Correlation coefficients
Use with quantitative data
IRB and Belmont Report
Belmont report sets forth basic ethical principles required for research with human subjects. FWA=Federa Wide Assurance. 3 ethical principles are the basis of HHS/45 CFR 46=respect for persons, beneficence, justice. Secretary of Dept of Health and Human Services has oversight for system protecting human subjects.
3 famous violations of ethics
Willowbrook studies, radiation tests on mentally impaired boys, Tuskegee Syphilis study
Monster study
Orphans put under psychological stress to induce stuttering
Test-retest
Should only be used when learning/maturation is not possible. Compute correlation coefficient for scores.
Pros and Cons of Reversal
Pros of reversal: Demonstrate experimental control, time confounds unlikely (eg maturation). Cons of reversal: Difficult with long-lasting effect treatment, ethics with withdrawal.
Pros and Cons of Multiple Baseline
Pros: No need for reversal if using long-lasting effects, Cons: Individual differences, can take a long time.
What are SSDs good for?
Learning, treatment studies