Ch. 11 Flashcards
Not- Quite Experimental Designs
Classic Experimental Design
—— participant are randomly assigned to IV conditions
——IV is manipulated
——DV is measured
What if you can’t randomly assign?
—–Signle-Case Designs
——Quasi-experimental designs
——–Developmental designs
Single- Case Experimental Designs
- A.K.A single subject designs or small N designs
- Use this when trying to figure out whether an experimental manipulation had an effect on single participant
- basically, you record the baseline control) behavior, than record behavior during the treatment period, to see if it changed
- problem is there are many alternative explanations for why the behavior chaged
Single-Case Experimental Designs: Reversal Designs
- record the baseline behavior, then record behavior during the treatment period, then remove to treatment to record a second baseline period
- called ABA design, or withdrawal design
- to rule out possibility that some unrelated event caused the change in behavior, you can do multiple reversals ABA design or ABA BAB design)
Single- Case Experiments: Multiple Baseline Designs
- sometimes its unethical or impossible to reverse El treatment
0n this case, you can take multiple baseline measures at diff times, and
multiple post-treatment measures at different times- The multiple baselines can be across subjects, introducing the IV manipulation at different points in time
- across=behaviors
- across situations
- interrupted timer series design
- control series design
—– try to find a comparison group, to act like a control group
Developmental Research Designs
Cross- Sectional Method
- study people of different areas of a single point in time
— Longitudinal Method
—– study the same group of people at different points in time as they grow older
COMPARISON of LONGITINAL And CROSS-SECTIONAL METHODS
- advantages of cross- sectional designs:
—— much faster and cheaper - disadvantages of cross–sectional designs
—— differences may be due to the cohort effects, not age-related change - advantages of longitudinal designs
——– can actually see how a variable changes in each person, and the group, as they age - disadvantages of longitudinal designs
——— expensivee difficult and takes many years
———- attraction can impact results
SEQUENTIAL METHOD
- do a cross- sectional study and longitudinal study at the same time
Single Case Experiments: Replications
replication= do the same single -subject experiment with additional subjects
- enhances generability, and helps rule out individual differences as casual factors
QUASI- EXPERIMENTAL DESIGNS
- you use these when you want to study the effect of an independent variable, but you aren’t able to exercise experimental control over it
— limits ability to make definitive statement about cause and effect
Quasi experimental design- One Group Post Test only design
- you have nothing to compare it too
Quasi-experimental - Nonequivalent control group pretest-post test design
-concern is that there’s section differences between groups
Quasi Experimental Design- One Group pretest post test design
- a change in one group pretest–post test design can’t rule out alternative explanations
Quasi- experimental Design; Nonequivalent control group design
- does have control group
- participants not randomly assigned
- concern is that there’s selection differences between groups
Quasi experimental design- -nonequivalent control group pretest- post test design
—- can use pretest- to see if groups were the same before start of experiment
—- can also look at look at change in scores from pretest to post test
Quasi experimental Design- Propensity score matching of nonequivalent treatment and control groups;
—- similar to matched pairs Design; measure all participants health scores match each person in experimental group with someone in control group with similar score
- Propensity score matching is statistically matching the groups on multiple variables instead of just one
State the key difference between true experimental designs and Quasi experimental designs, How does this affect how we can interpret the results?
In a true experimental random assignment is used to ensure equality within groups
Affects how we interpret results because, with quasi-experiments, confounding variables could be our causes
Why do we use single-case experiments
we use them to determine whether an experimental manipulation had an effect on a single research participant
Describe the steps involved in an ABAB design, as well as what each step is for
ABAB
A(baseline) B (treatment) A (baseline) B (treatment)
What is meant by a multiple-baseline design across subjects, or across situations? Provide Examples
Multiple baseline design
- Across Subjects: the behavior of several subjects is measured over time; for each subject, manipulation is introduced at different points in time
- Across situations: same behavior is measured in different settings, differerent times in each setting
Multiple Baselines Design across subjects
- Baselines are measured over time for each subject and manipulation is introduced at a different point in time (which rules out explanations based on chance and historical events ECT.)
Multiple baseline across behaviors
Several different behaviors are measured over time, and manipulation is applied to each of those behaviors to see if it affects those behaviors
Multiple Baselines across situations
Behavior is measured in diff settings. Manipulation introduced at different times in each setting and expectation is that change in behavior will occur only after manipulation
What is a reversal design? Describe an example and explain what the purpose is of doing it this way?
A single-case design in which the treatment is introduced after a baseline period and then with drawn during a second baseline period. It is to show the reversibility of the manipulation
Give an example of a one-group PostTest-only design, and explainw hy these results cannot be interpreted.
Participant->smoking measure->training program-> Smoking measure DV post test
Cannot be interpreted because there can be confusing variables
Describe and give examples of a one group pretest-posttest design design, explaining the advantages and disadvantages
One group:
Pretest- Posttest Design
- testing before and after manipulation
- alternative explations threats to intrnal validity
Describe and give examples of a nonequivalent control group design design design, explaining the advantages and disadvantages
- employs sperate controjl group but the 2 groups are not equivalent
- no random assignment
- selection differences problem
Explain how history, maturation, testing, and instrument decay and all potential problems for interpting the results of a one-group pretest-post test design
History refers to any event that occurs between 1st, 2nd measurement but is not part of the manipulation
- can be caused by any confounding eevent
Maturation is considered any change that occurs systematically over time
Testing becomes a problem if simply taking the pretest changes the participants behaviors
Instrument Decay can cause basic characteristics of the measureing instrument change over time
What is regression towards the mean, and why does it occur?
Regression toward the mean is likely to occur whenever participants are selected because they score extremely high or low on some variable, when they are tested again their scores tend to change in the direction of the mean
Discuss the interrupted time series design, and explainw hy it is valuable for interpreting whether a particular intervention had an effect
The interrupted time series design is a design in which the effectiveness of a treatment is determined by examining a series of measurements made over an extended time period both before and after the treatment is introduced; not introduced at a random point in time
How does a control series design improve upon the interrupted time series design
The control series design improves upon the interrupted time series by provided a control group to help compare the results
Give examples of cross-sectional, longitudinal, and sequential designs, and summarize the cons and pros of each type
Cross sectional: persons of different ages are studied only at one point in time
- less expensive
- yields results immediately
-must infer differences are due to age
- developmental change is not actually observed
Longitudinal
- expensive; results take time
- participants die, move on or lose interest
- results are actually based on age
- developmental changes actually observed
Sequential: A combination of the cross-sectional and longitudinal design to measure developmental research questions
- fewer years and less effort to yield results
- participants not followed their entire lifetime
Cross Secitional pros and cons
Cross sectional: persons of different ages are studied only at one point in time
+
- less expensive
- yields results immediately
-
-must infer differences are due to age
- developmental change is not actually observed
Pros and cons of longitudinal
Longitudinal
- expensive; results take time
- participants die, move on or lose interest
+
- results are actually based on age
- developmental changes actually observed
Sequential design pros and cons
Sequential: A combination of the cross-sectional and longitudinal design to measure developmental research questions
+
- fewer years and less effort to yield results
- participants not followed their entire lifetime
what if you can’t randomly assign participants to
conditions (because it’s unethical, impractical,
impossible, etc.)? Three options to address this problem
include:
- Single-case designs
- Quasi-experimental designs
- Developmental designs
Multiple Baseline design vs ABABAB design
- Multiple Baseline: it may be unethical to revoke treatment so treatment is compared across subjects and administered at different times
- ABABABAB design, you take baseline, give treatment, take treatment away to see if you return to baseline
Types of single case experiments
- Multiple Baselines
- ABABAB (aka Reveral Designs)
