Study Guide Flashcards
What is internal validity?
Answers the research question
provides evidence by controlling variance enough to provide a clear picture of the relationship between the IV & DV.
Must eliminate alternative explanations
What is external validity?
focuses on the extent to which a researcher is justified in describing the impact of one variable on another or for concluding that an observed relationship is casual.
Degree that generalization can be made or transferred outside of the confines of the study.
What is history?
Events that may have occurred between treatment sessions. An extraneous variable that occurs “outside” the experiment
long term studies are more likely to be “contaminated”
What is maturation?
change in subjects’ themselves that cannot be controlled by the experimenter (e.g., age, biological, psychological)
this plays a role in long-term studies.
What is reactive pretest?
the effect of taking a test may have on scores achieved on subsequent administration of the same test.
Improvement may exist without Tx–based solely on test practice
An issue for studies using pre-test and post-test designs
What is instrumentation?
changes in the calibration of a measuring instrument or changes in the observers or scorers used may produce changes in the obtained measurements
faulty, inadequate, or changing calibration of the equipment
rating scales, questionnaire, attitude inventories, and standardized language tests
What is statistical regression?
phenomenon in which subjects who are selected on the basis of atypically low or high scores change on a subsequent test so that their scores are now somewhat better or somewhat poorer than they were originally
What is differential subject selection?
Differences in subjects in experimental and control groups may account for the treatment effects rather than the treatment itself (ex: age, IQ, sex)
What is subject randomization?
the random assignment of subjects to experimental and control group
What is attrition?
experimental mortality, the differential loss of subjects between experimental and control groups
(ex: incomplete surveys, death)
What is interaction of factors?
possible interaction effects of two or three jeopardizing threats
What is credibility?
when the interpretation fits the data and is true to the participants, the conclusions may be considered credible.
what is researcher bias?
researcher must be reflexive about his or her own voice or perspective
What is researcher reactivity?
design must account for the possible influence of the researcher on the participant’s behavior
What is subject selection?
degree to which the subjects chosen for a study are representative of the population the researcher wishes to generalize
What is generalizability?
the extent to which populations, settings, treatment variables, and measurement variables can be generalized
What is interactive pretest?
subjects exposed to a pretest may react to an experimental treatment in a way that is different from people who have not been exposed to the pretest. The effect of treatment may be demonstrated only for subjects who are tested just before treatment.
What are reactive arrangements?
problem generalizing to other settigs
What is the hawthorne effect?
The mere fact of being observed experimentally can influence the behavior of those being observed
What is multiple treatment inference?
This threat concerns the degree to which various parts of a multiple treatment interact with each other in determining subject’s performance on the DV. When more than one treatment is administered.
What is transferability?
the extent in which qualitative findings are externally valid. The ability to apply the results of research in one context to another
What is Pilot research?
during initial stages of experimental design this is conducted on a small number of subjects not meant for publication or to provide data that supplement another investigation, it is only done to assess feasibility.
Describe Internal Validity
It answers the Research Question
Provides evidence by controlling variance enough to provide a clear picture of the relationship between the IV & DV
Results must reflect object reality
Must be certain the change in the DV is caused by the experimental Tx and not by factors that could mimic the effect of Tx
Must eliminate alternate explanations
the fewer (alternate explanations) the greater the internal validity!
Note: The fewer reasons you can come up with why something has changed=GOOD!
What are threats to validity?
History
Maturation
Pretesting–“reactive testing”
instrumentation
statistical regression
Different subject selection
Attrition!
Credibility
What are two threats to qualitative designs that are often conceptualized as alternative explanations or as rival hypothesis, therefore rendering the results meaningless and uninterpretable?
researcher bias
researcher reactivity
In quantitative studies, describe external validity
ability of a study to extend its conclusions from the specific environment to the other individuals with similar characteristics
What may weaken the internal validity?
efforts to extend the generalizability of results
What do threats do?
limit the degree to which internally valid results can be generalized