Stats and research design (internal, external validity/experimental design) Flashcards
when a study has adequate internal validity, the investigator can conclude that observed variations in the ________ variable were caused by variations in the ________ variable rather than by other factors
dependent; independent
Campbell and Stanley identified several “generic” extraneous variables that can limit a study’s internal validity. _________ refers to an external event that is irrelevant to the research hypothesis but that occurs during the course of a study and affects subjects’ status on the ______ variable
history; dependent
_______ refers to changes that occur within subjects during the course of a study as the result of the passage of time and that have a systematic effect on the DV
maturation
Statistical _____ is the tendency for very high and very low scores to move toward the mean on retesting.
regression
it threatens a study’s internal validity whenever subjects are selected to participate in the study because of their extreme scores on the _________ variable measure
dependent
_______ is a problem when subjects in different treatment groups are not similar in terms of important characteristics at the beginning of the study
selection
______ limits a study’s internal validity when subjects who drop out of one group differ in an important way from those who drop out of another group
attrition
_____ can interact with history and threaten a study’s internal validity if one group of subjects is exposed to an external condition that does not affect subjects in other groups
selection
external validity refers to the ________ of research results to other people, settings, and conditions
generalizability
________ is a threat to external validity when administration of a pretest affects how subjects react to the treatment
pretest sensitization
The effects of pretesting on both internal and external validity can be evaluated by using the ______ four-group design
Solomon
Another potential threat to external validity is an interaction between ________ and treatment, which occurs when people in the sample differ from people in the ________ in terms of some characteristics that makes them respond differently to the IV
selection; population
_______ is another potential threat to external validity and occurs when research participants act differently because they know their behaviour is being observed
reactivity
A subject’s behaviour might be altered by _______, which are cues in the research setting that communicate to subjects what behaviours are expected of them
demand characteristics
multiple treatment _______ threatens a study’s external validity when more than one ________ of the IVs is administered to each subject. This threat can be controlled by using a Latin square or other type of ______ design
interference; level; counterbalance
when using a ______ groups research design, the effects of an independent variable are assessed by administering each level of the IV to a different ______ of subjects and comparing the performance or status of the groups on the ______ variable
between-; group; dependent
when using a _______ subjects (repeated measures) design, the effects of an independent variable are assessed by comparing the performance or status of the same group of subjects on the ______ variable after receiving, at different times, each level of the IV
within- ; dependent
in a single-group ________ design, the dependent variable is measured several times before and after the IV is applied
time-series
A research design that includes two or more IVs is called a _______ design. an advantage of this type of design is that it allows an investigator to assess the main effects of each independent variable as well as any interaction between those variables
factorial
a(n) _____ effect is the effect of one independent variable on the dependent variable
main
a(n) _______ is the effect of one IV on the DV at different _______ of another IV
interaction; levels
Two distinguishing characteristics of the single-subject designs are that they include at least two phases – a ______ (no treatment phase), and a _________ phase – and that they involved measuring the ______ variable at regular intervals during each phase of the study
baseline; treatment; dependent
three commonly used single-subject designs are:
the AB design, the reversal design, and the multiple baseline design
the AB design includes one ______ (A) phase and one ______ (B) phase
baseline; treatment
the reversal designs extend the AB design by including, at a minimum, two _______ phases and one ______ phase
baseline; treatment
when using a reversal design, if the subject’s performance on the ________ variable follows the predicted pattern (i.e., if it changes in the expected direction after the treatment is applied and withdrawn), a researcher can conclude that changes in the _______ variable are due to effects of the ________ variable rather than to history, maturation, or other factors
dependent; dependent; independent
when it is not ethical or practical to withdraw an effective treatment during the course of a study, an investigator can use the multiple _______ design, which involves sequentially applying the ________ variable to two or more “baselines” –i.e., either to two or more behaviours, settings, tasks, or subjects. An advantage of this design is that, once the IV is applied to a baseline, it is not ______ during the study
baseline; independent; withdrawn (removed)
An interviewer unintentionally nods whenever research participants answer his questions in ways that confirm the study’s research hypothesis. The interviewer’s behavior is best described as an example of which of the following?
demand characteristics
A psychologist evaluates the effects of a 15-month training program on the conservation skills of preoperational children by administering a measure of conservation to the same group of children before and at the end of training. The psychologist finds that significantly more children are able to conserve after the program than before the program. The biggest threat to this study’s internal validity is:
Maturation
A psychologist obtains a statistically significant F-ratio for the interaction between two independent variables (IVs). This means that:
the effects of one IV are contingent on the level of the second IV.
As applied to research design, “external validity” refers to which of the following?
generalizability
Dr. Angela Angst is using a repeated measures design to compare the effects of different techniques for reducing free-floating anxiety. To control potential carryover effects, Dr. Angst should use which of the following?
counterbalancing
In what type of research studies do participants act as their own “controls”?
single-subject
The Solomon four-group design is used to control which of the following threats to the validity of a research study?
pretest sensitization
