EXAM 2 Flashcards
What is posttest-only control group design
A research design in which there are at least two groups, one which does not receive a treatment or intervention and data on the outcome is collected after the treatment/intervention.
What is the pre test post test control design
This is where the outcome is measured before an intervention/treatment is administered and then the same outcome is measured after treatment.
(Does this require a control group?)
What is posttest only non equivalent control group design
Participants in one group are exposed to a treatment, a non equivalent group is not exposed to the treatment and then the two groups are compared. 
What is Solomon 4 group design
Used when there are concerns about the treatment being influenced by a pre test.
(Need more definition)
What are the four groups in Solomon research design
1) pre test; treatment; post test
2) pre test: no treatment; post test
3) treatment; post test
4) no treatment; post test
What is factorial research design
A type of research that allows for the investigation of the main and interaction effects between two or more independent variables on one or more outcome variable
Examination of multiple IVs
Give an example of 4x2 factorial experimental design
A college wants to study the incomes of accounting, management, finance, and marketing majors and also look at gender.
IV - majors
Levels - gender
In research design - what are repeated measures
A design that involves multiple measures of the same variable taken on the same or matched subjects.
Example measuring abstinence rates of AA members at 3, 6, months of AA participation and 9, and 12 months of NA participation.
What is non equivalent control group pre test post test design? (This may not be correct)
Participants in one group are pre tested exposed to a treatment, a non equivalent group is not exposed to the treatment, and then the two groups are compared (post tested)
What is time series analysis
A specific way of analyzing a sequence of data points collected over an interval of time.
What is an example of time series analysis
Measuring the value of retail sales each month of the year.
What is single subject design?
A type of research methodology characterized by repeated assessment of a particular phenomenon (often a behavior) over time and is generally used to evaluate interventions.
The participant is both the control and treatment group.
Weak in external validity
What is an example of single subject research design?
Examination of the effect of punishment on class disruption over a period of a month
What is action research
Evaluation and critical analysis of practices based on collected data in order to introduce improvements
In research what are extraneous factors (variables)
Any factor (variables) that you’re not investigating that can potentially affect the outcome of your study
What is the difference between random selection and random assignment
Random selection- how you select individuals from the population to participate
Random assignment- how you place those participants into groups
An example of random assignment is:
Assigning participants into experimental and control groups
Something that provides an alternate explanation of what happened in the study beyond the effect of the IV or the DV is called: 
An extraneous factor
True or false: a post test measure will be taken of the control group as well
True
What is a Covariant
Variables that somehow relate to the DV but not the IV
These are controlled using statistics
What is an example of a covariant in behavioral research
Smoking could be a covariant when examining the relationship between alcohol use and health outcomes.
What is matching?
Allocating subjects to treatment conditions based on their equivalence in some desired effect
What is blocking
Matching subjects by group rather than individually
What is homogeneous sampling
Using a group of subjects who are very similar in some relevant way
What is an example of homogeneous sampling
people on a sample being the same age, or from the same area, or in the same career.
What is pre-experimental design?
A study in which a group is treated and then measured to see the effect. There is no control group
What is an example of pre-experimental design?
A teacher using a new instruction method in class.
What is an example of Quasi experimental design?
Studying the effects of motivational reward on fourth grade students from two classes.
Single Variable designs measure:
One independent variable
Factorial Designs measure
2 or more independent variables with at least one being manipulated
Usually true experimental but can he quasi
What does Tx mean?
Treatment
(“Add question about different Levels of IV receiving different treatment on slide 13”)
What is internal validity
Can we make a causal inference between the IV and the DV
Ruling out extraneous factors
What is external validity
Can the results of the experiment/study be generalized to other populations/settings
What is construct validity
are the operational definitions of the IV and the DV reasonable and accurate
What is statistical conclusion validity
The proper use of stats to determine whether to reject or retain the null hypothesis
What are the threats to external validity
1) interaction of selection and treatment
2) Interaction of setting and treatment
3) Interaction of history and treatment
What are the threats to internal validity
1) history
2) Maturation
3) Regression
4) Selection
5) Mortality
6) Interactions with selection
7) Diffusion of treatments
8) Compensatory equalization
9) Compensatory rivalry
10) Resentful demoralization
What is history threat to internal validity
Time passes between the pretest and the post test and events other than the treatment happen - obscuring the effects of the treatment
What is the maturation threat to internal validity
The possibility that mental or physical changes occur within the participants themselves that could account for the evaluation results.
What is the regression threat to internal validity?
This means that extreme scores on the 1st measurement (heigh or low) tend to move closer to average on the second.
Example selecting only heavy smokers for a cessation study
What is the selection threat to internal validity?
The selection of test participants that may influence the result of a study in lieu of the IV
Example: selection of people who are brighter or more receptive to treatment.
What is the mortality threat to validity
When people drop out or leave a study prior to its completion.
Example: if more people from the treatment groups withdraw than the control group it can skew the results
What is the interactive threat to internal validity
(Interactions with Selection)
These refer to social pressures in the research context that can lead to posttest differences
Example: historical events, race, socioeconomic status, educational levels can affect sample in dramatic ways
What is the diffusion of treatments threat to internal validity?
This is when participants adopt different interventions than the one assigned because they believe it to be more effective. This would be your control group learning from you treated group.
What is compensatory equalization threat to validity
When comparison groups not obtaining the preferred treatment are provided with compensations (alternatives) that make the comparison groups more equal than planned.
(Seeing that all groups in some way benefit) “confounds” the measure
What is compensatory rivalry
When a control (or unequally treated) group feels like the underdog and tries even harder to overcome the difference, skewing the results)
What is resentful demoralization
This is when a control group becomes angry and demoralized and stops trying or otherwise affects the measure
What is the testing threat to validity (procedure threat)
When a measure/test/assessment is given multiple times and the participant becomes familiar with and good at it - skewing the results
What is the instrumentation threat to validity (procedure)
This refers to changing how instruments are used during the course of the study
Example: using a paper test pre and an online test post.
What is interaction of selection and treatment threat to external validity
The inability to generalize the results of a treatment beyond the group/s that participated. For example a study of young people may not apply to the elderly
What is interaction of setting and treatment threat to external validity?
The inability to generalize results from one setting to another.
Example: public high schools vs. private high schools
What is interaction of history and treatment threat to external validity?
History treatment interaction happens when a researcher tries to generalize findings to past and future situations.
Example a fall test may not generalize to a spring test.
What are the are the two threats to validity based on procedures
1) testing
2) instrumentation
R stands for
Random selection
NR stands for
Non random
G stand for
Group
X stands for
The level of the IV essentially it’s the intervention status or type
Xe stands for
Experimental group
Ec stands for
Control group
O stands for
Observation
What are three types of correlational studies done within groups
1) time series
2) repeated measures
3) single subject
What is a one shot case study
When a single group is observed on a single occasion after experiencing some event, treatment or intervention
G1 X O is an example of a
One shot case study
What is a one group pretest posttest design
A type of quasi experiment in which the outcome of interest is measured 2 times: once before and once after exposing a non random group to a certain treatment/intervention
G1 O X O is an example of
One group pretest posttest design
What is a static group comparison
A quasi experimental design in which the outcome of interest is measured only once after exposing a non random group to a treatment and then comparing it to a control group.
G1 X O
G1 O =
What type of design is this?
A static group comparison
R G1 X O1
R G2 O2
Is what type of experiment
What is the threat:
Post-test only control group design
We’re the groups equal to begin with
R G1 O1 X O2 (pre-T, treatment post-T
R G2 O3. O4(preT no treatment postT)
Is what type of experiment
What is the threat
Pre-test post test control group design
Possible interaction between pretest and treatment: the dilemma of “gain scores”
What is meant by “gain scores“
ASK IN CLASS
R G1 O1 X O2
R G2 O3 - O4
R G3 X O5
R G4. O6
Is what type of study
What do you use to evaluate the results of this design?
Solomon four group design
A factorial ANOVA
What is ANOVA
Analysis of variance. The statistical method in which the variation in the set of observations is divided into distinct components
If the lines on a graph of interaction are parallel there is ______ interaction present 
No
In evaluating quasi experimental samples The researcher should consider
1) The equivalency of the groups to begin with
2) The representativeness of the groups
3) The generalizability of the results to other larger populations
NR G1 X1–O1
NR G2 X2–O2
NR G3 — O3
What type of design is this:
Post test only non equivalent control group design
NR G1 O1 X1 - O2
NR G2 O3 X2 - O4
NR G3 O5 O6
What type of design is this?
What is the advantage of this design?
Pretest posttest non equivalent control group design
It aids in checking the extent of group similarity, and the pre-test scores may be used for statistical control or for generating gain scores
NR G1 - O1 O2 O3 - X1 - O4 O5
What type of design is this
Interrupted time series design
Any number of observations is feasible, and the intersection of X should be random
G1 - O1 X1 O2 X1 O3 X1 O4
What type of study design is this?
Equivalent time series design
(Write up steps for single subject/single case designs)
What are the two procedural threats to validity?
Testing and Instrumentation
Photo 1 indicates a _________corrrlation
No corrrlation
Photo 2 indicated _________correlation
Positive Correlation
Photo 3 indicates _________ corrrlation
Negative correlation
What is a time series research design?
Similar to repeated measures but with only one intervention.

