EPPP Research Flashcards
-Qualitative Research
= obtain a description of the quality of relationships, actions, situations, or other phenomena. Naturalistic, contextual approach emphasizing understanding and interpretation and primarily inductive. Investigator’s perspective important. Observation, interviews and document analysis are strategies.
Quantitative Research
= obtain numerical data on variables. Empirical methods and statistical procedures, emphasizes prediction, generalizability, causality and id deductive. Investigators perspective minimized. Can be non-experimental (descriptive – to collect data on variables rather than to test hypotheses about relationships between them, ie correlational) or experimental (conducted to test hypothesis about effects of 1 or more IV or DV).
Planning and Conducting Research (steps)
• Developing an Idea into a Testable Hypothesis about the relationship between the variables. • Choosing An Appropriate Research Design. • Selecting a Sample. ID the target population and detmine how the sample will be selected from pop. • Conducting the Study and collect and record data. • Analyzing the Obtained Data using appropriate descriptive and inferential statistical techniques. • Reporting the Results
Independent Variable
(treatment or intervention, must have at least 2 levels = X): When it affects or alters status of another variable = Dependent Variable (outcome which is observed and measured = Y). “What is the effect of the Independent variable on the dependent variable?”
Defining and Measuring Variables:
Once IV and DV ID’d, they must be operationally defined in terms of method or process used to ID or measure them. Sometimes it is a behavior to be observed and must decide how to record or measure it. Protocol Analysis is a form of content analysis, verbalizations thought out loud of problem solving are recorded and coded in terms of relevant categories like intentions, cognitions, planning and evaluations.Can look at a sample rather than complete record. Interval recording useful to divide complex behaviors up or when there is not clear beginning or end. Event sampling, observe behavior each time it occurs, good if it is infrequent or long or that leave a permanent record, ie worksheet. Situational sampling observing in a number of settings. Sequential analysis, coding sequences to study complex social behaviors.
True experimental research
provides enough control to conclude that observed variability in DV is caused by variability in IV, through control of conditions, levels of variables and *****random assignment of subjects to groups.
Quasi-experimental research
= can not control assignment of subjects to groups and must use intact pre-existing groups or single treatment group.
Sampling Techniques
Sample must be representative of population to maximize generalizability of results. Systematic sampling (selection) techniques include: • Simple Random Sampling: Every person has = chance of being picked. • Stratified Random Sampling: If population varies in specific “strata”, use stratified random sampling to ensure that each stratum is represented in the sample. Divide according to specific strata and then randomly select subjects from each stratum ie age, race, education. • Cluster Sampling: selecting units of individuals and then select all or randomly select from unit (multistage cluster sampling) . Useful if don’t have access to full population.
Methods of Control in Experimental Research
2 questions: Is there a relationship between the IV and DV? If so, is the relationship a causal one? To accurately answer, depends on extent design allows control of 3 factors that cause variability in DV: • The IV (experimental variance) • Systematic error (error due to extraneous variables) • Random error (error due to random fluctuations in subjects, conditions, methods of measurement) To be more certain observed variability in DV is due to IV than error: Choose design that: • Maximizes variability in DV due to IV. • Control variability due to extraneous variables • Minimize variability caused by random error Control is maximized if true experimental study.
Maximizing Variability Due to the Independent Variable(s)
True experimental research enhances ability to maximize variability due to IV by allowing levels of IV to be as different as possible so effects on DV can be detected.
Extraneous (confounding) variable
is a source of systematic error, irrelevant to he purpose of the study but confounds results as it has a systematic effect on (correlates with) the dependent variable.
Random Assignment of Subjects to Treatment Groups (Randomization):
equalizes all effects and is the most “powerful” method of experimental control which makes it true experimental research.
Holding the Extraneous Variable Constant:
Eliminate effects by selecting subjects who are homogenous with respect to the variable. Problem: Limits generalizability of research results.
Matching Subjects on the Extraneous Variable
: Match subjects in status on that variable and randomly assign matched subjects to 1 of the treatment groups. Matching is useful when sample size is too small to guarantee random assignment will equalize groups with regard to the extraneous variable.
Building the Extraneous Variable into the Study (“Blocking”):
Control the extraneous variable by including it is the study as an additional IV so effects on DV can be statistically analyzed. Subjects are blocked (grouped) on the basis of their status on the extraneous variable. Subjects in each block are then randomly assigned to 1 of the treatment groups. ie, blocked in terms of severity of an illness.
Statistical Control of the Extraneous Variable:
When you know each subjects status on the EV, can use the ANCOVA or other statistical technique to remove variability in the DV which is due to the EV, by equalizing all subjects with regard to their status on the variable to remove the effects. Useful in quasi-experimental research in which can not randomly assign to treatment groups.
Minimizing Random Error
Through experimental research, can minimize random fluctuations by controlling conditions and procedures ie make sure subjects do not become fatigued, they are free from distractions and that measuring devices are reliable. Important: In choosing research design, pick one that minimizes the effects of both systematic and random error and understand the differences between them.
Threats to Internal Validity
Internal Validity when it allows an investigator to determine if there is a causal relationship between the IV and DV. Internal Validity is threatened when can not control the 3 sources of variability in previous section. Campbell and Stanley: 7 generic extraneous variables that if not controlled can threaten study’s internal validity: Maturation, History, statistical regression, testing, selection, attrition, interaction with selection
Maturation IV Threat:
Any biological or psychological change within subjects during the course of a study as a function of time, not relevant to the research hypo and effects the status of subjects on DV in systematic way. ie, fatique, boredom, hunger, intellectual growth. Control by including more than 1 group in the study and randomly assign subjects to each group since they will all be subject to maturation. Single group time series also: measure DV several times at regular intervals before of after the intervention is applied. Does noteliminate but provides information to detect them.
History IV Threat:
when an external event systematically affects the status of subjects on the DV. Historical events a problem with 1 group and even occurs about same time as the IV applied. Include more than 1 group and randomly assign subjects. Ensures all equal in exposure to external event.
Testing IV Threat:
When pre test affects subjects scores on the posttest. Administer DV only once or use 2 groups.
Instrumentation IV Threat:
Changes in measuring devices or procedures such as rater’s increased accuracy. Include more than 1 group and ensure all are subject to the same instrumentation effects.
Statistical Regression IV Threat:
Extreme scores “regress”, move toward the mean when the measure is readministered to the same group of people = statistical regression. Happens when selected due to extreme scores. Include more than 1 group and that all groups have some who are similarly extreme.
Selection IV Threat:
When method used to assign subjects results in systematic differences between groups at beginning of the study. Problem with intact groups. Control by random assignment or pretest to subjects to determine if they differ initially with the DV.
Attrition IV Threat:
When those who drop out are different in an important way. Pretests can determine if drop outs differed.
Interactions with Selection IV Threat:
With groups initially nonequivalent, selection can act alone or interact ie with history if 1 group exposed and 1 not. Selection is really an assignment problem.
External Validity
when its findings can be generalized to other people, settings and conditions. Can distinguish Population validity (generalize to other people) and ecological validity (generalize to other settings, problem in analogue studies in laboratory or non-naturalistic setting). External validity is always limited by its internal validity, but a high internal validity does not guarantee external validity. Campbell and Stanley ID’d 4 factors that threaten external validity: Interaction Between Testing and Treatment, Interaction between selection and treatment, reactivity, multiple treatment
Interaction Between Testing and Treatment Threat to EV:
Pretest can sensitize to purpose of the study and alter reaction to the IV. Control by not using a pre test or using Solomon 4group design which enable investigator to measure the impact of pretesting on both the external and internal validity of the study. Pretest is treated as an additional IV so effects on the DV are statistically analyzed.
Interaction Between Selection and Treatment Threat to EV:
When subjects included have characteristics that make them respond to the IV in a particular way, ie they are volunteers who tend to be more motivated than non volunteers so more responsive to the IV. Ensure that the sample is representative of the population of interest.
Reactivity (Reactive Arrangements):
Respond in a certain way because subjects know being noticed or observed= reactivity. May have evaluation apprehension. Can also be altered by demand characteristics or cues in the experimental setting that inform subjects of the purpose of the study or suggest what is expected of them. Biased by experimenter expectancy: provide cues to subjects or computational errors are likely to support research hypothesis. Recheck what conflicts with hypothesis than what supports it. Control by deception, unobtrusive (nonreactive)measures or single (don’t know what treatment group assigned) or double blind technique( subjects nor experimenter know which group subjects assigned to).
Multiple Treatment Interference (Order Effects, Carryover Effects):
When exposed to 2 or more levels of IV in within subjects design: effects of one level can be effected by effects of previous exposure. Control by counterbalanced design,: different subjects receive the levels of the IV in a different order. Latin square design = administer IV so it appears the same number of times in each position.
Between-Groups (between-subjects) Designs:
different levels of the IV to different groups the compare on DV. Can expand with more than 2 levels of single IV or 2 or more IVs. When 2 or more IV = factorial design which allows more thorough information: can analyze main effects of each IV and interaction between IVs. Distinguish between main and interaction effects. Main effect = effect of 1 IV on the DV, disregarding effects of all other IVs.