Chapter 4: Research Methods Flashcards
Internal Validity
the extent to which the interpretation drawn from the results of a study can be justified and alternative interpretations can be reasonably ruled out
External Validity
the extent to which interpretations drawn from the results of a study can be generalized beyond the narrow boundaries of a specific study
Statistical Conclusion Validity
the extent to which the results of a study are accurate and valid based on the type of statistical procedures used in research
Factor Analysis
a statistical procedure used to determine the conceptual dimensions or factors that underlie a set of variables, test items, or tests
Moderator
a variable that influences the strength of the relation between a predictor variable and a criterion variable
Mediator
a variable that explains the mechanism by which a predictor variable influences a criterion variable
Structural Equation Modeling
a comprehensive statistical procedure that involves testing all components of a theoretical model
Randomized Control Trials
an experiment in which research participants are randomly assigned to one of two or more treatment conditions
Clinical Significance
in addition to the results of a study attaining statistical significance, the results are of a magnitude that there are changes in some aspects of participants’ daily functioning
Systematic Review
the use of a systematic and explicit set of methods to identify, select, and critically appraise research studies
Meta-analysis
a set of statistical procedures for quantitatively summarizing the results of a research domain
Effect Size
a standardized metric, typically expressed in standard deviation units or correlations, that allows the results of research studies to be combined and analyzed
What is qualitative research?
better suited to generating hypotheses, describing intricate processes, and export the subjective experiences of small groups of subjects
specifically seeks to avoid establishing parameters which tend to limit the range of participants’ responses
data collection looks like clinical interviewing
qualitative data often take the form of lengthy narratives which are carefully analyzed for the emergence of recurrent themes
What are the disadvantages of qualitative research?
inherent difficulty in comparing studies that purport to examine similar phenomena
small n studies have severely limited generalizability
What are the advantages of qualitative research?
better at illuminating process
What is quantitative research?
based on specific research designs intended to eliminate confounds
designs are available, or can be modified, to accommodate variously-sized research samples, multiple conditions, and the passage of time
the use of validated measures generates data which can be statistically analyzed to identify trends, identify significant between-group differences, and describe performance
this allows for systematic inquiry into specific research questions
deliberately seeks to limit responses
What are confounding factors?
anything that introduces competing explanations for observed phenomena
improves interpretability of results by ruling out alternative explanations
What are the advantages of quantitative research?
well-suited to examining the effectiveness of interventions and describing the population for whom those interventions have proven useful
results are reported in a way that contributes to an ongoing research enterprise
What is the jigsaw puzzle analogy of quantitative research?
think of it as a community of researchers cooperating to assemble a jigsaw puzzle
the idea is to both utilize, and contribute to the existing knowledge base(s)
doesn’t mean you have to base your designs on others’ work, but similar methods are often used
How should the results of studies relate to previous research?
it is incumbent upon the researchers, in reporting their results, to explain the fit of their findings with the existing body of literature
results which appear contradictory to previous findings must be explained with reference to differences in study procedures, participants, analytic methods, etc. or revision of theory
these matters are typically covered in the Discussion section of a research report
Why is educating patients about research important?
it is reasonable for consumers of professional services to expect information concerning: the likely outcomes, the expected benefits, potential risks
based on the results of properly conducted studies
psychologists should not expect patients to participate in treatment on the basis of their professional reputation (“eminence-based practice”)
educating patients about research finding may improve compliance
What is deductive hypothesis generation?
designing research provides opportunities to test hypotheses emerging from various theories
if ______ then _______
to the extent that those hypotheses are disconfirmed, there is an opportunity to modify the theory
this, in turn, will result in new hypotheses which can also be subject to testing
evidence and theory inform one another reciprocally, and a good theory must be able to accommodate existing data
What is the inductive process?
there is an inherently qualitative component to clinical interviewing, and to making observations in the course of providing psychological services
almost invariably, research attempts to explicate the relationship between two or more variables
the hypotheses that emerge from those contacts are colored by our unique personal experiences, theoretical orientation, and perceptions of the client/patient
What is operationalization?
once the research question has been conceptualized, variables must be chosen to translate the (relatively abstract) concept into data
it is often difficult to identify measures that adequately encapsulate complex ideas
may be necessary to choose multiple measures in order to capture the relevant aspects of the concept under study
Why is generalizability important?
it is very important for researchers to appreciate cultural assumptions and obstacles that would compromise the usefulness of the research data when available
this is ultimately a question of generalizability, which speaks to the range of individuals to which the research outcome could potentially be applied
Why is an ethics evaluation important in research?
an ethics evaluation is essential even though it may actually limit the range of designs available
for example, it may be unethical to place individuals in a control group if there is pre-existing evidence that an experimental condition might offer relief from symptoms
What is the goal of research?
almost invariably, research attempts to explicate the relationship between two or more variables
there are essentially three classes of relationship: correlation, moderation, and mediation
What is correlation?
the degree to which two or more variables change together
in a positive correlation, an increase in one is associated with an increase in the other
in a negative correlation, changes in one variable are met with changes in an opposite direction in the other variable
note that no causal relationship can be surmised from correlations alone
What is moderation?
is the treatment equally efficacious for all participants?
e.g., does this intervention for the treatment of bulimia work equally well for boys and girls and for patients of different ages (moderator analysis)
What is mediation?
what is the mechanism of change?
e.g., how does the intervention work? is it changing body image by resist media image or by learning relaxation? (mediator analysis)
What is the Canadian Code of Ethics?
not just about treatment but guides psychologists in all aspects of their practice
