Research EXAM #3 Flashcards
Type 1 vs. Type 2 error
Type I — false (+) if investigator rejects null hypothesis that is actually true in the population
Type II — false (-) if investigator fails to reject a null hypothesis that is actually false in the population
Statistical tests to improve validity
Determine probability of errors:
Type I
Type II
Calculate and report Effect Size
Ensure data meets the basic assumptions of the statistical tests
Empirical literature
this type of literature is based on experiences or observations and displays
how theories apply to individual behavior or observation. E.g. if a medication is going to reduce
BP, then you hypothesize that because the medication reduces BP in will lower the risks for
heart attacks. This notion is based on observation rather than theory
Seminal literature
foundational and classic literature (think o fit as original, first creation of
the concept)
Construct variable
in simple terms it refers to an explanatory variable that cannot be directly
observed. We may be able to observe its effect but not a directly observe it. A good example is
gravity, we know a lot about what gravity does and its effect but we cannot directly see or
observe gravity. So gravity maybe considered a construct variable. Anxiety is another construct
variable. We can observe the outcomes of anxiety such as tension, stress, anger etc.
Correlational (relationship) design
demonstrates a relationship between the variables it may
be a positive relationship or negative relationship
Common Types of Statistical Tests (Inferential tests)
- Independent t-tests: tests for differences in the means between 2 groups
-
Paired t-tests: tests for differences between paired measurements e.g. pretest before
the intervention and post-test after the intervention
Analysis of variance (ANOVA)
F-test - is a statistical test used in experimental or quasi-
experimental research (quantitative). Test is applicable when measuring the means between 2
or more study groups. Only measures one dependent variable. Example in a diabetic study one
group receives oral medication, one group is diet controlled, one group is placebo.
Multivariate analysis of variance (MANOVA)
a statistical test used when measuring 2 or
more dependent variables (outcomes) for the research
– e.g does music therapy and relaxation techniques affect anxiety and panic attacks?
ANOVA vs. MANOVA are
statistical tests
What is the purpose of a chi-square test?
helps detect the relationship between 2 variables but does not demonstrate
the depth or direction of the relationship between the variables
Correlational coefficient (r)
measures correlation (relationship) between 2 variables.
External validity
Generalize the findings from a research study to other populations, places, situations
— It is SO good that nothing needs to change —> generalization = QUANTitative
Why is validity important in search?
It helps to measure what it is supposed to measure
Internal validity
Ensures the intervention worked and the outcome was not based on other causes
—The confidence experimental treatment/condition has made a difference and rival explanations were systemically ruled out through study design and control
— IV caused the outcome (DV)
Generalization is synoymous with ____.
Transferability is synonymous with ____.
QUANTitative = generalization
QUALitative = transferability
Instrumentation
The instrument or data collection process has changed
— e.g. operative error: post-partum tool and how explained vs. someone who is not well-informed, may not use the tool/instrument to the best of its abilities
Describe some biases that can be interjected into a research study
— Personal
— Selection
— Subject
Factors that can interfere with internal validity
– Historical threats
– Maturation
– Testing
– Instrumentation
– Consent effect
– Treatment effect
– Hawthorne effect
– Multiple-treatment effect
– Subject selection
– Attrition
Describe a historical threat
subjects behave in a certain manner because of their exposure to events outside the experiment
– e.g. the occurrence of an actual earthquake during a field study of the effects of training in earthquake preparedness
Bias in research
Sampling error:
A number that demonstrates the difference in the results between the sample and the population it was drawn from
Treatment effects:
A threat to internal validity because the subjects may perform differently
Measurement error:
Difference between actual attribute (true score) and the amount of attribute that was represented (observed score)
Maturation related to internal validity
Too much time has passed with long study
Changes in the research subjects not due to the intervention, because time has passed
— e.g. deterioration of physical characteristics: vision, hearing, taste, memory
— e.g. pain relief w/ cancer patient disease is maturing (stage I —> stage III)
Testing related to internal validty
Familiarity of the research subject w/ testing, especially retesting occurs
— e.g. pre-test then take post-test; knowledge became enhanced
Consent effect
Threat to internal validity occurs. Because the subject who consents to student may differ from those who do not in way that affects outcome of the study
— e.g. change your mind to study after finding out you’re going to be recorded therefore change their mindset/thoughts
Treatment effect
Subject may perform differently b/c they know they are being in a study therefore act the way that looks good
— e.g. masks their behavior b/c if in an anger study, you will hide that anger
How to control extraneous variables
– Eliminate the threat
– Control the threat
– Account for the threat or write-up
Hawthorne effect
Seen as person of power and subject takes on subordinate role; research subjects change their behavior in a study because they are aware of being under observation
— e.g. You are researching the smoking rates among bank employees as part of a smoking cessation program. You collect your data by watching the employees during their work breaks. If employees are aware that you are observing them, this can affect your study’s results
Multiple-treatment effect
An inability to isolate the effects of treatments because multiple treatments are being used at the same timeA
Subject selection/Subject effects (bias)
A threat to internal validity due to introduction of bias through selection or composition of comparing groups assignment of research subjects to groups in a bias manner, not random
- e.g. Health studies that recruit participants directly from clinics miss all the cases who don’t attend those clinics or seek care during the study.
Attrition
Loss of research subjects during the study (possibly due to how long the study is); drop out of study
— e.g. children from troubled families increase the likelihood to drop out/move away in the middle of school year
— e.g. yoga education vs. paper education over 8 weeks —> only 1 showed up/completed the paper education study vs. everyone that completed the yoga education
What factors can affect external validity?
– Population
– Ecological
– Time & historical effects
– Novelty
– Experimenter effect
Threats to external validity
— Selection effects
— Time
— History
— Novelty effects
— Experimenter effects
Threats to trustworthiness in QUALitative research
— Hawthorne effect
— Selection effects
— Historical effects
— Researcher bias
Researcher bias
The primary investigator (PI) poses their thoughts into the study
Population validity
Can the findings be generalized from the sample to a larger group?
The capacity to confidently generalize the results of a study from one group of subjects to another population group
— e.g. can the findings of patients from one medical center be generalized to patients in an entire health care system?
Ecological validity
external validity
Findings can be generalized and applied to other settings
Can findings be generalized from one set of environmental conditions to another?
— e.g. Can the findings be generalized from a medical-surgical unit to a long-term unit.