Unit 3: Non-Experimental Research Methods Flashcards
Non-Experimental Research
Research that LACKS:
- Manipulation of an independent variable
AND/OR
- Random assignment of participants to conditions, or orders of conditions
Does not identify causal relationship between dependent and independent variables
What kinds of research questions are suited to nonexperimental research?
- Ask about a single variable (rather than relationship between 2 or more variables)
- Ask about a noncausal relationship between variables (correlation)
- Ask about a causal relationship, provided the independent variable is not manipulated and participants are not randomly assigned to conditions
- Ask about a broad or exploratory observation
Main types of nonexperimental research
- Single-variable research
- Correlational research
- Quasi-experimental research
- Qualitative research
Single-variable research
Main interest is in one variable
Ex: Milgram’s first obedience study, all participants performed same task under same conditions
Correlational research
2 variables of interest, no control of other possible variables
How does change in one variable relate to change in another?
Qualitative research
Data are nonnumerical, often categorical
Data cannot be analyzed statistically
Strong correlation
Represented by an r value between +/- .7 and .9
x and y values almost always go together; few exceptions
In a scatterplot, data points are more tightly arranged along the sloped line
Weak correlation
Represented by an r value between +/- .1 and .3
x and y values go together some of the time; many exceptions
In a scatterplot, data points are very spread out along the sloped line
Moderate correlation
Represented by an r value between +/- .4 and .6
Types of data collection associated with correlational research
- Naturalistic observation
2. Archival data
Naturalistic observation
Observing behaviour in the environmental setting in which it normally takes place
Participants are usually unaware they are being studied
Researches must consider:
- Sampling; decide who to observe, what to include in data collection
- Measurement; decide what specific behaviours to measure, use coding to clearly define a set of target behaviours so they can be categorized, especially when relying on observer’s judgment
Archival data
Data that have already been collected for some other purpose
If data cannot be easily quantified, content analysis is used to identify specific keywords, phrases, ideas so that instances can be counted, timed, or analyzed
Advantages of Naturalistic Observation
- Creation of theories, ideas for future research
- Results are more easily generalized to the real world
- Allows for study of phenomena that can’t be replicated in an experiment
Limitations of Naturalistic Observation
- Can’t determine causation
- Prone to bias; researchers’ expectations can impact how they interpret observations
- Presence of researchers can impact behaviour being observed
Advantages of Archival Research
- Response bias is minimized; researchers are not present when subjects respond
- Plentiful data already exists; is often cheaper than other research
- Can be used to confirm if theoretical explanations apply to the real world
- Help generate new hypotheses to be tested experimentally
Limitations of Archival Research
- Selective deposit; only certain ideas/responses are chosen to be recorded; can be skewed to look more politically correct or socially acceptable, rather than accurately reflect the real world
- Survival of archives is selective, could reflect bias
- Data could include errors
- Definitions of terms change over time; might refer to a different group now than it did 50 years ago
- Collection of data could be biased; recording a suicide as an accidental death to protect privacy of family
- Can’t determine causation
Case Study
An example of qualitative research
Intensive, thorough examination of one subject (or a small group of subjects) with a unique characteristic
The goal is to understand in detail the individual experience of participant (rather than drawing generalized conclusions about humanity)
Advantages of Case Studies
- Allow study of rare phenomena that may otherwise be unethical to study experimentally
- Can generate new theories to be tested experimentally
- Can challenge existing theories; provide counter-examples
- Can provide tentative support for current theories
Limitations of Case Studies
- Can’t determine causation; confounding variables
- Interpretation bias; often researcher records and participates in treatment
- Can’t generalize from a single case
- Can offer people false hope; one success story can persuade others to choose unproven treatment