Unit 3: Non-Experimental Research Methods Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Non-Experimental Research

A

Research that LACKS:

  1. Manipulation of an independent variable

AND/OR

  1. Random assignment of participants to conditions, or orders of conditions

Does not identify causal relationship between dependent and independent variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What kinds of research questions are suited to nonexperimental research?

A
  1. Ask about a single variable (rather than relationship between 2 or more variables)
  2. Ask about a noncausal relationship between variables (correlation)
  3. Ask about a causal relationship, provided the independent variable is not manipulated and participants are not randomly assigned to conditions
  4. Ask about a broad or exploratory observation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Main types of nonexperimental research

A
  1. Single-variable research
  2. Correlational research
  3. Quasi-experimental research
  4. Qualitative research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Single-variable research

A

Main interest is in one variable

Ex: Milgram’s first obedience study, all participants performed same task under same conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Correlational research

A

2 variables of interest, no control of other possible variables

How does change in one variable relate to change in another?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Qualitative research

A

Data are nonnumerical, often categorical

Data cannot be analyzed statistically

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Strong correlation

A

Represented by an r value between +/- .7 and .9

x and y values almost always go together; few exceptions

In a scatterplot, data points are more tightly arranged along the sloped line

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Weak correlation

A

Represented by an r value between +/- .1 and .3

x and y values go together some of the time; many exceptions

In a scatterplot, data points are very spread out along the sloped line

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Moderate correlation

A

Represented by an r value between +/- .4 and .6

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Types of data collection associated with correlational research

A
  1. Naturalistic observation

2. Archival data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Naturalistic observation

A

Observing behaviour in the environmental setting in which it normally takes place

Participants are usually unaware they are being studied

Researches must consider:

  1. Sampling; decide who to observe, what to include in data collection
  2. Measurement; decide what specific behaviours to measure, use coding to clearly define a set of target behaviours so they can be categorized, especially when relying on observer’s judgment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Archival data

A

Data that have already been collected for some other purpose

If data cannot be easily quantified, content analysis is used to identify specific keywords, phrases, ideas so that instances can be counted, timed, or analyzed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Advantages of Naturalistic Observation

A
  1. Creation of theories, ideas for future research
  2. Results are more easily generalized to the real world
  3. Allows for study of phenomena that can’t be replicated in an experiment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Limitations of Naturalistic Observation

A
  1. Can’t determine causation
  2. Prone to bias; researchers’ expectations can impact how they interpret observations
  3. Presence of researchers can impact behaviour being observed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Advantages of Archival Research

A
  1. Response bias is minimized; researchers are not present when subjects respond
  2. Plentiful data already exists; is often cheaper than other research
  3. Can be used to confirm if theoretical explanations apply to the real world
  4. Help generate new hypotheses to be tested experimentally
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Limitations of Archival Research

A
  1. Selective deposit; only certain ideas/responses are chosen to be recorded; can be skewed to look more politically correct or socially acceptable, rather than accurately reflect the real world
  2. Survival of archives is selective, could reflect bias
  3. Data could include errors
  4. Definitions of terms change over time; might refer to a different group now than it did 50 years ago
  5. Collection of data could be biased; recording a suicide as an accidental death to protect privacy of family
  6. Can’t determine causation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Case Study

A

An example of qualitative research

Intensive, thorough examination of one subject (or a small group of subjects) with a unique characteristic

The goal is to understand in detail the individual experience of participant (rather than drawing generalized conclusions about humanity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Advantages of Case Studies

A
  1. Allow study of rare phenomena that may otherwise be unethical to study experimentally
  2. Can generate new theories to be tested experimentally
  3. Can challenge existing theories; provide counter-examples
  4. Can provide tentative support for current theories
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Limitations of Case Studies

A
  1. Can’t determine causation; confounding variables
  2. Interpretation bias; often researcher records and participates in treatment
  3. Can’t generalize from a single case
  4. Can offer people false hope; one success story can persuade others to choose unproven treatment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Internal validity

A

The extent to which a research design supports the conclusion that manipulation of the independent variable causes a change in the dependent variable; how well the results can determine causation

Experimental research has highest degree

Quasi-experimental research has moderate degree

Non-experimental research has lowest degree

21
Q

External validity

A

The degree to which a study ensures that potential findings apply to different settings or samples; how generalizable the results are

Relates to how a study was conducted

Are higher when the participants and the situation studied are similar to those that the researchers want to generalize to and participants encounter everyday

Often described as mundane realism

22
Q

Subject variables

A

Characteristics that participants possess prior to being assigned to a group

Ex: height, weight, sex

Not a true independent variable because researchers do not manipulate them

23
Q

Quasi-Experimental research

A

Research method resembles an experiment, but the researchers do not directly manipulate the variables

Participants are not randomly assigned to conditions

The independent variable is indirectly manipulated before the dependent variable is measured

Ex: Studies that group males in one condition and females in another condition

Often used when manipulation of variables is impractical, unethical, or impossible

Ex: Used to evaluate the effectiveness of a treatment in a field setting, such as psychotherapy or an educational intervention

24
Q

Advantages of quasi-experimental research

A
  1. Allows study of variables that are impractical, unethical, or impossible to manipulate
  2. Easier to set up than standard experiments because there is no need for random assignment of participants
  3. High potential for external validity because natural environments are less artificial than a controlled lab setting
  4. Natural setting allows for generalizations to be made to larger population
25
Q

Limitations of quasi-experimental research

A
  1. Due to lack of random assignment, it is exposed to confounding variables. Therefore, internal validity is lower than experimental research
  2. Can’t determine causation because researchers lack total control over extraneous variables
26
Q

Nonequivalent groups design

A

A between-subjects research design in which participants have not been randomly assigned to conditions

A form of quasi-experimental research

27
Q

Pretest-posttest design

A

When the dependent variable is tested once before treatment is implemented, and once after

28
Q

Regression to the mean

A

When an individual scores extremely on a variable one time, the next time they will tend to score less extremely (closer to the individual’s mean score)

29
Q

Cross-sectional research

A

Assesses several different groups at approximately the same time and then compares these groups

Often used when investigating the relationship between age and other variables of interest

30
Q

Advantages of cross-sectional research

A
  1. Efficient to conduct because many groups can be studied at once
  2. Can suggest new relationships between variables and generate new research questions
  3. Can support/disconfirm theories studied in artificial settings
  4. Allow us to study variables, like age, that cannot be manipulated experimentally
31
Q

Limitations of cross-sectional research

A
  1. They are always confounded, cause‐and‐effect relationships can never be determined
  2. The possibility that the groups differ in multiple ways may artificially exaggerate the differences between groups
32
Q

Longitudinal research

A

Involve following a group of individuals over time and repeatedly measuring their behaviour

Often used in developmental psychology when the subject‐variable age is studied

33
Q

Selective attrition

A

In longitudinal research, the non‐random loss of participants over time

Ex: Sprinters that remain competitive are more likely to continue participating than sprinters who have become slower and stopped competing

34
Q

Advantages of longitudinal research

A
  1. Individual differences are minimized because the same participants are measured over time
  2. Can suggest new relationships between variables and generate new research questions
  3. Can support/disconfirm theories studied in artificial settings
  4. Allow us to study variables, like age, that cannot be manipulated experimentally
35
Q

Limitations of longitudinal research

A
  1. Relatively expensive in terms of time, money, and effort; difficult to track down participants after years have passed
  2. Selective attrition can bias samples
  3. They are always confounded, cause‐and‐effect relationships can never be determined
  4. Differences in time between measurements may artificially minimize any differences between times
  5. Vulnerable to practice effect
36
Q

Survey research

A

Consists of administering a series of predetermined questions to a group of individuals

When every individual in a population is included, it is called a census

When data is collected from a subset of the population, it is called a sample

37
Q

Advantages of survey research

A
  1. Can be done quickly
  2. Large samples can be done with a low cost
  3. Anonymity allows study of personal or embarrassing subjects
  4. Online surveys can be configured to counterbalance the order of questions, or even to tailor subsequent questions based on the respondent’s earlier responses
  5. Can suggest new relationships between variables and generate new research questions
38
Q

Limitations of survey research

A
  1. Respondents may not understand the questions
  2. Order questions are answered may influence responses; not way to guarantee it is completed in order
  3. Results are only as good as the sample that completes the survey; will include any sampling bias
  4. Responses can be influenced by “demand characteristics”; participants interpret the researchers’ purpose and change responses
  5. The format of the question may also influence responding
39
Q

Item-order effect

A

When the order in which survey items are presented affects people’s responses

40
Q

Common threats to internal validity (in nonexperimental design)

A

Acronym “MRS SMITH”:

  1. Maturation
  2. Regression to the mean
  3. Selection of subjects
  4. Selection of maturation interaction
  5. Mortality
  6. Instrumentation
  7. Testing
  8. History
41
Q

Maturation (in relation to internal validity)

A

Physiological processes that occur in the participant that could explain a change in behaviour

Changes in scores between testing sessions may simply be due to the passage of time rather than any treatment effects

Ex: natural aging; hunger; fatigue

42
Q

Regression to the mean (in relation to internal validity)

A

The tendency that participants who receive extreme scores when tested, tend to have less extreme scores on subsequent retesting even in the absence of any treatment effects

43
Q

Selection of subjects (in relation to internal validity)

A

Any bias in selecting and assigning participants to groups that results in systematic differences between the participants in each group.

44
Q

Selection of maturation interaction (in relation to internal validity)

A

The treatment and no-treatment groups, although similar at one point, would have grown apart (developed differently) even if no treatment had been administered

45
Q

Mortality (in relation to internal validity)

A

Differential dropping out of some subjects from the comparison groups before the experiment is finished, resulting in differences between the groups that may be unrelated to the treatment effects

46
Q

Instrumentation (in relation to internal validity)

A

Changes in the measurement procedures may result in differences between the comparison groups that are confused with the treatment effects

47
Q

Testing (in relation to internal validity)

A

When participants are repeatedly tested, changes in test scores may be more due to practice or knowledge about the test procedure gained from earlier experiences rather than any treatment effects

48
Q

History (in relation to internal validity)

A

Extraneous events occurring during the course of the experiment that may affect the participants’ responses on the dependent measure

Ex: Major social events, equipment malfunctions within experimental situation