Chapter 3: Research methods and study design Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

What are the steps to forming a good experimental design?

A
  1. Select the population
  2. Operationalize variables
  3. Divide into groups
  4. Random sampling
  5. Random assignment
  6. Measurement
  7. Test the hypothesis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the objectives in the “select the population” step?

A
  1. Determine the population of interest
  2. Consider what group will be pragmatic to sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the common flaws in the “select the population” step?

A
  1. Population is too restrictive
  2. Sampling all individuals of interest is not practical
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the objectives in the operationalize variables step?

A
  1. Determine the independent and dependent variable
  2. Specify exactly what is meant by each variable
  3. Make sure the dependent variable can be measured quantitatively within the parameter of the study
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the objectives in the divide into groups step?

A
  1. Carefully select experimental and control groups
  2. Homogenize the two groups
  3. Isolate the treatment by controlling for potential extraneous variable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the flaw in the operationalized variable step?

A
  1. Insufficient rigor in the description
  2. Manipulation of the independent variable presents practical problems
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the flaws in the divide into groups step?

A
  1. Control group does not resemble treatment along important variable
  2. Experiments is not double-blind
  3. Participants can guess the experiment, allowing a placebo effect to occur
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the objective in the random sampling step?

A
  1. Make sure all members of the population are represented
    2.. Ideally each member has an equal chance of being selected
  2. Meeting these criteria is often not possible for practical reasons
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the flaws in the random sampling step?

A
  1. Sampling is not truly random
  2. Sample does not represent the population of interest
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the objectives of the random assignment step?

A
  1. Individuals who have been sampled are equally likely to be assigned to treatment or control
  2. Consider matching along potential extraneous variable which have been pre-selected
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the flaws in the random assignment step?

A
  1. Groups are not properly matched
  2. Assignment is not perfectly random
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the objective of the measurement step?

A
  1. Make sure measurements are standardized
  2. Make sure instruments are reliable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the flaws in the measurement step?

A
  1. Tools are not precise enough to pick up a result
  2. Instruments used for measurements are not reliable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the objectives in the test the hypothesis step?

A
  1. Use statistics to check for a significant difference
  2. Assign a pre-established threshold at which the null hypothesis will be rejected
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the flaw in the test the hypothesis step?

A
  1. Small sample size leads to insufficient power
  2. Researchers do not set thresholds in advance and make after the fact conclusion that lead to logical fallacies
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Impression management

A

Participants adapt their responses based on social norms or perceived researcher expectations, self-fulling prophecy, a methodology is not double-blind, Hawthrone effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Confounding variables

A

Extraneous variable not accounted for in the study, another variable offers an alternative explanation for results, lack of a useful control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Lack of reliability

A

Measurement tools do not measure what they purport to, lack consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Sampling bias

A

Selection criteria are not random, the population used for the sample does not meet conditions for a statistical test (e.g., the population is not normally disturbed)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Attrition effects

A

Participants fatigue, participants drop out of the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Demand characteristics

A

Participants interpret what the experiment is about and subconsciously respond in ways that are consistent with the hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Experiment doesn’t reflect real world

A

Laboratory setups that don’t translate to the real world, lack of generalizability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Selection criteria

A

Too restrictive of inclusion/exclusion criteria for participants (i.e., sample is not representative)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Situational effects

A

Presence of laboratory conditions changes outcome (e.g., pre-test and post-test, presence of experimenter, claustrophobia in an MRI machine)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Lack of statistical power

A

Sample groups have high variability, sample size too small

26
Q

What are the non-experimental designs?

A
  1. Correlational
  2. Ethnographic
  3. Twin
  4. Longitudinal
  5. Case
  6. Phenomenological
  7. Survey
  8. Archival
  9. Biographical
  10. Observational
27
Q

Correlational

A

Measures the quantitive relationships between two variables

28
Q

Ethnographic

A

Deep lengthy qualitative analysis of culture and its characteristic

29
Q

Twin

A

Analysis of heritability through measuring characteristic of twins

30
Q

Longitudinal

A

Long-term analysis that intermittently measures the evolution of some behavior or characteristic

31
Q

Case

A

Deep analysis of a single case or example

32
Q

Phenomenological

A

Self-observation of phenomenon by researcher or small group of participants

33
Q

Survey

A

Use of a series of questions to allow participants to self-report behaviors or tendencies

34
Q

Archival

A

Analysis of historical records for insight into a phenomenon

35
Q

Biographical

A

Exploration of the events and circumstances of an individual’s life

36
Q

Observational

A

Broad category that includes any research in which experiments do not manipulate the situation or results

37
Q

What are the strengths and weaknesses of correlational study?

A

Strengths:
1. Great preliminary technique
2. Usually easy to conduct

Weaknesses:
1. Does not establish causality
2. May not pick up a nonlinear relationship

38
Q

What are the strengths and weaknesses of Ethnographic study?

A

Strength:
1. Provides detailed analysis and comprehensive evaluation

Weaknesses:
1. Researcher’s presence may affect an individual’s behavior
2. Heavily dependent on the researcher conducting the study, difficult to replicate,, and objectivity may not be compromised

39
Q

What are the strengths and weaknesses of Twin study?

A

Strengths:
1. Offers insight into how nature and nurture might interact to lead to various characteristics

Weaknesses:
1. Difficult to find participants who meet the criteria
2. Difficult to analyze the complex variable involved and how they interact

40
Q

What are the strengths and weaknesses of Longitduinal study?

A

Strengths:
1. Scientist can understand how trait of interest changes over time

Weaknesses:
1. Logistically demanding expensive and difficult to implement
2. High attrition rate

41
Q

What are the strengths and weaknesses of Case study?

A

Strength:
1. Offers comprehensive details about the single case

Weaknesses:
1. Results may not be generalizable
2. Does not offer points of reference or comparison

42
Q

What are the strengths and weaknesses of Phenonmenological study?

A

Strengths:
1. Introspection can provide insight into behaviors and occurrences that are difficult to measure

Weaknesses:
1. Lacks objectivity due to results coming from self-analysis
2. Difficult to generalize results to other circumstances or individuals

43
Q

What are the strengths and weaknesses of Survey study?

A

Strengths:
1. Easy to adminster
2. Can provide quantitative data that can be compared to large participants pools

Weaknesses:
1. Self-reporting creates limitations in objectivity

44
Q

What are the strengths and weaknesses of Archival study?

A

Strengths:
1. Provide insight into events from the past that are unique from every-day behavior

Weaknesses:
1. Quality of analysis subject to the quality and integrity of records
2. Difficult to conduct follow-ups
3. Data are unlikely to be comprehensive, leaving ambiguity and unanswered questions

45
Q

What are the strengths and weaknesses of Biographical study?

A

Strengths:
1. Comprehensive knowledge of all the details of an individual’s life

Weaknesses:
1. Limitations in objectivity
2. Diffculuts to generalizing observations

46
Q

What are the strengths and weaknesses of Observational study?

A

Strengths:
1. Naturalistic observation of circumstances as they are
2. Difficult to tease out the complex interplay of many variables

47
Q

The ________ method is the primary method used by researchers to establish causality

A

Experimental

48
Q

The ________ variable is the variable manipulated by the researcher

A

Independent

49
Q

The _______ variable is the variable that is measured to test for an effect

A

Dependent

50
Q

An _________ definition is a precise definition of the meaning of research variables

A

Operational

51
Q

____________ indicates numerical, whereas ________ indicates descriptive or categorical

A

Quantitative, Qualitative

52
Q

A ________ group is the group researcher use as a point of comparison, it doesn’t receive the treatment

A

Control

53
Q

An ______________ group is the group that does receive the treatment in a study

A

Experimental

54
Q

Extraneous variables

A

Variables other than the research variable that could potentially explain a result in an experiment

55
Q

A sample within research should reflect the ______________

A

Population

56
Q

Individuals who are sampled from the population should be _______ assigned to the control and experimental group

A

Randomly

57
Q

In _____________, researchers assign the null hypothesis, the hypothesis that any effects are due to chance and there is no experimental result

A

hypothesis testing

58
Q

Type 1 error

A

Known as false positive, rejecting the null hypothesis when in fact it is true

59
Q

Type 2 error

A

Known as false negative, accepting the null hypothesis when in fact it is false

60
Q

Internal validity

A

How well done a study is or how well it allows researchers to draw conclusions from measured effects

61
Q

External validity

A

How well a research results apply to the population at large and real-life scenarios

62
Q

_____________ methodologies, don’t allows researchers to draw conclusions about causality

A

Non-experimental