Research Methods and Study Designs Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

What is a dependent variable?

A

The variable being that is being measured (that is affected by the independent variable)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the independent variable?

A

The variable being manipulated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is reproducibility?

A

Refers to the ability of an experiment and its results being reproduced by other experimenters/researchers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is an operational definition?

A

a specification of precisely what each variable in a study means

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Distinguish between quantitative and qualitative.

A

quantitative: a numerical value (which allows for statistical analysis)
qualitative: a descriptive value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does a homogenous control or group refer to?

A

A group that is the same throughout, and as similar as possible to the experimental group.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an extraneous/confounding variable?

A

variables other than the treatment that could potentially explain an experimental result

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the main purpose of a double blind experiment?

A

to help counter the placebo affect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is sampling bias?

A

Refers to when not all members of a population are equally likely to be sampled for an experiment. i.e. social research at a university randomly samples undergraduate students for a study (because that’s the most readily available surrounding population), but then applies the results of the study to the general population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is selection bias?

A
  • a general category of systemic flaw in a design that can compromise results i.e. sampling bias, attrition bias
  • another type of selection bias is purposefully selecting which studies to evaluate in a meta-analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is attrition effects?

A

Refers to participants dropping out of a study for reasons that are not random; can be caused by participant fatigue. This might introduce an extraneous variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the randomized block technique?

A

Refers to when researchers evaluate where participants fall along the variables they wish to equalize across experimental and control groups. Then they randomly assign individuals from these groups so that the treatment and control groups are along similar variables of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

The most important aspects of measurement for an experiment are that the dependent variable is__1__ and that the instruments are __2__

A

1) quantitative

2) reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does it mean for instruments to have reliability?

A

means that the instrument produces stable and consistent results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does replicability refer to?

A

repeated measurements (i.e. by instruments) lead to similar results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is construct validity?

A

the measurements of an experiment measure what they’re supposed to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is psychometrics?

A

the study of how to measure psychological variables through testing i.e. how to test mood, memory, attitude, etc.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is response bias?

A

the tendency for respondents to have conditions or biases that influence their responses, resulting in them providing untruthful/inaccurate answers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is between-subjects design?

A

refers to when comparisons are made between subjects, from one group to another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is within-subjects design?

A

refers to when the same group is compared at different time points

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is mixed methods research?

A

any combination of different research techniques i.e. using both between-subjects and within-subjects design, or using both quantitative and qualitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Distinguish between Type 1 and Type 2 error. Which one is generally worse to make?

A

Type 1: to falsely suppose the veracity of a result that does not actually exist (a false positive)
Type 2: incorrectly conclude that there is no effect (aka a false negative)
Type 1 error is generally worse

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is a null hypothesis?

A

the hypothesis that assumes there is no causal relationship between the variables and any effect that is measured, if there is one, is due to chance.
think of this as the objection hypothesis to the actual scientific/experimental hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the experimental hypothesis in comparison to the null hypothesis?

A

the proposition that variations in the independent variable cause changes in the dependent variable (which is the opposite of the null hypothesis)

25
Q

What does it mean when the null hypothesis is rejected?

A

Rejecting the null hypothesis is proving that there is a measured significant difference in the data, which then means that the actual scientific/experimental hypothesis is supported.

26
Q

What is a significant difference?

A

a measured difference between 2 groups that is large enough that it is probably not due to chance.
usually this observed difference is 5% (or 0.05) or less

27
Q

What is a p-value?

A

a number between 0 to 1 that represents the probability that a difference observed in an experiment is due to chance.
usually if p <0.05, scientists reject the null hypothesis

28
Q

What is the “power” of the experiment? What increases the power of the experiment?

A

Refers to the ability of an experiment to pick up an effect if one is actually present
The larger the sample size, the more power the experiment will have.

29
Q

Does a lower or higher p-value represent a stronger relationship?

A

a lower value; the lower the value, the stronger the relationship

30
Q

Small sample sizes leads to insufficient _____

A

power

31
Q

What is external validity?

A

the extent to which findings can be generalized to the real world

32
Q

What is internal validity?

A

the extent to which a researcher can say that the change in the outcome/dependent variable is actually due to the intervention/independent variable (and not due to an extraneous variable or any inherent flaw in the design)

33
Q

What are demand characteristics?

A

the tendency of participants to consciously or subconsciously act in ways that match how they are expected to behave i.e. participants interpret what the experiment is about and respond in ways that are consistent with the hypothesis
this is a threat to internal validity

34
Q

What is impression management?

A

participants adapt their responses based on social norms or perceived researcher expectations: self-fulfilling prophecy, methodology is not double blind, or Hawthorne Effect

35
Q

What is the Hawthorne effect?

A

refers to the tendency of people to work harder and perform better when they are part of an experiment

36
Q

What is lack of generalizability?

A

laboratory setups that don’t translate to the real world

37
Q

How can selection criteria of an experiment threat the validity of the experiment?

A

too restrictive of inclusion/exclusion criteria for participants will not be a true representative of the population

38
Q

What are situational effects and how do they threat validity?

A

situational effects refer to laboratory/experimental conditions that change the outcome i.e. pre-test and post-test, presence of the experimenter, claustrophobia in an MRI machine

39
Q

what 2 aspects can cause an experiment to lack statistical power

A

sample size is too small

sample groups have a high variability

40
Q

_______ design offers the only way to confidently establish a causal relationship between 2 variables

A

experimental

41
Q

What is Pearson Correlation?

A

assigns a number from -1 to +1 to a pair of variables
if the value is negative, the 2 variables are negatively correlated
if the value is positive, the 2 variables are positively correlated
a value of 0 = no correlation

42
Q

what are correlational studies?

A

they explore the relationship between 2 quantitative variables

43
Q

what are ethnographic studies?

A

a qualitative method in which researchers immerse themselves completely in the lives, culture, or way of life of ppl they are studying. These studies tend to be lengthy and thorough and involve as little interference or intervention by the researchers as possible

44
Q

What are twin studies?

A

often test the relationship between nature and nurture

they are the best way to measure heritability (the extent to which a trait is due to genetics and not the environment)

45
Q

What are longitudinal studies?

A

involves measuring dependent variables over long time frames

these studies are expensive, hard to execute, and have high attrition rates

46
Q

What is a cross-sectional study?

A

involves data collection or looking at data from a population at one specific point in time

47
Q

what are case studies?

A

in-depth exploration of one individual or case; explores the potential causes that lead to a phenomenon

48
Q

what are a phenomenological studies?

A

uses an introspective method to explore research questions: researchers study themselves through self observation, or researchers record what individuals report about their own personal experience

49
Q

What are 2 benefits and 3 potential flaws of surveys?

A

2 benefits: easy to administer and cost effective
3 flaws: unrepresentative sample; respondents may not feel encouraged to provide accurate, honest answers; must be checked for reliability and consistency to be sure they measure the variable they are designed to (i.e. poor survey questions)

50
Q

what are archival studies?

A

analyze already collected data from historical records and authentic original documents

51
Q

What are biographical studies?

A

exhaustive accounts of an individual’s life experience

52
Q

What are observational studies?

A

any study in which individuals are observed and outcomes measured with no attempt to control the outcome

53
Q

What are threats to internal validity? (5)

A
  • impression management (demanding characteristics, self-fulfilling prophecy, not double blind, or Hawthorn effect)
  • confounding/extraneous variables (variables not accounted for in the study or lack of useful control)
  • lack of reliability (instruments don’t measure what they’re supposed to or lack consistency),
  • sampling bias (i.e. sampling is not random or representative of the population)
  • attrition effects (participant fatigue and participants dropping out of the study)
54
Q

What are threats to external validity? (4)

A
  • experiment/laboratory set-up doesn’t reflect the real world
  • selection criteria: too restrictive of inclusion/exclusion criteria for participants and therefore sample is not representative
  • situational effects: laboratory conditions changes outcome i.e. pre and post tests, presence of experimenter, claustrophobia in MRI machine
  • lack of statistical power: sample size is too small or groups have high variability
55
Q

What is the ultimate goal of experimental designs and how do researchers accomplish this goal?

A

to draw causal relationships between 2 variable.
they accomplish this by exerting a lot of experimental control: control vs experimental groups, random sampling and assignment, control of extraneous variables

56
Q

What is the ultimate goal of non-experimental designs?

A

they are simply trying to observe and not trying to intervene a study; they thus are not trying to control the outcome
-a flaw usually involves the researchers doing too much i.e. intervening too much to control the outcome

57
Q

Out of -1, 0, and +1, what is the weakest possible correlation?

A

0

the closer the value is to 1, the stronger the correlation is

58
Q

What is the R value?

A

the correlational value that can range from -1 to +1 (including 0). The value itself will tell you the strength of the correlation. A value of 0.5 is a pretty strong/significant correlation