Survey Design and Experiments Flashcards

1
Q

T or F: sampling is an important part of quantitative research

A

True: especially important when conducting surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is a survey?

A

a specific type of field study that involves the collection of data from a sample of elements drawn from a well-defined population through the use of a questionnaire

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what is the purpose of surveys?

A
  • allow for data collection from a large number of people
  • allow for assessment of self-reported traits, attributes, and behaviors
  • are reliable means of information gathering
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

T or F: surveys do not rely on self-report data

A

FALSE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is self-report data?

A

data provided by a study respondent without inference on the part of the research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is the process of conducting a survey?

A

1) specify the research problem
2) select a survey design
3) generate questionnaire
4) generate data
5) analyze data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

T or F: survey questions should be easy to read and understandable

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

T or F: it’s important to think about “user experience” when designing surveys

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

T or F” a survey should take participants more than 10-12 minutes to complete

A

False: should not take more than 10-12 minutes to complete

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

T or F: personally sensitive questions and demographic questions should appear at the beginning of the survey

A

False: these questions should appear at the end of the survey

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When is it acceptable to have personally sensitive question at the beginning of a survey?

A

when branching or eligibility questions are necessary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What do experiments do?

A

1) demonstrates whether something is true
2) examines the validity of a hypothesis or theory
3) attempts to discover new information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

T or F: experiments are the means by which we detect cause and effect

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a casual relationship between variables?

A

refers to the researcher’s attempts to determine that one or more variables (independent) have caused the changes in another variable (dependent)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What conditions allow for one variable to cause an effect in another variable?

A

1) Correlation
2) Time Order
3) Non-Spuriousness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is correlation?

A

when variables A and B are related to one another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is time order?

A

when changes to variable A result in changes to variable B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what is non-spuriousness?

A

the relationship between variable A and B must not be explained by a third variable (C)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

what is spuriousness?

A

a relationship between variables that seems real, but is explained by the presence of another variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what is causation?

A

states that A causes B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what is association?

A

states that A and B are associated (correlated) with one another

22
Q

T or F: surveys can only point to associations between two variables

A

True

23
Q

T or F: independent variables are varied by researchers

A

True

24
Q

T or F: dependent variables are presumed to be affected by independent variables

A

True

25
Q

what is an independent variable in an experimental research?

A

a variable that is manipulated/changed by the researcher

26
Q

what is a dependent variable in an experimental research?

A

a variable that is measured by the researcher

27
Q

T or F: independent and dependent variables are something we think about in all forms of qualitative research

A

False: quantitative research

28
Q

how is the independent variable used in non-experimental research contexts?

A

the independent variable is the thing that is presumed/theorized to predict another outcome

29
Q

T or F: in survey designs, independent and dependent variables are used similarly to experimental research

A

False: the independent variable is the variable that we expect to come before or be predictive of the dependent variable

30
Q

T or F: the independent/dependent variable distinction only makes sense if our research context involves two or more variables

A

True

31
Q

what are the common question types in survey design?

A

1) single selection measures
2) multiple selection measures
3) ranking measures
4) rating measures
5) likert-type measure
6) semantic differential measures

32
Q

what are single selection measures?

A

requires participants to make a single selection from a list of options

33
Q

what are multiple selection measures?

A

allows participants to make more than one selection from a list of options

34
Q

what are ranking measures?

A

requires participants to rank a body of elements in terms of preference

35
Q

what are rating measures?

A

requires participants to rate (on a numeric scale) thoughts, feelings, or beliefs relative to a researcher-provided prompt

36
Q

what are likert-type measures?

A

requires participants to indicate level of agreement relative to a researcher-provided prompts
- ex: strongly disagree - strongly agree

37
Q

what are semantifc differential measures?

A

requires participants to indicate feelings/beliefs relative to a researcher-provided prompt
- use bipolar formate where only the poles are labeled

38
Q

T or F: all true experiments no do require random assignment

A

False: random assignment is require

39
Q

what is random assignment?

A

the research subjects are randomly placed in experimental groups

40
Q

What is the first thing we do when we’re ready to collect data?

A

randomly place our participants into the experimental or control group

41
Q

T or F: randomly assigned people into experimental groups should be similar in terms of demographics features, life experiences, and so on…

A

True

42
Q

what is the purpose of random assignment?

A

placing subjects into different treatment and control groups in a true experiment to ensure that subjects in each group will have similar characteristics and are equal

43
Q

T or F: if an “experiment” uses random assignment, it is a quasi-experiment

A

False: experiments that don’t use random assignments are quasi-experiments

44
Q

T or F: quasi-experiments can provide conclusive evidence of causation

A

False: quasi-experiments CANNOT provide conclusive evidence of causation

45
Q

T or F: random assignment and random sampling are the same thing

A

False: random sampling refers to the random selection of individuals from a larger population

46
Q

T or F: the most straightforward experiment involves two groups: control and experimental group

A

True

47
Q

what is randomized controlled trial?

A

an experiment involving a controlled and experimental group
- also referred to as RCT

48
Q

what is a control group?

A

a group of participants who do everything the experimental group does, but are not given any test, drug, intervention, or manipulation

49
Q

what is an experimental group?

A

the group of participants who undergo a form of experimentation

50
Q

what are the strength of experimental research?

A

only method that can definitively show causality
- can be replicated