Unit 12 Experimental Design Flashcards

1
Q

What’s a population?

A

a population is the entire group of individuals whom you want to describe.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What’s a sample?

A

a sample is a smaller group of individuals you select FROM the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What’s the sampling frame?

A

the sampling frame is a list of individuals from the population of interest from which the sample is drawn.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What happens if

  1. the sampling frame is NOT equal to the population of interest
  2. and is different from the population in some way that may affect the response variable?
A

Then the sample will be BIASED in some way.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

When is a sample biased?

A
  1. the sampling frame is NOT equal to the population of interest
  2. and the sampling frame is different from the population in some way that may affect the response variable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What’s sampling variability?

A

sampling variability is the natural tendency of probability samples to vary.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Is sampling variability an error?

A

NO! sampling variability is not an error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

If sampling variability isn’t an error, then what is it?

A

sampling variability is the result of properly applied random sampling techniques.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What’s the sample size?

A

the sample size is the number of individuals you select from your sampling frame.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

does the size of the population dictate the size of the sample?

A

NO!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What dictates the size of the sample?

A

ten percent rule dictates the size of the sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What’s the ten percent (10%) rule?

A

the sample size should not be bigger than 10% of the population size.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What’s a census?

A

a census is the sample that’s the size of the entire population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What’s a parameter?

A

a parameter is a number that describes an aspect of the population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Do we know the parameter of a population?

A

No, we usually do not know the true value of a parameter, so we have to estimate it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What’s a statistic?

A

a statistic is a number than describes an aspect of the SAMPLE DATA.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What do we use statistics for?

A

we use statistics to ESTIMATE values in the POPULATION.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What’s a sampling design?

A

a sampling design is the method we use to select the sample for a study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What do all appropriate statistical sampling designs include?

A

all appropriate statistical sampling designs include the idea that chance, rather than choice, is used to select the sample.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What’re poor methods of selecting a sample? (2)

A

poor methods of selecting a sample:

  1. voluntary response sampling
  2. convenience sampling
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What’s voluntary response sampling?

A

A voluntary response sample is a sample made up of volunteers.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What’s convenience sampling?

A

Convenience sampling is when you select subjects that’s close and convenient for you to sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What’s the best defense against systematic errors in way that the data represents the population?

A

RANDOMIZATION is the best defense against systematic errors in way that the data represents the population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What’re the appropriate selection methods?

A

appropriate selection methods:

  1. simple random sampling
  2. systematic random sampling
  3. stratified random sampling
  4. cluster sampling
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

When can you use cluster sampling?

A

you can use cluster sampling only when the clusters are all HETEROGENEOUS.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What’s heterogeneous?

A

HETEROGENEOUS means DIVERSE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What’s systematic random sampling?

A

systematic random sampling is when

  1. you assign all items a value and order them
  2. you select samples based on a system of intervals in a numbered population.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

example of systematic random sampling?

A

systematic random sampling:

  1. Lucas can give a survey to every fourth customer that comes in to the movie theater.
  2. The fact that Lucas is giving the survey to every fourth customer is what makes the sampling systematic because there is an interval system.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What’s stratified random sampling?

A

stratified random sampling is when

  1. you divide a population into smaller groups known as strata based on shared characteristics
  2. then you choose some individuals from each strata
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What’s stratified random sampling in summary?

A

some from all

- choosing some from all strata/clusters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What’s cluster sampling?

A

cluster sampling is when

  1. a population is broken up into clusters that represent the population in terms of diversity.
  2. you number each cluster
  3. you choose entire clusters based on randomly picking numbers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What’s cluster sampling in summary?

A

all from some

- choosing all individuals in a cluster from some clusters

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What happens in a simple random sample?

A

in a simple random sample, every member of the population has an equal chance of being included in a sample of size “n”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

True or False?

The simple random sampling technique eliminates bias

A

True, if you’re referring to SELECTION bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What’s sample design or sampling technique?

A

sample design or sampling technique is the method you use to select participants and gather data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What sampling techniques are prone to selection bias?

A

sampling techniques prone to selection bias:

  1. voluntary response
  2. convenience
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What probability sampling techniques get rid of selection bias?

A

probability sampling techniques that get rid of selection bias:

  1. simple random sample
  2. stratified
  3. systematic
  4. cluster
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What is the only method that eliminates all bias from a sample?

A

a CENSUS is the only method that eliminates all bias from a sample.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What’s bias?

A

bias is any systematic failure of a sample to represent its population of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What’re the types of response bias?

A

types of response bias:

  1. question wording
  2. interviewer bias
  3. order of choices
  4. honesty
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What’s non-response bias?

A

non-response bias is when respondents differ in meaningful ways from nonrespondents.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What’s under-coverage bias?

A

Undercoverage occurs when some members of the population are inadequately represented in the sample.

43
Q

What’s voluntary response bias?

A

voluntary response bias occurs when sample members are self-selected volunteers, as in voluntary samples

44
Q

How to describe how you would select an SRS?

A
  1. describe the picking process: include the phrase “without replacement” and “repetition.
  2. include a conclusion: what do the things you pick represent?
    • ex: these are the 8 people selected to go to the US Capitol.
45
Q

What’s an observational study?

A

an observational study is when researchers

1. OBSERVE individuals 2. record variables of interest.

46
Q

What can you not determine from an observational study?

A

you can’t determine a CAUSE AND EFFECT relationship from an observational study

47
Q

What’s an experiment?

A

an experiment is when you

  1. deliberately apply treatments
  2. in addition to observing
  3. and recording variables of
48
Q

What can you perform to determine a cause and effect relationship?

A

you can perform an EXPERIMENT to determine a cause and effect relationship.

49
Q

How to use an experiment to determine cause and effect?

A

you use an experiment to determine cause and effect between the explanatory and response variables.

50
Q

What’s an explanatory variable?

A

an explanatory variable is the INDEPENDENT variable

51
Q

What’s a response variable?

A

a response variable is the DEPENDENT variable

52
Q

What’s the treatment?

A

the treatment are the CHOICES for the independent variable

53
Q

Identify the population of interest, explanatory variable, the treatment, and the response variable.

Researchers believe that cranberry juice may be as effective in reducing a person’s blood pressure as a conventional drug (Drug A), which is much more expensive and has more unwanted side effects.

A
  1. population of interest: people with high blood pressure
  2. explanatory variable: what is consumed
  3. treatment: cranberry juice, Drug A
  4. response variable: blood pressure
54
Q

What’re the steps to designing an experiment?

A
  1. “select subjects” (from the population of interest)
  2. decide which treatment to give
    • state how you’ll randomly assign it
    • ex. coin flip
  3. specific the treatment
    • amount, frequency of treatment, etc.
  4. detail how you’re collecting the response variable
    • how you’re going to measure it
  5. “compare variables.”
55
Q

In designing an experiment, what do you use blocks for?

A

use blocks to reduce variability and bias.

56
Q

What’s binding?

A

blinding is when the subject does not know which treatment (if any) that they are receiving

57
Q

What’s double-blind?

A

double-blind is when neither the experimenter nor the subjects know what treatments are being given.

58
Q

What’s the placebo effect?

A

the placebo effect is when the subject isn’t given a treatment but responds bc they think the treatment is effective.

59
Q

What’s blocking?

A

blocking is when you sort a POPULATION into GROUPS based on criteria in EXPERIMENTAL DESIGN

60
Q

What’s stratifying?

A

stratifying is when you sort a POPULATION into GROUPS based on criteria in SAMPLING.

61
Q

What’s the difference between blocking and stratifying?

A
  1. they both involve sorting a POPULATION into GROUPS based on criteria
  2. but, blocking is for experimental design, and stratifying is for sampling
62
Q

What’re the benefits of observational studies?

A

benefits of observational studies:

  1. less expensive
  2. takes less time
  3. the situation is more “real life”
63
Q

What’re the cons of observational studies?

A

cons of observational studies:

  1. lurking variables
  2. confounding variables
64
Q

What’re lurking variables?

A

lurking variables are variables that impact the response variable but are not measured as part of the study of interest

65
Q

What’s the relationship between lurking and confounding variables?

A

lurking variables are a subset of confounding variables

66
Q

What’re confounding variables?

A

confounding variables are two variables that BOTH have an impact but the investigator can’t separately identify their impact on the response variable.

67
Q

How do you minimize the effects of confounding and lurking variables?

A

minimize the effects of confounding and lurking variables by doing observational studies on subjects that are as HOMOGENOUS as possible.

68
Q

What’s the difference between observational studies and experiments?

A

difference between observational studies and experiments is how much CONTROL you have over the variables.

69
Q

How is an observational study different from an experiment?

A

observational study:

  1. you simply collect data based on what is seen and heard
  2. you infer based on the data collected
  3. you DO NOT interfere with the subjects or variables in any way (you don’t add a treatment)
70
Q

Why can you not determine cause and effect from an observational study?

A

because there may be LURKING variables.

71
Q

What’re the key elements of experimental design? (important)

A

key elements of experimental design:

  1. control
  2. randomization
  3. replication (can it be replicated?)
72
Q

What’s the basic design method? (important)

A

basic design method:

  1. you randomly select individuals
  2. you randomly assign treatments
    • via coin flip, etc.
  3. you measure the treatments
  4. you administer the treatments
  5. time elapses and treatment finishes
  6. you measure the treatments again
  7. you analyze data
  8. you make conclusions.
73
Q

What’s blocking?

A

Blocking is when you sort a experimental units or subjects that are known before the experiment to be similar in some way that is expected to affect the response to the treatments by group.

74
Q

What’s a block?

A

a block is A group of experimental units or subjects that are known before the experiment to be similar in some way that is expected to affect the response to the treatments.

75
Q

What’s an example of blocking?

A

males and females may respond to a diet supplement differently, so you block the experiment by gender.

76
Q

What’s matched pairs design a part of?

A

matched pairs design is a FORM OF BLOCKING

77
Q

What’s a form of blocking?

A

matched pairs design is a form of blocking

78
Q

What’s matched pairs design?

A

matched pairs design is when 1. you give two people or objects who are similar or identical DIFFERENT TREATMENTS
2. then you make them go through SIMILAR CONDITIONS

79
Q

Example of matched pairs design?

A

matched pairs design:

  1. one shoe receives one shining treatment
  2. another shoe receives another shining treatment
  3. you see how well they hold up with daily wear in a week.
80
Q

What’s a census?

A

census is when you collect data from ALL of the members of a population in the study.

81
Q

What’s quota sampling?

A

quota sampling is when interviewers interview a fixed quota or number of members of the population.

82
Q

What’re the chances involved in simple random sampling?

A

chances involved in simple random sampling:

  1. you have an equal chance of choosing every sample of size “n.”
  2. every member of the population has an equal chance of being included in the sample.
83
Q

What’s simple random sampling?

A

simple random sampling

  1. involves choosing individuals at random from the population WITHOUT replacement
  2. you choose a sample of size “n” from the population
84
Q

What’s bias?

A

bias is a systematic error that favors a particular segment of the population or encourages certain results

85
Q

What type of sampling technique eliminates selection bias?

A

the SIMPLE RANDOM sample eliminates selection bias

86
Q

Why does the simple random sample eliminate selection bias?

A

since all subsets of a given size have the same chance of being selected from the population.

87
Q

What’s a strata?

A

strata are different groups of your population

88
Q

What’s the multi-stage random sample?

A

multi-stage random sample is when you repeatedly select simple random samples within previously selected simple random samples

89
Q

What’s an example of the multi-stage random sample?

A
  1. a wholesaler selects a simple random sample of cases of fruit from a shipment.
  2. he then selects a simple random sample of fruit within one case
90
Q

What’s a sampling frame?

A

a sampling frame is the list of possible subjects who could be selected in a sample.

91
Q

What happens if the sampling frame isn’t equal to the population?

A

the sample will be biased in the same way the sampling frame is biased.

92
Q

What’s a random sampling error?

A

a random sampling error is an error that occurs because of chance variation.

93
Q

What’s a sampling method error?

A

a sampling method error is an error that occurs because of the sampling method you chose.

94
Q

Example of a sampling method error?

A

you choose a convenience sample

95
Q

What’s a non-sampling method error?

A

a non-sampling method error is an error that members in a sample cause

96
Q

What an example of a non-sampling method error?

A

a non-sampling method error is when dishonest responses will create error in the sample.

97
Q

What’s a control?

A

a control includes the units that do not receive the independent variable or treatment

98
Q

When are results statistically significant?

A

if the differences between the groups are greater than what would be expected through chance variation alone.

99
Q

When can you investigate a cause and effect relationship?

A

when an experiment meets the following criteria:

  1. control
  2. randomization
  3. replication
100
Q

What’re historical controls?

A

historical controls are when you compare subjects who receive the treatment to historical records of subjects who didn’t receive the treatment

101
Q

why do researchers use historical controls?

A

it’s cheaper and less time consuming

102
Q

When do you use block design?

A

block design when one specific characteristic of the experimental units will likely affect the results of the experiment

103
Q

what’s one example of when you would use block design?

A

you would use block design if when testing blood pressure medication, you anticipate gender affecting the results, you create separate blocks for males and females

104
Q

What’s the purpose of matched pairs design?

A

To control for lurking variables