DECK 10: UNIT 3 MIXED - sampling and experiments Flashcards
1
Q
Can you stratify in an experiment?
A
NO. stratification is a sampling method, blocking is method used in experiments. They are similar ideas.
2
Q
How are we proving causation in experiments and obs studies?
A
No causation in a study, maybe association or correlation. ONLY IN EXPERIMENTS TO YOU TALK ABOUT CAUSALITY.
3
Q
When your sampling frame is different from the population, then you risk ____
A
undercoverage
4
Q
What is wording bias
A
A type of response bias, When the wording of the question impacts response to it. (type of response bias)
5
Q
Systematic, how do you find the N for every nth subject, and then how do you proceed?
A
TOTAL POP/SAMPLE SIZE= your n (round down). Then use RAND INT to Randomly choose first. RANDINT(1, n). And then take every nTH.
6
Q
What is the standard sampling method? (the gold standard)
A
A Simple Random Sample (SRS) is our standard. Every possible group of n individuals has an equal chance of being our sample. That’s what makes it simple. Put the names in a hat.
7
Q
How is Blocking in an Experiment Similar to Stratefying in a Sample?
A
The two are similar because they divide the subjects into homogenous groups where the subjects are all similar (these traits were already present in the population)
8
Q
give an Example of a MULTISTAGE sample
A
Suppose you want to poll urban, suburban and rural citizens, you can divide a map into those strata, and then randomly choose neighborhoods or streets in each and ask everyone on those streets. Here you stratified by community type and then clustered by street.
9
Q
What is BIAS in sampling?
A
A systematic FLAW in your method.
10
Q
How are we manipulating the environment differently in experiments and studies?
A
No manipulation or treatments in an observational study. You only manipulate environment in an experminet.
11
Q
4 ingredients: What is “control?”
A
You want to control the environment as best as you can so that the only difference between groups is the treatment, and the treatment only. Everything else should be similar.
12
Q
Give example of randomized block design for a new anxiety med vs placebo with 100 volunteers (60m and 40f)
A
Block by gender. Randomly assign 30m to new and rest placebo. Randomly assign 20w new and rest placebo.
13
Q
Name types of bias
A
undercoverage, non response, response, voluntary
14
Q
What is the placebo effect?
A
When those who get the placebo show improvements, or show the effects of the treatment. This often happens to up 20% of participants!
15
Q
what is the best way to reduce bias?
A
randomness and good sampling methods.
16
Q
How are we making inferences differently in experiments vs studies?
A
In observaional studies, you make and inference about the population, in an experiment you make an inference about a treatment.
17
Q
4 ingredients: What is “replication?”
A
Having enough subjects. You don’t want to test fertilizer on just one plant.
18
Q
What’s the difference between a prospective and a retrospective study?
A
A retrospective study takes a group and looks back at its history while a prospective study watches a group for a period of time and records the data along the way into the future.
19
Q
What is a multistage sample?
A
A sample that combines several sampling methods
20
Q
Give an example of matched pair design for comparing a new blood pressure medication to an older version?
A
Have subjects use the new medication for a month and the old one for a month and compare. Be sure to randomize which month and blind.
21
Q
Who can be blinded? ( two groups)
A
- Subjects (and dog owners..). The poeple getting treatment and 2. administrators. Those delivering treatments and assessing effectiveness of treatments.
22
Q
What is a weakness of a SRS?
A
Suppose you want a sample of 50 high school students, with an SRS, although unlikely you could get “all freshmen” which wouldn’t be representative.
23
Q
A 4 year high school of 2000 students, sampling 40 high students: Describe a cluster sample
A
Imagine that all of art classes have 10 students and they are mixed with fr, so, jr and srs… You would randomly choose 4 classes and survey everyone in each of the 4 classes.
24
Q
Why does it make sense to double-blind an experiment?
A
It reduces bias in an experiment. If subjects don’t know what treatment they’re receiving, they won’t change their habits based on that knowledge. If evaluators don’t know which treatment each subject is receiving, they won’t bias the true results based on the results they expect to see
25
What is sampling error?
How far your statistic is from the parameter (how far your calculation from your sample was from the population parameter)
26
What is the sure way to assign treatments correctly?
throw names in hat and first half in group 1 and the rest group 2. . Or number subjects from 1-n and use randint until you get half for group 1.
27
How are statistics and parameters different?
A statistics is a numerical description of a sample, and a parameter is a description of a population. The difference between these is called ERROR (sampling error).
28
A 4 year high school of 2000 students, sampling 40 high students: Explain how stratifying has "impossible groups"
You couldn't get all freshmen in your sample
29
How are we using random numbers in experiments vs studies?
In a study, we randomly choose subjects to survey from the population as a whole. In an expermint we
30
Suppose you want to see the relationship between gender and candy preference in squirrels. How may you do a stratified vs cluster sample
STRATIFIED: You can split the list of all of the squirrels in your neihborhood by gender and randomly select 20 males from th list of all of the males, and then 20 females (strata) from all of the females. CLUSTER: you can randomly choose to 5 different trees and survey all of the squirrels in those trees, assuming that there are 4 squirrels living in each tree (clusters, the trees have both M and F).
31
What is difference between non response bias and undercoverage?
You may ask someone to take a survey, they may say no. They may feel differently than the people who decide to take the survey. In this case, that is non-response bias. Undercoverage happens when you didn't even ask some people to take the survey. The people you didn't even ask might feel different.
32
Is it always better to do a census or to sample?
depends on the availablility of the data. If the you want to look at SAT vs GPA, you may easily be able to get all of the school's data and do that study (a census). If you have to go out and get the info, you may want to take a sample to save time and energy.
33
How is BIAS different from SAMLING error
Bias is a systematic flaw in your sampling method. Sampling error is always present even with the best methodology.
34
What are the two types of observational studies?
Retrospective, and Prospective
35
What is the difference between single-blind and double blind?
Single blinding is when all individuals in either one of the classes are blinded; double-blinded is when everyone in BOTH classes are blinded. Classes are: subjects and the other is treatment givers + evaluators…
36
name 2 differences between observational studies and experiments
1. Experiments can prove causation (studies can't) . 2. In experiments, you assign treatments (studies you just watch)
37
What is the purpose of matching?
it isolates the differences between subjects so help see the impact of the treatment.
38
Give example of a matched pair design study for fuel efficiency
Testing fuel efficiency of different gasolines. Subjects use both fuel A for a month and fuel B for a month and compare, based on their driving habits and vehicle, which was more efficient. BE SURE TO RANDOMLY CHOOSE WHICH ONE GOES FIRST FOR EACH SUBJECT.
39
What is the difference between response bias and nonresponse bias?
Response is when the person's response is influenced by the question or questioning method (like if a parent asks if you use drugs, as opposed to a friend... there is only one answer to this, but one might respond differently to them), non response is is when the people who don't respond might have different opinions/views than the people who did.
40
What is a sampling frame?
It is the frame from which you get your sample. For instance, if you call people the frame would be "people with phones"
41
A 4 year high school of 2000 students, sampling 40 high students: Describe a stratified sample
Stratify by year. Randomly choose 10 FR, 10 SO, 10 JU and 10 SENIORS
42
Example of response bias
A teenager goes to the doctor's office with their parents. The doctor asks the teen if they vape. The teen may say "no" because their parent's are there, even though they do vape.
43
What is the main purpose of a placebo ?
To blind the subject that is being experimented on to avoid influence to the given variable therefore altering the response variable . When people think they're getting help, they often improve anyway..
44
4 INGREDIENTS TO EXPERIMENTS
Compare, control , randomization, replication (and BLOCKING when you need to)
45
How do we use representative samples in experiments and studies?
You don't need a representative sample in an experiment. You are not making inferences about a population, just about a treatment.
46
Example of undercoverage
You only ask people who go to Home Depot about their views on school lunches.
47
What is a simple random sample?
put all of the names in a hat. every group is possible. pull the numbers
48
When we say "statistics vary" or the "variablility of statistics" are we talking about data from an individual?
NO... we are stating that summaries of samples (statistics) will vary from sample to sample. Statistics from one sample will differ from statistics from another sample and they will also differ from the parameters. The distance your statistic is from the parameter is called the ERROR.
49
Example of nonresponse bias
In a survey, a person does not answer a few questions (or a person is on your list and you can't get a hold of them)
50
What is cluster sampling?
Cluster- grab clusters of the population. each cluster should be representative ( like the population) use a few clusters.
51
How can you decrease sampling error?
Get a larger sample
52
What do observational studies and experiments have in common?
In both, you are making OBSERVATIONS.. recording data... doing statistical analysis...
53
Is sampling error a mistake?
IT IS NOT A MISTAKE!!! Because the data in samples are generally different, the statistics calculated from one sample to another vary and are generally not equal to the parameter. This variablilty of STATISTICS is called sampling error.
54
Can you eliminate sampling error?
Only if you take a census. Larger samples have less error.
55
What is random sampling?
When we use chance to select a sample, like rolling dice, a random number generator, or a random number table in our selection process. We use randomization in all of the "GOOD" sampling methods.
56
4 ingredients: What is "compare?"
Having something to compare your treatment with helps you see its effectiveness.
57
What is retrospective study?
A retrospective study is a study that looks backwards in time (or at the present moment).
58
An unbiased sampling method will eliminate error
No, error is always there. Error is not a mistake.
59
When sampling, what kind of sample are we striving to get?
A representative sample, we want our sample to have similar charactaristics as the population
60
A 4 year high school of 2000 students, sampling 40 high students: Since ALL GROUPS (samples) are possible and equally likely, show some groups that you could get randomly from and SRS that would not be representative of the entire school.
all female, all freshmen, all seniors, all athletes.. these could happen in an SRS (but they are not likely to)
61
4 ingredients: What is "BLOCKING?"
If you think different groups of subjects may respond differently to treatments because of location, gender, age, then you make BLOCKS, and make sure to compare the treatments within each block.
62
What is systematic sampling?
collecting data from every nth subject.
63
What is the problem with convenience sampling?
The sample may not be representative as it is not randomized to include every type of person. Friends and family are convenient but they likely share similar opinions and thus the sample is not representative of a population.
64
What are the "bad" sampling methods.
convenience samples, voluntary samples
65
What are the two (three) types of experiments?
1. Completely randomized 2. Randomized block (matched pairs)
66
In which sampling methods do all subjects have the same probability of being chosen?
SRS, cluster, systematic and stratified all give subjects equal likelihood of being chosen.
67
What is a control group?
The group that doesn't get a treatment (or gets the old treatment). It helps us see the impact of the environment. It gets the placebo or standard care but goes through all of the motions
68
Give example of factors and levels
Factor: medication. Levels: 50mg, 100mg and 200mg.
69
What is prospective study?
Prospective study is when you study the experimental unit's present and future.
70
To make a survey to tell of a restaurant is good, would you ask the people coming out of the restaurant?
People at the restaurant are probably there because they already like it. If you asked the question "Is this your first time dining here?" and if they say "yes" you survey them, that would be a better method. But then again.. the people wouldn't go into an Italian restaurant if they didn't like that type of food.
71
What is a level in an experiment? give example
Example. For the Factor "SLEEP" the, level(s) would be how many hours the subjects were alowed to sleep.. 4 hours, 6 hours, 8 hours.. 3 levels
72
What is a representative sample?
A sample that looks like the population. It has similar characteristics.
73
What is difference between completely randomized and random block design?
Completely randomized takes all units and puts them in a hat and randomly chooses treatments, blocked puts them all in different hats first (blocks) and then chooses
74
What is matched pair design?
A type of blocking where you match subjects to other "like" subjects… MOST OFTEN SEEN WHEN YOU COMPARE A SUBJECT TO ITSELF!! (like pre-post tests)
75
What is undercoverage?
Undercoverage is when a group of the population is not represented in the sample. When the sampling frame isn't representative.
76
Suppose you are doing a weight loss experiment with 2 diets (A. low carb and B. low fat), and three medications (1. NUTRI LOSS, 2. POUND DROPPER and 3. SLIMMERLY). How many treatment groups would there be?
there would be 6: A1, A2, A3, B1, B2, B3
77
How is undercoverage different from non response
undercoverage you don't even ask people, non-response you ask, but they don't answer.
78
How is a sampling frame different from the population?
Suppose you are wondering how elderly people on the cape feel about a new medicare law. If you go to nursing homes and randomly sample residents, then the frame is "elderly people at those nursing homes." Your population is still elderly people on cape cod.
79
What is the difference between confounding and lurking?
Confounding is in experiments, like sunlight confounding a fertilizer experiment. Lurking is when you think hot chocolate causes ski accidents. "lurking"is actually a word not even used in AP STATS.
80
Will larger samples reduce BIAS?
No, bias is a systematic flaw, even large samples will still have bias. If you ask more people outside of McDonalds, you still only get answers from people who eat at McDonalds (large samples can reduce error, however)
81
Why randomize in an experiment?
To reduce confounding variables (and bias).
82
Example of wording bias
Do you support food assistance and nutrition programs for children living in poverty? VS. Do you approve of supporting lazy people on welfare?
83
A 4 year high school of 2000 students, sampling 40 high students : Describe a systematic sample
Get an alphabetical list of all of the students, 2000/40=50. Randomly choose one of the first 50 students and then every 50th student after that.
84
How are voluntary and convenience samples similar…
With voluntary, people choose them selves, with covenience, the people are just chosen by researcher, neither uses randomness and both are prone to BIAS.
85
What is stratified sampling?
When you break the population into groups with similar attributes and randomly select from each strata.
86
What is the difference between a completely randomized and a randomized block?
In a completely randomized experiment, all of the subjects names go into ONE HAT and you pick for treatment groups. In a randomized block design you have more hats (a hat for males, a hat for females etc) and pick for treatments from each.
87
Suppose you sample 150 people randomly from a city to make an inference about the city, and then you sample 150 people randomly from around the country to make an inference about the entire country, which will you be more confident in????
It will tell you just as much about both. Same reliability (if sample is representative). Sample size determines confidence. To get more confidence you need a larger sample (not a smaller population)
88
A 4 year high school of 2000 students, sampling 40 high students: Describe a convenience sample
Ask the first 40 students coming to the locker rooms after school. This is problematic because athletes may not have the same preferences as non athletes.
89
Suppose you are doing a weight loss experiment with 2 diets (A. low carb and B. low fat), and three medications (1. NUTRI LOSS, 2. POUND DROPPER and 3. SLIMMERLY). What is the response variable?
weight loss (pounds)
90
What is difference between subject and experimental unit?
Humans who are experimented on are commonly called subjects in an experiment. Subjects like dogs, days, plants and anything not human are called Experimental Units
91
What is wrong with using volunteers in a survey?
(Volunteers are often upset or emotionally attached) Those who volunteer may not be like the rest of the population. An example may be, if you're trying to find our how often people volunteer for things. So you ask for volunteers to take the survey. A question may be "when was the last time you volunteered for something?" Well. they all just volunteered for the survey!
92
4 ingredients: What is "randomization?"
You want to randomly assign subjects to treatment groups.
93
How can the WORDING of the question lead to response bias
Words or phrases that impact your feelings tend to influence responses. Look for "devastating, horrific, wonderful… etc." Sometimes there is a background story like "Many americans lose jobs to illegal aliens every year, do you feel this is fair"
94
What type of study would find relationship beween Verbal and Math SAT?
You could take all of the SAT Math and Verbal scores and run a regression and find the r-quared value and linear model. This would be a Retrospective Study.
95
What's the difference between stratified and cluster sampling?
Stratified- you divide the population up into groups with similar traits, called strata (homogeneous groups) and randomly choose a few from each strata.
96
A 4 year high school of 2000 students, sampling 40 high students: Explain how clustering has "impossible groups"
You couldn't get 2 people from each classroom, because you would be randomly choosing classrooms and asking everyone in those classes.
97
What is response bias? How do you avoid it?
Response bias is any influence that may sway the respondent e.g wording of the question, interviewer's behavior/background. Therefore, in a survey, ask questions that allow respondents to answer comfortably and honestly. Keep the wording "indifferent" or neutral in some way in order to unduly favor one response over another.
98
A 4 year high school of 2000 students, sampling 40 high students: Explain how systematic has "impossible groups"
You couldn't get the first 40 people alphabetically (because you are taking every nth)
99
What is a factor? give example
DIET PLAN would be a factor and levels could be: low carb, low fat, and no diet
100
In the fertilizer experiment, how could you plan to eliminate the confounding variable?
USING RANDOMIZED BLOCK DESIGN. Make each table a block, and then randomly assign fertilzer A and B to the plants at each table. Compare the fertilizers for table 1, then compare the fertilizers on table 2.
101
In which sampling methods do all GROUPS have the same probability of being chosen?
Only in SRS do all GROUPS have the same probability of being chosen, all of the other methods have IMPOSSIBLE GROUPS.
102
Things that cause nonresponse bias ?
(remember non response is that the people you ask, or try to ask don't respond) Lazy researcher, shy survey takers, who is the questioner, environment,
103
What is a quality of SRS that is not a quality of Systematic, Stratified or Clustering?
In an SRS, all groups are possible, and ALL POSSIBLE GROUPS have the same chance of being picked (like all senior male students.).The other methods have lots of impossible groups. SRS has no impossible groups. Example: -Stratified- an impossible group would be all girls (you're taking some boys and girls)-Clustered- an impossible group would be all girls (each cluster has boys and girls)-systematic- an impossible group would be first 10 people that are right next to each other (you are taking every nth person, so you will skip)
104
What is statistically significant?
When an observed difference is too odd for us to believe that it is likely to have occurred naturally (or just randomly). Basically it is Statistically Significant when we don't think it happened randomly. when you think "something's up" or "something's fishy"
105
What is wrong with using voluteers in an experiment?
Not much. In an experiment, we are not looking for a sample that is like the population. We just want to see the effectiveness of a treatment. It is fine if the subjects are all similar. In fact it is best sometimes when they are!
106
Why do you have to Stratify?
You don't have to.. But you might want to if you feel that a simple random sample might not be representative of the population . You want your sample to be like the population. a representative sample (it represents the population well).
107
What "designs" are there for experiments?
completely randomized, random block, and matched pair design(type of block)
108
What are the differences between the subjects in strata and the subjects in clusters?
the "strata" are homogeneous, or have similar traits. The clusters are heterogeneous, or mixed traits.
109
What's a useful alternative when you can't run an experiment? What are they useful forms of this, and how do you preform them respectively?
An alternative of an experiments could be an observational study. t.
110
Give example of confounding variable.
fertilizer A vs B. If you have two tables in a room with tomato plants and and one table gets A and the other gets B, but later you realize that the table with A was near the windows. You say that SUNLIGHT IS A CONFOUNDING FACTOR in that experiment.
111
What are the "good" sampling methods?
SRS (simple random sample), stratified, clustered, systematic, multistage
112
How can you use random numbers to sample?
Number the subjects 00-99 (if less than 100) or 000-999 (if less than 1000) or 0000 to 9999 etc.. then use a random number table taking one, two, three or four numbers at a time. Throw out repeats.
113
In which sampling methods do the subjects have equal chances of being selected?
SRS, Stratified, Clustered, Systematic, and multistage. In all of these, the subjects have an equal chance (but groups have different chances)
