TaMoS Seminar 2 - Preparation Quiz (fick 14/15 rätt) Flashcards
Which of the following components are necessary for something to be an experiment? Mark all correct options.
A)
A control group
B)
Intervention on target variable
C)
Control of background variables
D)
Observation of outcome
E)
Elimination of disturbing variables
B)
Intervention on target variable
C)
Control of background variables
D)
Observation of outcome
Randomization by itself does not guarantee a high-quality experiment. Why is that? Mark all correct options.
A)
Randomization doesn’t solve all kinds of potential control issues.
B)
Even though the probability might be very small, there is always the mathematical possibility that a completely random distributor might distribute objects into control and test group too unevenly. This is because a sample is always a finite set of objects (especially if the sample is small).
C)
Assuming there are no problems when randomizing the sampled objects, it is still not guaranteed that the sample was unbiased towards some relevant background variable to begin with, since the sampling might have been non-random.
D)
Randomization cannot distribute certain background variables evenly enough. For example people’s age in an experiment investigating attitudes towards some subject.
A)
Randomization doesn’t solve all kinds of potential control issues.
B)
Even though the probability might be very small, there is always the mathematical possibility that a completely random distributor might distribute objects into control and test group too unevenly. This is because a sample is always a finite set of objects (especially if the sample is small).
C)
Assuming there are no problems when randomizing the sampled objects, it is still not guaranteed that the sample was unbiased towards some relevant background variable to begin with, since the sampling might have been non-random.
What is the purpose of randomizing one’s distribution of individuals to the test- and control group? Mark all correct options.
A)
It facilitates blinding.
B)
It allows for a better representation of the population, from which the sample of individuals is extracted.
C)
It is a means to achieve a constant distribution of background variables between the groups.
D)
It reduces the effect of selection bias.
A)
It facilitates blinding.
D)
It reduces the effect of selection bias.
What is confirmation bias (i.e., the interpretation problem)? Mark the correct option.
A)
It is when an observer makes interpretations of what is being observed, for instance social behavior between people.
B)
It is when two or more observers interpret the same observation in different ways.
C)
It is when an observer influences the observation and changes the result.
D)
It is when the observation, results of some test, or data is read incorrectly because of some psychological properties of the observer.
D)
It is when the observation, results of some test, or data is read incorrectly because of some psychological properties of the observer.
Which of these are examples of confirmation bias? Mark the correct options.
A)
The doctor uses a test whose operationalization has a low quality that makes the result seem more significant than it is.
B)
The doctor favours evidence that confirms that the drug works as it should, while putting less weight on contradicting evidence.
C)
The doctor has done research on the drug for many years, has an expectancy that it will work as intended, and interprets the drug’s effects to be greater than they actually are.
D)
The doctor knows from previous tests that the medicine does not affect chronic pain, and therefore does not test the medicine.
B)
The doctor favours evidence that confirms that the drug works as it should, while putting less weight on contradicting evidence.
C)
The doctor has done research on the drug for many years, has an expectancy that it will work as intended, and interprets the drug’s effects to be greater than they actually are.
What is the observer effect (i.e. the influence problem)? Mark the correct option.
A)
It is when an operationalization is too theory-dependent.
B)
It is when the observation, in some sense, changes the object of study.
C)
It is when some observers are influenced by previous knowledge that might be false.
D)
It is when an experimenter intentionally changes the independent variables in an experiment
B)
It is when the observation, in some sense, changes the object of study.
Which of these are examples of observer effect (i.e., influence problem)? Mark all correct options.
A)
When asking the question “How do you feel?” affects the subject’s mood.
B)
When the act of using a speedometer slows down the vehicle’s speed.
C)
When using improper statistical tools make an insignificant result appear to be significant.
D)
When an experimenter exaggerates their results in order to make people think the results are more groundbreaking than they actually are.
A)
When asking the question “How do you feel?” affects the subject’s mood.
B)
When the act of using a speedometer slows down the vehicle’s speed.
What is single and double blinding? Mark all correct options.
A)
Single blinding is when only the test subjects know which group (test or control) they belong to.
B)
The conditions for single blinding are fulfilled if the test subjects in a medical trial do not know whether they’re given the real treatment or a placebo.
C)
Single blinding is a way to reduce theory dependence.
D)
Double blinding reduces the interpretation problem.
E)
Single blinding is an elimination method.
B)
The conditions for single blinding are fulfilled if the test subjects in a medical trial do not know whether they’re given the real treatment or a placebo.
D)
Double blinding reduces the interpretation problem.
E)
Single blinding is an elimination method.
Suppose that you are designing an experiment to measure the effects of Yoga exercise on flexibility in arms and legs. Which of the following are correct applications of some of the steps in Mill’s method of difference? Mark all correct options.
A)
Doing an intervention by having both groups do the same amount of Yoga for one month.
B)
Dividing test subjects into two groups, making sure that training background and other relevant factors are evenly distributed.
C)
Seeing that both groups increase their flexibility equally and concluding that “Yoga increases flexibility in arms and legs”.
D)
Formulating the hypothesis that Yoga increases flexibility in arms and legs.
B)
Dividing test subjects into two groups, making sure that training background and other relevant factors are evenly distributed.
D)
Formulating the hypothesis that Yoga increases flexibility in arms and legs.
Match each experimental flaw (A-C) with the correct type of experimental error (1-4)
A)
When Carol is informed that she is one of the participants who will be given a new and promising anxiety drug for the researchers’ purpose of testing this new drug, Carol becomes very happy because she has struggled with her anxiety for a long time.
B)
Random fluctuations in measurements create the possibility for a significant result to be the effect of the fluctuations, rather than the hypothesized cause. Therefore, inferring that there is a substantial effect from a significant result based upon very few measurements is problematic.
C)
Surveys are sent out to study the opinions of Stockholm’s inhabitants about the new yellow subway line, but the only people that receive the surveys are those in close proximity to the new planned subway stations.
D)
A marine biologist wants to observe and study dolphines’ mating ritual, but when the dolphins become aware of the marine biologist’s close presence they behave differently from what other marine biologists have reported.
1) The influence problem
2) Selection bias
3) The placebo effect
4) The interpretation problem
A)
When Carol is informed that she is one of the participants who will be given a new and promising anxiety drug for the researchers’ purpose of testing this new drug, Carol becomes very happy because she has struggled with her anxiety for a long time.
The placebo effect
B)
Random fluctuations in measurements create the possibility for a significant result to be the effect of the fluctuations, rather than the hypothesized cause. Therefore, inferring that there is a substantial effect from a significant result based upon very few measurements is problematic.
The interpretation problem
C)
Surveys are sent out to study the opinions of Stockholm’s inhabitants about the new yellow subway line, but the only people that receive the surveys are those in close proximity to the new planned subway stations.
Selection bias
D)
A marine biologist wants to observe and study dolphines’ mating ritual, but when the dolphins become aware of the marine biologist’s close presence they behave differently from what other marine biologists have reported.
The influence problem
Which of the following are true statements about internal validity? Mark all correct options.
A)
Control is a precondition for internally valid inferences.
B)
Internal validity is a property belonging to experimental systems; they have this property if enough background variables are controlled.
C)
If the conclusion I infer is a causal effect from, or heavily correlates with, the independent variable in my setup (and not some uncontrolled background variable(s)), then the inference is internally valid.
D)
Internal validity is a property belonging to an inference between the independent variable and the dependent variable
A)
Control is a precondition for internally valid inferences.
C)
If the conclusion I infer is a causal effect from, or heavily correlates with, the independent variable in my setup (and not some uncontrolled background variable(s)), then the inference is internally valid.
D)
Internal validity is a property belonging to an inference between the independent variable and the dependent variable
Which of these options would (most likely) have a negative effect on the internal validity of the inferences drawn from an experiment? Mark all correct options.
A)
A large amount of experimental errors.
B)
Not using single blinding when testing the opinions of people.
C)
Interpretation problems.
D)
An influence problem.
E)
A large amount of controlled variables.
A)
A large amount of experimental errors.
B)
Not using single blinding when testing the opinions of people.
C)
Interpretation problems.
D)
An influence problem.
It is useful to distinguish between problems relating to the operationalizations used in a study, and problems relating to the design of the study. Mark those options that are examples of poor experimental design and not a problem with the operationalization. (Denna är fel, rätta gärna)
A)
Using an untested and non-standardized questionnaire for measuring peoples opinions.
B)
Failing to make sure that both the test group and control group in an experiment have the same and constant temperature before performing an intervention, resulting in a misleading temperature change when the intervention is performed.
C)
Failing to randomize between test group and control group in an experiment where people are asked to give their opinions on a survey.
D)
Failing to calibrate the thermometer before measuring the temperature of the test and control samples after performing an intervention, resulting in a temperature change
A)
Using an untested and non-standardized questionnaire for measuring peoples opinions.
D)
Failing to calibrate the thermometer before measuring the temperature of the test and control samples after performing an intervention, resulting in a temperature change
What is external validity? Mark the correct option.
A)
Justified inferences drawn from a population to a sample.
B)
Justified inferences drawn from the result of a scientific study to the target of the study.
C)
Justified inferences drawn from a population to some other population.
D)
Justified inferences drawn from experimental data to an experimental sample.
B)
Justified inferences drawn from the result of a scientific study to the target of the study.
A researcher is aiming to improve an existing exercise app by developing a new version of the app. The hypothesis to be tested is: People using the new app version will exercise and enjoy their exercise more. The research process will start by locating people who use the current version of the app, ask and receive their informed consent about participation, and then let half of the consenting participants use the new version of the app. Statistical data will be collected from participants’ smartphones, and the participants will also be asked to answer a survey asking for a qualitative assessment of the app.
Which of the following are possible method choices whose relevance is related to internal validity (as compared to external validity)? Mark all correct options.
A)
Making sure that they have a sufficiently large sample that is sufficiently similar to the real world population.
B)
Using randomization for the selection of participants of the study into treatment and control group.
C)
Only doing the intervention on the treatment group.
D)
Checking that the chosen participants do not have any upcoming plans that obviously risk invalidating their participation (e.g. someone is planning to run a marathon and will consequently train substantially more the upcoming months).
E)
Making sure that the survey questions are understood unanimously among the participants (e.g. the questions are not too ambiguous and/or vague).
F)
Conducting the study in 2 countries each from Europe, Africa, Asia, North- and South America, and Oceania.
B)
Using randomization for the selection of participants of the study into treatment and control group.
C)
Only doing the intervention on the treatment group.
D)
Checking that the chosen participants do not have any upcoming plans that obviously risk invalidating their participation (e.g. someone is planning to run a marathon and will consequently train substantially more the upcoming months).
E)
Making sure that the survey questions are understood unanimously among the participants (e.g. the questions are not too ambiguous and/or vague).
