Research & Program Evaluation Flashcards
Define a Type II error.
Aka. beta error
When a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false
Define a beta error.
Aka. Type II error
When a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false
What error is made when a researcher has accepted a null hypothesis (i.e., that there is no difference between an experimental group and a group not receiving any experimental treatment) when it is false?
Type II error or beta error
An experimenter wants to assess the effectiveness of a training course for improving SAT scores by comparing the pretest and posttest scores of a group of high school students. To analyze the data obtained in this study, the experimenter should use which statistical test? A. Factorial ANOVA B. Correlation C. T-test D. Chi-square
C. T-test
What statistical test should be used when comparing two means?
T-test
When should a T-test be used?
When comparing two means
Parametric and non-parametric both:
A. Assume random assignment of samples to groups
B. Assume random selection of the sample from the population
C. Require a normally-shaped distribution of DV scores in the population
D. None of the above
B. Assume random selection of the sample from the population
What is a difference between experimental and quasi-experimental research?
Random assignment is a requirement for experimental research. If you do not have random assignment, you have quasi-experimental research.
What is the difference between parametric and non-parametric statistics?
Parametric statistics make use of interval or ratio scales. Non-parametric statistics make use of nominal or ordinal scales.
You want to assess the effectiveness of a community intervention initiative aimed at educating young people about the dangers of drugs. Your assessment will most likely be a(n): A. Single subject research design B. Experimental research design C. Evaluation research design D. Longitudinal research design
C. Evaluation research design (i.e., a program evaluation)
A counselor conducted a study intended to evaluate the effectiveness of ongoing group career counseling on the vocational maturity of high school sophomores. The study was begun in September and continued until June. This study is particularly susceptible to which of the following threats to the validity of an experiment? A. Reactive effects of experimentation B. Multiple treatment interference C. Regression D. Maturation
D. Maturation
A counselor designs a study where two experimental groups and one control group complete pre- and post-experiment measures of self-concept. The subjects were not randomly assigned to the groups because of scheduling problems. Which of the following techniques is MOST appropriate for analyzing the resultant data?
A. Correlated t-tests
B. Wilcoxon matched-pairs signed-ranks test
C. Analysis of covariance
D. Analysis of variance
C. Analysis of covariance
A researcher conducts a study to test the hypothesis that children who eat food with a lot of sugar are more hyperactive than children who eat food with no sugar. The study’s independent variable is ____ and its dependent variable is ____:
A. Type of children; level of sugar consumed
B. Level of aggressiveness; level of sugar consumed
C. Level of sugar consumed; level of hyperactivity
D. Level of hyperactivity of children before eating; level of hyperactivity of children after eating
C. Level of sugar consumed; level of hyperactivity
Define independent variable.
The variable that is hypothesized to bring about or predict change in the dependent variable
The scale of measurement that is characterized by an arbitrary zero point is: A. Ordinal B. Ratio C. Nominal D. Interval
D. Interval
Name the four scales of measurement.
- Nominal
- Ordinal
- Interval
- Ratio
Describe the nominal scale of measurement.
It divides variables into unordered categories
Describe the ordinal scale of measurement.
It divides variables into categories and also provides information on the order of those categories
Describe the interval scale of measurement.
Characterized by equal intervals between data points, but no absolute zero. For example, in the Fahrenheit temperature scale, zero degrees does not mean that there is absolutely no heat. Thus the zero point is arbitrary rather than absolute.
Describe the ratio scale of measurement.
Has the properties of order and equal intervals as well as the property of an absolute zero point
When assessing the effect of a pretest on the dependent variable in an experiment, which research design should you use? A. Counterbalanced design B. ABA design C. Solomon four-group design D. ABAB design
C. Solomon four-group design
Define the Solomon four-group design.
An experimental design used to control the effects of pretesting on both the internal and the external validity of a research study by including the pretest as an independent variable
You are hired by a large insurance company to help improve sales. Two groups of employees are given a motivational pep talk that is either direct or indirect. Three groups are given either high doses, moderate doses, or low doses of a new drug designed to increase the performance of salespeople. Two groups attend a class in sales techniques that is taught either by an educator or an experienced salesperson. Afterwards, all subjects take a test of attitudes towards their jobs and all of their sales, in dollar amounts, are compared to previous levels. Which of the following is an independent variable in this study? A. Sales in dollar amounts B. Qualifications of the teacher of the class C. Low dosage of the drug D. Method for improving sales performance
B. Qualifications of the teacher of the class
MANOVA is a statistical technique that is used in situations where:
A. There are multiple independent variables, each with multiple levels
B. There are multiple dependent variables and any number of independent variables
C. There are multiple dependent variables and only one independent variable
D. There are multiple dependent variables and multiple independent variables
B. There are multiple dependent variables and any number of independent variables
The most valuable type of research is
a. always conducted using a factor analysis.
b. conducted using the chi-square.
c. the experiment, used to discover cause and-effect relationships.
d. the quasi-experiment.
c. the experiment, used to discover cause and-effect relationships.
Experiments emphasize parsimony, which means
a. interpreting the results in the simplest way.
b. interpreting the results in the most complex manner.
c. interpreting the results using a correlation coefficient.
d. interpreting the results using a clinical interview.
a. interpreting the results in the simplest way.
Occam’s Razor suggests that experimenters
a. interpret the results in the simplest manner.
b. interpret the results in the most complex manner.
c. interpret the results using a correlation coefficient.
d. interpret the results using a clinical interview.
a. interpret the results in the simplest manner.
A counselor educator is running an experiment to test a new form of counseling. Unbeknownst to the experimenter one of the clients in the study is secretly seeing a gestalt therapist. This experiment
a. is parsimonious.
b. is an example of Occam’s Razor.
c. is confounded/flawed.
d. is valid and will most likely help the fi eld of counseling.
c. is confounded/flawed.
Nondirective is to person-centered as
a. psychological testing is to counseling.
b. confounding is to experimenting.
c. appraisal is to research.
d. parsimony is to Occam’s Razor.
d. parsimony is to Occam’s Razor.
An experiment is said to be confounded when
a. undesirable variables are not kept out of the experiment.
b. undesirable variables are kept out of the experiment.
c. basic research is used in place of applied research.
d. the sample is random.
a. undesirable variables are not kept out of the experiment.
In experimental terminology IV stands for _______ and DV stands for _______.
a. independent variable; dependent variable.
b. dependent variable; independent variable.
c. individual variable; dependent variable.
d. independent variable; designer variable.
a. independent variable; dependent variable.
A professor of counselor education hypothesized that biofeedback training could reduce anxiety and improve the average score on written board exams. If this professor decides to conduct a formal experiment the IV will be the _______, and the DV will be the _______.
a. professor; anxiety level.
b. anxiety level; board exam score.
c. biofeedback; board exam score.
d. board exam score; biofeedback.
c. biofeedback; board exam score.
Experimenters should always abide by a code of ethics. The variable you manipulate/control in an experiment is the
a. DV.
b. dependent variable.
c. the variable you will measure to determine the outcome.
d. IV or independent variable.
d. IV or independent variable.
In order for the professor of counselor education (see question 708) to conduct an experiment regarding his hypothesis he will need a(n) _______ and a(n) _______.
a. biofeedback group; systematic desensitization group.
b. control group; systematic desensitization group.
c. control group; experimental group.
d. at least 60 subjects in the control group; at least 60 subjects in the experimental group.
c. control group; experimental group.
In order for the professor of counselor education to conduct the experiment suggested in question 708 the experimental group would need to receive
a. the manipulated IV.
b. the biofeedback training.
c. a and b.
d. the organismic IV.
c. a and b.
Hypothesis testing is most closely related to the work of
a. Hoppock.
b. Freud.
c. Lloyd Morgan.
d. R. A. Fisher.
d. R. A. Fisher.
The null hypothesis suggests that there will not be a signifi cant difference between the experimental group which received the IV and the control group which did not. Thus, if the experiment in question 708 was conducted, the null hypothesis would suggest that
a. all students receiving biofeedback training would score equally well on the board exam.
b. systematic desensitization might work better than biofeedback.
c. biofeedback will not improve the board exam scores.
d. meta-analysis is required.
c. biofeedback will not improve the board exam scores.
From a purely statistical standpoint, in order to compare a control group (which does not receive the IV or experimental manipulation) to the experimental group the researcher will need
a. a correlation coeffi cient
b. only descriptive statistics.
c. percentile rank.
d. a test of signifi cance.
d. a test of signifi cance.
When you see the letter P in relation to a test of significance it means
a. portion.
b. population parameter.
c. probability.
d. the researcher is using an ethnographic qualitative approach.
c. probability.
In the social sciences the accepted probability level is usually
a. .05 or less.
b. 1.0 or higher.
c. .0001 or less.
d. 5.0.
a. .05 or less.
P = .05 really means that
a. fi ve subjects were not included in the study.
b. there is only a 5% chance that the difference between the control group and the experimental groups is due to chance factors.
c. the level of signifi cance is .01.
d. no level of signifi cance has been set.
b. there is only a 5% chance that the difference between the control group and the experimental groups is due to chance factors.
P = .05 really means that
a. differences truly exist; the experimenter will obtain the same results 95 out of 100 times.
b. differences truly exist; the experimenter will obtain the same results 99 out of 100 times.
c. there is a 95% error factor.
d. there is a 10% error factor.
a. differences truly exist; the experimenter will obtain the same results 95 out of 100 times.
The study that would best rule out chance factors would have a signifi cance level of P =
a. .05.
b. .01.
c. .001.
d. .08.
c. .001.
Type I and Type II errors are called _______ and _______ respectively.
a. beta; alpha.
b. .01; .05.
c. a and b.
d. alpha; beta.
d. alpha; beta.
A Type I error occurs when
a. you have a beta error.
b. you accept null when it is false.
c. you reject null when it is true.
d. you fail to use a test of significance.
c. you reject null when it is true.
A Type II error
a. is also called a beta error.
b. means you reject null when it is applicable.
c. means you accept null when it is false.
d. a and c.
d. a and c.
Assume the experiment in question 708 is conducted. The results indicate that the biofeedback helped raise written board exam scores but in reality this is not the case. The researcher has made a
a. Type I error.
b. Type II error.
c. beta error.
d. b and c.
a. Type I error.
A counselor educator decides to increase the sample size in her experiment. This will
a. confound the experiment in nearly every case.
b. raise the probability of Type I and Type II errors.
c. have virtually no impact on Type I and Type II errors.
d. reduce Type I and Type II errors.
d. reduce Type I and Type II errors.