Research & Program Evaluation Flashcards
The most valuable type of research is
a. always conducted using a factor analysis.
b. conducted using the chi-square.
c. the experiment, used to discover cause-and-effect relationships.
d. the quasi-experiment.
c. the experiment, used to discover cause-and-effect relationships.
Experiments emphasize parsimony, which means
a. interpreting the results in the simplest way.
b. interpreting the results in the most complex manner.
c. interpreting the results using a correlation coefficient.
d. interpreting the results using a clinical interview.
a. interpreting the results in the simplest way.
Occam’s Razor suggests that experimenters
a. interpret the results in the simplest manner
b. interpret the results in the most complex manner.
c. interpret the results using a correlation coefficient.
d. interpret the results using a clinical interview.
a. interpret the results in the simplest manner
A counselor educator is running an experiment to test a new form of counseling. Unbeknownst to the experimenter one of the clients in the study is secretly seeing a gestalt therapist. This experiment
a. is parsimonious.
b. is an example of Occam’s Razor.
c. is confounded/flawed.
d. is valid and will most likely help the field of counseling.
c. is confounded/flawed.
Nondirective is to person-centered as
a. psychological testing is to counseling.
b. confounding is to experimenting.
c. appraisal is to research.
d. parsimony is to Occam’s Razor.
d. parsimony is to Occam’s Razor.
An experiment is said to be confounded when
a. undesirable variables are not kept out of the experiment.
b. undesirable variables are kept out of the experiment.
c. basic research is used in place of applied research.
d. the sample is random.
a. undesirable variables are not kept out of the experiment.
In experimental terminology IV stands for ________ and DV stands for ________.
a. independent variable; dependent variable
b. dependent variable; independent variable
c. individual variable; dependent variable
d. independent variable; designer variable
a. independent variable; dependent variable
A professor of counselor education hypothesized that biofeedback training could reduce anxiety and improve the average score on written board exams. If this professor decides to conduct a formal experiment the IV will be the ________, and the DV will be the ________.
a. professor; anxiety level
b. anxiety level; board exam score
c. biofeedback; board exam score
d. board exam score; biofeedback
c. biofeedback; board exam score
I manipulate… or I experiment with, well, the biofeedback training, of course.” The “I” statement here gives you your “IV.”
Experimenters should always abide by a code of ethics. The variable you manipulate/control in an experiment is the
a. DV.
b. dependent variable.
c. the variable you will measure to determine the outcome.
d. IV or independent variable.
d. IV or independent variable.
In order for the professor of counselor education (see question 708) to conduct an experiment regarding his hypothesis he will need a(n) ________ and a(n) ________.
a. biofeedback group; systematic desensitization group
b. control group; systematic desensitization group
c. control group; experimental group
d. control group with at least 60 subjects; experimental group with at least 60 subjects
c. control group; experimental group
In order for the professor of counselor education to conduct the experiment suggested in question 708 the experimental group would need to receive
a. the manipulated IV.
b. the biofeedback training.
c. a and b.
d. the organismic IV.
c. a and b.
Hypothesis testing is most closely related to the work of
a. Robert Hoppock.
b. Sigmund Freud.
c. Lloyd Morgan.
d. R. A. Fisher.
d. R. A. Fisher.
The null hypothesis suggests that there will not be a significant difference between the experimental group which received the IV and the control group which did not. Thus, if the experiment in question 708 was conducted, the null hypothesis would suggest that
a. all students receiving biofeedback training would score equally well on the board exam.
b. systematic desensitization might work better than biofeedback.
c. biofeedback will not improve the board exam scores.
d. meta-analysis is required.
c. biofeedback will not improve the board exam scores.
The hunch is known as the experimental or alternative hypothesis. The experimental hypothesis suggests that a difference will be evident between the control group and the experimental group (i.e., the group receiving the IV). Thus, if the experiment in question 708 were conducted, the experimental hypothesis would suggest that
a. the biofeedback would raise board scores.
b. the control group will score better on the board exam.
c. there will be no difference between the experimental and the control groups.
d. the experiment has been confounded.
a. the biofeedback would raise board scores.
From a purely statistical standpoint, in order to compare a control group (which does not receive the IV or experimental manipulation) to the experimental group the researcher will need
a. a correlation coefficient
b. only descriptive statistics.
c. percentile rank.
d. a test of significance.
d. a test of significance.
The correct answer is that the researcher in this experiment will need a test of significance. Such statistical tests are used to determine whether a difference in the groups’ scores is “significant” or just due to chance factors.
When you see the letter P in relation to a test of significance it means
a. portion.
b. population parameter.
c. probability.
d. the researcher is using an ethnographic qualitative approach.
c. probability.
In the social sciences the accepted probability level is usually
a. .05 or less.
b. 1.0 or higher.
c. .0001 or less.
d. .05 or higher.
a. .05 or less.
The two most popular levels of significance are .05 and .01.
P = .05 really means that
a. five subjects were not included in the study.
b. there is only a 5% chance that the difference between the control group and the experimental
groups is due to chance factors.
c. the level of significance is .01.
d. no level of significance has been set.
b. there is only a 5% chance that the difference between the control group and the experimental groups is due to chance factors.
P = .05 really means that
a. differences truly exist; the experimenter will obtain the same results 95 times out of 100.
b. differences truly exist; the experimenter will obtain the same results 99 times out of 100.
c. there is a 95% error factor.
d. there is a 10% error factor.
a. differences truly exist; the experimenter will obtain the same results 95 times out of 100.
The study that would best rule out chance factors would have a significance level of P =
a. .05.
b. .01.
c. .001.
d. .08.
c. .001.
The smaller the value for P the more stringent the level of significance.
Type I and Type II errors are called ________ and ________ respectively.
a. beta; alpha
b. .01; .05
c. a and b
d. alpha; beta
d. alpha; beta
A Type I error occurs when
a. you have a beta error.
b. you accept null when it is false.
c. you reject null when it is true.
d. you fail to use a test of significance.
c. you reject null when it is true.
Let “RA” be your first error (i.e., alpha, Type I) and remember this error occurs when you “R” (reject) null when you should “A” for accept it.
A Type II error
a. is also called a beta error.
b. means you reject null when it is applicable.
c. means you accept null when it is false.
d. a and c.
d. a and c.
Assume the experiment in question 708 is conducted. The results indicate that the biofeedback helped raise written board exam scores but in reality this is not the case. The researcher has made a
a. Type I error.
b. Type II error.
c. beta error.
d. b and c.
a. Type I error.
A counselor educator decides to increase the sample size in her experiment. This will
a. confound the experiment in nearly every case.
b. raise the probability of Type I and Type II errors.
c. have virtually no impact on Type I and Type II errors.
d. reduce Type I and Type II errors.
d. reduce Type I and Type II errors.
If a researcher changes the significance level from .05 to .001, then
a. alpha and beta errors will increase.
b. alpha errors increase but beta errors decrease.
c. alpha errors decrease; however, beta errors increase.
d. this will have no impact on Type I and Type II errors.
c. alpha errors decrease; however, beta errors increase.
A counselor believes that clients who receive assertiveness training will ask more questions in counseling classes. An experimental group receives assertiveness training while a control group does not. In order to test for significant differences between the groups the counselor should utilize
a. the student’s t test.
b. a correlation coefficient.
c. a survey.
d. an analysis of variance (ANOVA).
a. the student’s t test.
When comparing two sample groups the t test, which is a simplistic form of the analysis of variance, is utilized.
The t test is used to ascertain whether two sample means are significantly different. The researcher sets the level of significance and then runs the experiment.
The t test is computed and this yields a t value. The researcher then goes to a t table found in the index of most statistics’ texts. If the t value obtained statistically is lower than the t value (sometimes called “critical t”) in the table, then you accept the null hypothesis.
The researcher in question 727 now attempts a more complex experiment. One group receives no assertiveness training, a second group receives four assertiveness training sessions, and a third receives six sessions. The statistic of choice would be the
a. mean.
b. t test.
c. two-way ANOVA.
d. ANOVA.
d. ANOVA.
The answer is choice “d” since the simple ANOVA or one-way analysis of variance is used when there is more than one level of a single IV, which in this case is the assertiveness training.
If the researcher in the previous question utilized two IVs then the statistic of choice would be the
a. median.
b. t test.
c. two-way ANOVA or MANOVA.
d. ANOVA.
c. two-way ANOVA or MANOVA.
To complete a t test you would consult a tabled value of t. In order to see if significant differences exist
in an ANOVA you would consult
a. the mode.
b. a table for t values.
c. a table for F values.
d. the chi-square.
c. a table for F values.
Which level of significance would best rule out chance factors?
a. .05
b. .01
c. .2
d. .001
d. .001
When a researcher uses correlation, then there is no direct manipulation of the IV. A researcher might ask, for example, how IQ correlates with the incidence of panic disorder. Again, nothing is manipulated; just measured. In cases such as this a correlation coefficient will reveal
a. the relationship between IQ and panic disorder.
b. the probability that a significant difference exists.
c. an F test.
d. percentile rank.
a. the relationship between IQ and panic disorder.
If data indicate that students who study a lot get very high scores on state counselor licensing exams, then the correlation between study time and LPC exam scores would be
a. positive.
b. negative.
c. 0.00.
d. impossible to ascertain.
a. positive.
Which of the following would most likely yield a perfect correlation of 1.00?
a. IQ and salary.
b. ICD diagnosis and salary.
c. Length in inches and length in centimeters.
d. Height and weight.
c. Length in inches and length in centimeters.
A good guess would be that if you would correlate the length of CACREP graduates’ baby toes with their CPCE scores the result would be
a. close to 0.00.
b. close to a perfect 1.00.
c. close to a perfect negative correlation of -1.00.
d. be about +.70.
a. close to 0.00.
Dr. X discovered that the correlation between therapists who hold NCC status and therapists who practice systematic desensitization is .90. A student who perused Dr. X’s research told his fellow students that Dr. X had discovered that attaining NCC status causes therapists to become behaviorally oriented. The student is incorrect because
a. systematic desensitization is clearly not a behavioral strategy.
b. this can only be determined via a histogram.
c. the study suffers from longitudinal and maturational effects.
d. correlation does not imply causal.
d. correlation does not imply causal.
Behaviorists often utilize N = 1, which is called intensive experimental design. The first step in this approach would be to
a. consult a random number table.
b. decide on a nonparametric statistical test.
c. take a baseline measure.
d. compute the range.
c. take a baseline measure.
In a new study the clients do not know whether they are receiving an experimental treatment for depression or whether they are simply part of the control group. This is, nevertheless, known to the researcher. Thus, this is a
a. double-blind study.
b. single-blind study.
c. baseline for an intensive N = 1 design.
d. participant observer model.
b. single-blind study.
A large study at a major university gave an experimental group of clients a new type of therapy that was intended to ameliorate test anxiety. The control group did not receive the new therapy. Neither the clients nor the researchers knew which students received the new treatment. This was a
a. double-blind study.
b. single-blind study.
c. typical AB design.
d. case of correlational research.
a. double-blind study.
Experimental is to cause and effect as correlational is to
a. blind study.
b. double-blind study.
c. N = 1 design.
d. degree of relationship.
d. degree of relationship.