Research And Program Evaluation Flashcards
The most valuable type of research is
a. always conducted using a factor analysis.
b. conducted using the chi-square.
c. the experiment, used to discover cause-and-effect relationships.
d. thequasi-experiment.
The experiment, used to discover cause-and-effect relationships.
Experiments emphasize parsimony, which means
a. interpreting the results in the simplest way.
b. interpreting the results in the most complex manner.
c. interpreting the results using a correlation coefficient.
d. interpreting the results using a clinical interview.
Interpreting the results in the simplest way.
Parsimonious literally means a tendency to be miserly and not overspend. A parsimonious individual is said to be overly economical and stingy. In research, we strive for parsimony in the sense that the easiest and less-complex explanation is said to be the best; an economical description if you will.
Occam’s Razor suggests that experimenters
a. interpret the results in the simplest manner.
b. interpret the results in the most complex manner. c. interpret the results using a correlation coefficient. d. interpret the results using a clinical interview.
Interpret the results in the simplest manner.
A word to the wise: Exams often refer to parsimony as Occam’s Razor, the principle of economy, or Lloyd Morgan’s 1894 Canon (canon in this sense means “law”). Conway Lloyd Morgan was an English psychologist/physiologist, while William of Occam was a fourteenth-century philosopher and theologian.
A counselor educator is running an experiment to test a new form of counseling. Unbeknownst to the experimenter one of the clients in the study is secretly seeing a gestalt therapist. This experiment
a. is parsimonious.
b. is an example of Occam’s Razor.
c. is confounded/flawed.
d. is valid and will most likely help the field of counseling.
Is confounded/flawed.
Nondirective is to person-centered as
a. psychological testing is to counseling.
b. confounding is to experimenting.
c. appraisal is to research.
d. parsimony is to Occam’s Razor.
Parsimony is to Occam’s Razor.
An experiment is said to be confounded when
a. undesirable variables are not kept out of the experiment.
b. undesirable variables are kept out of the experiment.
c. basic research is used in place of applied research.
d. the sample is random.
Undesirable variables are not kept out of the experiment.
Confounding is said to occur when an undesirable variable which is not controlled by the researcher is introduced in the experiment. Hint: Your exam could refer to this as a contaminating variable.
In experimental terminology IV stands for ________ and DV stands for ________.
a. independent variable; dependent variable
b. dependent variable; independent variable
c. individual variable; dependent variable
d. independent variable; designer variable
Independent variable; dependent variable
A professor of counselor education hypothesized that biofeedback training could reduce anxiety and improve the average score on written board exams. If this professor decides to conduct a formal experiment the IV will be the ________, and the DV will be the ________.
a. professor; anxiety level
b. anxiety level; board exam score
c. biofeedback; board exam score
d. board exam score; biofeedback
Biofeedback; board exam score
Experimenters should always abide by a code of ethics. The variable you manipulate/control in an experiment is the
a. DV.
b. dependent variable.
c. the variable you will measure to determine the outcome.
d. IV or independent variable.
IV or independent variable.
In order for the professor of counselor education (see question 708) to conduct an experiment regarding his hypothesis he will need a(n) ________ and a(n) ________.
a. biofeedback group; systematic desensitization group
b. control group; systematic desensitization group
c. control group; experimental group
d. control group with at least 60 subjects; experimental group
with at least 60 subjects
Control group; experimental group
In order for the professor of counselor education to conduct the experiment suggested in question 708 the experimental group would need to receive
a. the manipulated IV.
b. the biofeedback training.
c. a and b.
d. the organismic IV.
A and B.
The experimental group receives the IV, which in this case is the biofeedback training. An organismic variable is one the researcher cannot control yet exists, such as height, weight, or gender. To determine whether an organismic IV exists you simply ask yourself if there is an experimental variable being examined which you cannot manipulate. In most cases, when you are confronted with IV/DV identification questions, the IV will be of the “manipulated variety.”
Hypothesis testing is most closely related to the work of
a. Robert Hoppock.
b. Sigmund Freud.
c. Lloyd Morgan.
d. R. A. Fisher.
R. A. Fisher.
Hypothesis testing was pioneered by R. A. Fisher. A hypothesis is a hunch or an educated guess which can be tested utilizing the experimental model.
The null hypothesis suggests that there will not be a significant difference between the experimental group which received the IV and the control group which did not. Thus, if the experiment in question 708 was conducted, the null hypothesis would suggest that
a. all students receiving biofeedback training would score equally well on the board exam.
b. systematic desensitization might work better than biofeedback.
c. biofeedback will not improve the board exam scores.
d. meta-analysis is required.
Biofeedback will not improve the board exam scores.
The hunch is known as the experimental or alternative hypothesis. The experimental hypothesis suggests that a difference will be evident between the control group and the experimental group (i.e., the group receiving the IV). Thus, if the experiment in question 708 were conducted, the experimental hypothesis would suggest that
a. the biofeedback would raise board scores.
b. the control group will score better on the board exam.
c. there will be no difference between the experimental and
the control groups.
d. the experiment has been confounded.
The biofeedback would raise board scores.
An alternative hypothesis—which may be called the “affirmative hypothesis” on your exam—asserts that the IV has indeed caused a change.
From a purely statistical standpoint, in order to compare a control group (which does not receive the IV or experimental manipulation) to the experimental group the researcher will need
a. a correlation coefficient
b. only descriptive statistics.
c. percentile rank.
d. a test of significance.
A test of significance.
When you see the letter P in relation to a test of significance it
means
a. portion.
b. population parameter.
c. probability.
d. the researcher is using an ethnographic qualitative
approach.
Probability.
In the social sciences the accepted probability level is usually
a. .05 or less.
b. 1.0 or higher.
c. .0001 or less.
d. .05 or higher.
.05 or less.
The two most popular levels of significance are .05 and .01.
P = .05 really means that
a. five subjects were not included in the study.
b. there is only a 5% chance that the difference between the control group and the experimental groups is due to chance
factors.
c. the level of significance is .01.
d. no level of significance has been set.
There is only a 5% chance that the difference between the control group and the experimental groups is due to chance
factors.
P = .05 really means that
a. differences truly exist; the experimenter will obtain the same results 95 times out of 100.
b. differences truly exist; the experimenter will obtain the same results 99 times out of 100.
c. there is a 95% error factor.
d. there is a 10% error factor.
Differences truly exist; the experimenter will obtain the same results 95 times out of 100.
The study that would best rule out chance factors would have a significance level of P =
a. .05.
b. .01.
c. .001.
d. .08.
.001.
The smaller the value for P the more stringent the level of significance. Here, the .001 level is the most stringent level listed, indicating that there is only one chance in 1,000 that the results are due to chance, versus one in 20 for .05, and one in 100 for .01. In plain, everyday English it is easier to get significant results using .08, .05, or .01, than it is using .001.
Type I and Type II errors are called ________ and ________
respectively.
a. beta;alpha
b. .01;.05
c. a and b
d. alpha;beta
Alpha;beta
If it sounds a little like Greek, that’s because it is. Alpha and beta are the first and second letters of the Greek alphabet. A Type I (alpha error) occurs when a researcher rejects the null hypothesis when it is true; and a Type II error (beta error) occurs when you accept null when it is false.
A Type I error occurs when
a. you have a beta error.
b. you accept null when it is false.
c. you reject null when it is true.
d. you fail to use a test of significance.
You reject null when it is true.
A Type II error
a. is also called a beta error.
b. means you reject null when it is applicable. c. means you accept null when it is false.
d. a and c.
A and C.
Assume the experiment in question 708 is conducted. The results indicate that the biofeedback helped raise written board exam scores but in reality this is not the case. The researcher has made a
a. Type I error.
b. Type II error.
c. beta error.
d. b and c.
Type I error.
In this case null would indicate that biofeedback did not raise board exam scores. This question tells you that the experimental results revealed that biofeedback did raise board scores, so you will reject the null hypothesis.
A counselor educator decides to increase the sample size in her experiment. This will
a. confound the experiment in nearly every case.
b. raise the probability of Type I and Type II errors.
c. have virtually no impact on Type I and Type II errors.
d. reduce Type I and Type II errors.
Reduce Type I and Type II errors.
Raising the size of a sample helps to lower the risk of chance/ error factors. Simply put: Differences revealed via large samples are more likely to be genuine than differences revealed using a small sample size.
If a researcher changes the significance level from .05 to .001, then
a. alpha and beta errors will increase.
b. alpha errors increase but beta errors decrease.
c. alpha errors decrease; however, beta errors increase.
d. this will have no impact on Type I and Type II errors.
Alpha errors decrease; however, beta errors increase.
A counselor believes that clients who receive assertiveness training will ask more questions in counseling classes. An experimental group receives assertiveness training while a control group does not. In order to test for significant differences
between the groups the counselor should utilize
a. the student’s t test.
b. a correlation coefficient.
c. a survey.
d. an analysis of variance (ANOVA).
The student’s t test.
When comparing two sample groups the t test, which is a simplistic form of the analysis of variance, is utilized. The t test is used to ascertain whether two sample means are significantly different.
The researcher in question 727 now attempts a more complex experiment. One group receives no assertiveness training, a second group receives four assertiveness training sessions, and a third receives six sessions. The statistic of choice would be the
a. mean.
b. t test.
c. two-way ANOVA.
d. ANOVA.
ANOVA.
Since the simple ANOVA or one-way analysis of variance is used when there is more than one level of a single IV, which in this case is the assertiveness training.
If the researcher in the previous question utilized two IVs then the statistic of choice would be the
a. median.
b. t test.
c. two-way ANOVA or MANOVA.
d. ANOVA.
Two-way ANOVA or MANOVA.
Two IVs requires a two-way ANOVA, three IVs, a three-way ANOVA, etc.
To complete a t test you would consult a tabled value of t. In order to see if significant differences exist in an ANOVA you would consult
a. the mode.
b. a table for t values.
c. a table for F values.
d. thechi-square.
A table for F values.
Which level of significance would best rule out chance factors?
a. .05
b. .01
c. .2
d. .001
.001
When a researcher uses correlation, then there is no direct manipulation of the IV. A researcher might ask, for example, how IQ correlates with the incidence of panic disorder. Again, nothing is manipulated; just measured. In cases such as this a correlation coefficient will reveal
a. the relationship between IQ and panic disorder.
b. the probability that a significant difference exists.
c. an F test.
d. percentile rank.
The relationship between IQ and panic disorder.
If data indicate that students who study a lot get very high scores on state counselor licensing exams, then the correlation between study time and LPC exam scores would be
a. positive.
b. negative.
c. 0.00.
d. impossible to ascertain.
Positive
Which of the following would most likely yield a perfect correlation of 1.00?
a. IQ and salary.
b. ICD diagnosis and salary.
c. Length in inches and length in centimeters.
d. Height and weight
Length in inches and length in centimeters.
A good guess would be that if you would correlate the length of CACREP graduates’ baby toes with their CPCE scores the result would be
a. close to 0.00.
b. close to a perfect 1.00.
c. close to a perfect negative correlation of -1.00.
d. be about +.70
Close to 0.00.
There is an absence of association here because as one variable changes the other variable varies randomly. The variation of one variable is most likely totally unrelated to the variation of the
other.
Dr. X discovered that the correlation between therapists who hold NCC status and therapists who practice systematic desensitization is .90. A student who perused Dr. X’s research told his fellow students that Dr. X had discovered that attaining NCC status causes therapists to become behaviorally oriented.
The student is incorrect because
a. systematic desensitization is clearly not a behavioral strategy.
b. this can only be determined via a histogram.
c. the study suffers from longitudinal and maturational
effects.
d. correlation does not imply causal.
Correlation does not imply causal.
Correlation does not mean causal! Correlational research is quasi-experimental, and hence, it does not yield cause–effect data.
Behaviorists often utilize N = 1, which is called intensive experimental design. The first step in this approach would be to
a. consult a random number table.
b. decide on a nonparametric statistical test.
c. take a baseline measure.
d. compute the range.
Compute the range.
In a new study the clients do not know whether they are receiving an experimental treatment for depression or whether they are simply part of the control group. This is, nevertheless, known to the researcher. Thus, this is a
a. double-blind study.
b. single-blind study.
c. baseline for an intensive N = 1 design.
d. participant observer model.
Single-blind study.
In the single-blind study the subject would not know whether he or she is a member of the control group or the experimental group. This strategy helps eliminate “demand characteristics” which are cues or features of a study which suggest a desired outcome.
A large study at a major university gave an experimental group of clients a new type of therapy that was intended to ameliorate test anxiety. The control group did not receive the new therapy. Neither the clients nor the researchers knew which students received the new treatment. This was a
a. double-blind study.
b. single-blind study.
c. typical AB design.
d. case of correlational research.
Double-blind study.
Experimental is to cause and effect as correlational is to
a. blind study.
b. double-blind study.
c. N = 1 design.
d. degree of relationship.
Degree of relationship.