CACREP AREA: Research and Program Evaluation Flashcards
The most valuable type of research is…?
the experiment — used to discover cause-and-effect relationships.
Experiments emphasize parsimony, which means interpreting the results…?
Interpreting the results in the simplest way
HINT:
In research, parsimony is strived for as it is the easiest and less complex expklanation
Parsimony: In research, it means using the simplest explanation that fits the data without adding extra assumptions.
Occam’s Razor suggests that experimenters interpret the results…?
interpret the results in the simplest manner
HINT: Parsimony is also referred to as Occam’s Razor, which is a principle of economics.
A counselor educator is running an experiment to test a new form of counseling. Unbeknownst to the experimenter one of the clients in the study is secretly seeing a gestalt therapist.
This experiment is…?
is confounded/flawed
Nondirective is to person-centered as ___?___ is to ___?___
parsimony is to Occam’s Razor.
An experiment is said to be confounded when…?
Undesirable variables are not kept out of the experiement
NOTE: CPCE may refer to this as “contaminating variable”
HINT:
Cofounding = Happens when an uncontrolled, unwanted variable affects the experiment’s results; the researcher is not in control of this
In experimental terminology IV stands for ___?___ and DV stands for ___?___
independent variable; dependent variable
HINT:
IV = variable the researcher manipulates, controls, alters, etc. in the experiment
DV = expresses the outcome, or the data
A professor of counselor education hypothesized that biofeedback training could reduce anxiety and improve the average score on written board exams.
If this professor decides to conduct a formal experiment the IV will be the ___?___ and the DV will be the ___?___
biofeedback; board exam score
Experimenters should always abide by a code of ethics. The variable you manipulate/control in an experiment is the
IV or independent variable.
In order for the professor of counselor education (see question
708) to conduct an experiment regarding his hypothesis he will need a(n) ___?___ and a(n) ___?___
control group; experimental group
Footnote
In order for the professor of counselor education to conduct the experiment suggested in question 708 the experimental group would need to receive what?
HINT: Multiple answers
1) the manipulated IV
2) the biofeedback training
Hypothesis testing is most closely related to the work of which theorist?
R. A. Fisher.
HINT:
Null hypothesis = the idea that nothing is happening or changing. It’s what you assume to be true until you have evidence to show otherwise.
In other words, THE IV DOES NOT AFFECT THE DV
The null hypothesis suggests that there will not be a significant difference between the experimental group which received the
IV and the control group which did not.
Thus, if the experiment in question 708 was conducted, the null hypothesis would suggest that…?
biofeedback will not improve the board exam scores.
The hunch is known as the experimental or alternative hypothesis.
The experimental hypothesis suggests that a difference will be evident between the control group and the experimental group (i.e., the group receiving the IV).
Thus, if the experiment in question 708 were conducted, the experimental hypothesis would suggest that…?
the biofeedback would raise board scores
From a purely statistical standpoint, in order to compare a control group (which does not receive the IV or experimental manipulation) to the experimental group the researcher will need do a…?
A test of significance.
HINT: Statistical tests (like test of significance) are used to determine whether a difference in the groups’ score is significant or just due to chance factors
When you see the letter P in relation to a test of significance it means…?
Probability
HINT:
In research, the probability (P) is usually set at .05 or lower (ex: .01 or .001)
In the social sciences the accepted probability level is usually
.05 or less.
HINT:
The two most popular levels of significance are:
1) .05
2) .01
P = .05 really means that…?
there is only a 5% chance that the difference between the control group and the experimental groups is due to chance factors.
P = 05 really means that…?
differences truly exist; the experimenter will obtain the same results 95 times out of 100.
The study that would best rule out chance factors would have a significance level of P = …?
.001
HINT:
The smaller the value for P (probability) = the more strict/precise the level of significance
Here, .001 level is the most strict/precise level that indicates there is only one chance in 1000 that the results are due to chance
Type I and Type II errors are called ___?___ and ___?___ respectively.
alpha; beta
HINT:
Type I error (alpha error) = occurs when researcher rejects the null hypothesis when it is true
Type II error (beta error) = occurs when researcher accepts the null hypothesis when it is false
A Type I error occurs when you…?
you reject null when it is true
Footnote
What is true of a Type II error
HINT: Multiple answers
1) it is also called a beta error
2) it means you accept null when it is false.
Assume the experiment in question 708 is conducted. The results indicate that the biofeedback helped raise written board exam scores but in reality this is not the case.
The researcher has made which type of error?
Type I error
A counselor educator decides to increase the sample size in her experiment.
This will do what?
reduce Type I and Type II errors.
HINT:
Raising the size of the sample helps lower the risk of chance/error factors
If a researcher changes the significance level from .05 to .001, what will occur?
alpha errors decrease; however, beta errors increase.
A counselor believes that clients who receive assertiveness training will ask more questions in counseling classes. An experimental group receives assertiveness training while control group does not.
In order to test for significant differences between the groups the counselor should utilize what?
the student’s t test.
HINT:
A t-est is used to compare two sample groups; this is a simple form of the analysis variance (ANOVA)
The researcher in question 727 now attempts a more complex experiment. One group receives no assertiveness training, a second group receives four assertiveness training sessions, and a third receives six sessions.
The statistic of choice would be the…?
ANOVA
HINT:
An ANOVA (aka one-way analysis of variance) is used when there is more than one level of a single IV (independent variable)
If the researcher in the previous question (question 728) utilized two IVs then the statistic of choice would be the…?
two-way ANOVA or MANOVA.
HINT:
Two IV’s (independent variables) requires a two way ANOVA
To complete a t test you would consult a tabled value of t.
In order to see if significant differences exist in an ANOVA you would consult…?
A table for F values.
Which level of significance would best rule out chance factors?
.001
When a researcher uses correlation, then there is no direct manipulation of the IV. A researcher might ask, for example, how IQ correlates with the incidence of panic disorder. Again, nothing is manipulated; just measured.
In cases such as this, a correlation coefficient will reveal what?
The relationship between IQ and panic disorder
HINT:
Correlation Coefficient = A number that shows how strongly two variables are related, ranging from -1 to 1. Often expressed a “r”
1) Positive Correlation Coefficient: Indicates that as one variable increases, the other also increases.
* EX: More study hours are linked to higher test scores.
2) Negative Correlation Coefficient: Indicates that as one variable increases, the other decreases.
* EX: More hours of TV watching are linked to lower test scores.
If data indicate that students who study a lot get very high scores on state counselor licensing exams, then the correlation between study time and LPC exam scores would be…?
positive
Which of the following would most likely yield a perfect correlation of 1.00?
Length in inches and length in centimeters.
A good guess would be that if you would correlate the length of
CACREP graduates’ baby toes with their CPCE scores the result would be…?
close to 0.00 (there’s an absence of association as these have no relation)
Dr. X discovered that the correlation between therapists who hold NCC status and therapists who practice systematic desensitization is .90.
A student who perused (read/examined) Dr. X’s research told his fellow students that Dr. X had discovered that attaining NCC status causes therapists to become behaviorally oriented.
The student is incorrect because…?
correlation does NOT imply causal.
Behaviorists often utilize N = 1, which is called intensive experimental design.
The first step in this approach would be to do what?
take a baseline measure
HINT:
N = number of people being studied or the sample size
Baseline measure = the initial data collected to assess the starting point of a condition or behavior before any changes or interventions are made.
In a new study the clients do not know whether they are receiving an experimental treatment for depression or whether they are simply part of the control group.
This is, nevertheless, known to the researcher. Thus, this is an example of…?
single-blind study
HINT:
Single blind study = the subject would not know whether they are a member of the control gorup or the experiemental group, but the researcher does
This helps eliminate Demand Characteristics:
* Clues/signals in an experiment that cause participants to guess the purpose of the study, leading them to change their behavior to fit what they think is expected.
A large study at a major university gave an experimental group of clients a new type of therapy that was intended to ameliorate test anxiety. The control group did not receive the new therapy.
Neither the clients nor the researchers knew which students received the new treatment. This is an example of…?
double-blind study
HINT:
Double blind study = BOTH the subject and researcher would not know whether they are a member of the control group or the experiemental group
This helps eliminate confounding variables caused by experimental effect:
* experimental effects can flaw an experiment as the researcher might unconsciously communicate their intent/expectations to the subjects
Experimental is to cause and effect as correlational is to…?
degree of relationship