Research & Program Evaluation Flashcards

1
Q

The credibility of studies published in refereed journals is usually higher than studies published in non-refereed journals because

  • there is a longer history of publication of good studies in refereed journals
  • more methodological detail is included in refereed journals
  • the ‘blind review’ of articles accepted for refereed journals ensures their quality
  • the writing style in refereed journals is better
A

The ‘blind review’ of articles accepted for refereed journals ensures their quality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

If a counselor is conducting an observation study of children’s behavior in a classroom, he or she will have to take into account which of the following phenomena?

  • Hawthorne effect
  • Placebo effect
  • Halo effect
  • Self-fulfilling prophecy
A

Hawthorne effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In a research study that users volunteers, the researcher should

  • give an account of how volunteers might differ from non-volunteers
  • use a larger sample
  • statistically control for people’s willingness to volunteer
  • state the purposes of the study simply so that volunteers can understand
A

give an account of how volunteers might differ from non-volunteers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

The multiple correlation of 5 predictor variables with grade point average (GPA) is .50 This means that

  • the best single predictor has 25 per cent shared variance with GPA
  • average correlation between each predictor and GPA is .25
  • combined predictors have 25 per cent shared variance with GPA
  • average predictor has a .50 correlation with GPA
A

combined predictors have 25 per cent shared variance with GPA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The statement, “there is a negative relationship between number of older siblings and social maturity among six year old children” si an example of a(n)

  • null hypothesis
  • directional hypothesis
  • research question
  • implication
A

directional hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

If a researcher is comparing the mean scores of rural and urban students and male and female students on a self-efficacy measure, the appropriate statistical procedure would be a

  • t-test
  • one-way ANOVA
  • regression analysis
  • factorial ANOVA
A

factorial ANOVA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Product’ evaluation, sometimes known as ‘summative’ evaluation, is focused on a program’s

  • efficiency
  • outcomes
  • face validity
  • process elements
A

outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

In a multi-authored journal article, the primary responsibility for the ethical conduct of the research falls upon

  • the author who is employed in the most senior rank
  • the author whose name comes first in the list of authors
  • all authors independently and collectively
  • the authors who actually conducted the data collection
A

the author whose name comes first in the list of authors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Research which is focused on developing and testing theory rather than on practical applications is called

  • descriptive
  • deductive
  • basic
  • applied
A

basic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which of the following research designs allows for the greatest confidence with regard to external validity

  • one- group posttest only design
  • one group pretest-posttest design
  • posttest only control group design
  • pretest-posttest control-group design
A

posttest only control group design

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which of the following reasons explains best why longitudinal studies have rarely been conducted in counseling

  • results are this type of research are not so useful
  • it takes too long to collect data of this kind
  • it costs too much to do these studies
  • the statistical procedures needed are too complex
A

it costs too much to do these studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

If you are conducting a single-subject research design study the first thing you will do is establish

  • termination
  • baseline
  • membership of the control group
  • treatment protocols
A

baseline

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When 2 or more independent variables simultaneously affect the dependent variable, at least some degree of a(n) ___________ effect can be expected to have occurred

  • experimenter
  • Hawthorne
  • correlational
  • interaction
A

interaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

A counselor studies student experiences of counseling with a series of statements followed by a scale of five responses foir each statement ranging from Strongly agree to Strongly disagree. This is called a _____________ scale.

  • Thurstone
  • Likert
  • weighted
  • bathroom
A

Likert

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

A one-way ANOVA differs from a t-test in that it is used to test the difference(s) among

  • two means
  • three or more means
  • two means with at least 2 independent variables
  • 3 or more means with at least 3 independent variables
A

three or more means

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Qualitative research is more context sensitive because human behavior is

  • abnormal only within certain contexts
  • not manifest in all settings
  • often not what it appears to a casual observer
  • influenced by the settings in which it occurs
A

influenced by the settings in which it occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

The strongest argument for the validity of research results is when

  • previous research supports the results
  • internal validity is well documented
  • external validity is evident
  • replications of the study support the results
A

replications of the study support the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

The .05 alpha level of statistical significance means that

  • Decisions made on the basis of the study will be wroing .05% of the time
  • 5 times out of 100 the null hypothesis will be rejected incorrectly
  • there are 5 chances in 100 that the null hypothesis is true
  • there are 5 chances in 100 that the statistical calculations will be in error
A

5 times out of 100 the null hypothesis will be rejected incorrectly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Institutional review boards (or Human Subjects Committees) were created in the attempt to ensure that

  • researchers conduct research according to professional standards
  • the viability of research activities is enhanced
  • the legal rights of participants in research are protected
  • researchers adhere to pertinent ethical standards
A

the legal rights of participants in research are protected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Experimental research is always characterized by (at least)

  • random selection of subjects from a population
  • 2 or more independent variables
  • use of a control group
  • manipulation of the independent variable
A

manipulation of the independent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Clinical vs. actuarial prediction research is concerned with:

  • which type of therapy is best evaluated with either method
  • the best evaluative procedure for career assessment
  • the best way to interpret information
  • parametric vs. non-parametric analysis
A

parametric vs. non-parametric analysis

22
Q

Research in psychotherapy regarding the effectiveness of different theoretical orientations suggests:

  • outcome research although improving is sparse
  • difficulty in comparing cure rates across theories because of differing philosophies
  • different techniques produce different results
  • effectiveness of the models is not the most important variable
A

difficulty in comparing cure rates across theories because of differing philosophies

23
Q

Measuring change in psychotherapy has typically been accomplished by which of the following?

  • observation by trained individuals
  • insight
  • matched assignments of individual
  • random assignment
A

matched assignments of individual

24
Q

Early research by Eysenck (1952) and later by Bergin (1971) regarding effectiveness of psychotherapy emphasized that:

  • all therapy is effective
  • Eysenck said no effect with psychotherapy was evident, while Bergin said psychotherapy was more effective than no treatment
  • Eysenck said psychotherapy was more effective than no treatment, while Bergin said there was no difference with psychotherapy
  • both said psychotherapy was not effective
A

Eysenck said no effect with psychotherapy was evident, while Bergin said psychotherapy was more effective than no treatment

25
Q

Research by several investigators suggested that success in treatment is more likely with which type of client?

  • borderline
  • phobic
  • alcoholic
  • low self-esteem
A

low self-esteem

26
Q

A “placebo” is designed to serve:

  • as treatment
  • as a control
  • in lieu of a drug
  • as a non-effective change agent
A

as a control

27
Q

Which therapy has been known to be effective with depression?

  • Lowen’s bioenergy
  • Loveinger’s ego therapy
  • Stampfl’s Implosive therapy
  • Beck’s cognitive therapy
A

Beck’s cognitive therapy

28
Q

Anxiety problems appear to be best remediated with which type of therapy?

  • cognitive-behavioral
  • rational-emotive
  • existential
  • eclectic
A

rational-emotive

29
Q

In conducting therapy with a phobic problem, the best way to measure change would be to use:

  • subjective evaluation
  • physiological changes
  • self-report
  • behavior rating
A

behavior rating

30
Q

A control group is:

  • the dependent variable
  • the group who receives the “halo effect” but not the treatment
  • a group of individuals who are not exposed to the treatment
  • a double-blind group in which the researcher does not know who is in the control group
A

a group of individuals who are not exposed to the treatment

31
Q

The attempt to scale down therapy to a few workable variables studied in the laboratory is what type of research?

  • analog
  • comparative
  • experimental
  • historical
A

experimental

32
Q

When utilizing inferential statistics, the central tendency considered the most helpful is the:

  • mean
  • median
  • mode
  • standard deviation
A

mean

33
Q

If you calculated the score on a math test for 15 sophomores and they all had the same score, then you could determine that the variance would be:

  • the score itself
  • zero
  • one
  • need the actual math score to be able to determine the variance of a set of scores
A

zero

34
Q

If the appropriate variance for a set of test scores is the interquartile range, then the appropriate central tendency would be:

  • mean
  • median
  • mode
  • mean, median, mode
A

median

35
Q

When a two-tailed test of significance is being utilized one can safely say:

  • one is rejecting both ends of a sampling distribution
  • one is rejecting one end of a sampling distribution
  • one is rejecting the middle of a sampling distribution and accepting the two ends of the distribution
  • failure to reject the hypothesis because the two tails are not in the distribution free sampling
A

median

36
Q

A factor-analyzed statistical technique is especially useful for which of the validity measures?

  • content
  • construct
  • concurrent
  • predictive
A

construct

37
Q

An investigator is conducting a survey of classical reading and has listed 10 of the most-often-read classics. He administered the survey to 30 eighth grade students. How many degrees of freedom are there?

  • 9
  • 10
  • 30
  • 29
A

29

38
Q

The null hypothesis is not rejected when:

  • a Type I error was made
  • a Type II error was made
  • the difference between the sample mean and population mean is due to chance
  • the difference between the sample mean and the population mean is zero
A

the difference between the sample mean and population mean is due to chance

39
Q

A research comparison between dogsled drivers and wind variability was planned for the Greater Alaska Dogsled Race. The drivers were compared on height, weight, and body surface with three different wind speeds. This type of comparison is:

  • a posteriori
  • post hoc
  • a priori
  • multiple comparison
A

a priori

40
Q

A 2x2x3 factorial design is described as which one of the following?

  • 2 independent variables for Factors A and B and 3 independent variables for C
  • 2 independent variables for 3 levels of Factors A, B, and C
  • 3 independent variables with two levels for A and B and 3 levels for C
  • 3 dependent variables with 2 levels for Factors A and B and 3 levels for Factor C
A

3 independent variables with two levels for A and B and 3 levels for C

41
Q

If a correlation is reported at -.40 for snowfall and sunshine, then what percent of the variance in snowfall is associated with less sunshine?

  • 40
  • 60
  • 16
  • 84
A

40

42
Q

In order to utilize a two-way Analysis of Variance the following must be true:

  • the data must be discrete and ordinal
  • the data must be interval or ratio, and subjects must be randomly assigned to groups
  • the data must be both discrete and continuous, and the subjects need not meet randomization
  • the dependent variable must be discrete, and students must be randomly assigned
A

the data must be interval or ratio, and subjects must be randomly assigned to groups

43
Q

You are interested in establishing the relationship between dogs and cats. One of the variables under study is continuous data, and the other is dichotomous data. What correlation coefficient would be most appropriate?

  • Spearman Rank
  • Point Biserial
  • Phi Coefficient
  • Pearson Product
A

Point Biserial

44
Q

A school counselor is of the opinion that vitamin C is effective in improving reading comprehension one hour after taking the vitamin. She conducts the experiment and administers the standardized portion of the Albright Reading Comprehension Test on a pre-post basis. What is the dependent variable?

  • Vitamin C
  • Albright Reading Comprehension Test Scores
  • one hour
  • students in the experimental group
A

Albright Reading Comprehension Test Scores

45
Q

Two tests measuring the same variable have been correlated and yield a correlation of .80. The first test has a separate correlation of .70 and the second of .60. The coefficient of determination is:

  • .64
  • .49
  • .36
  • .20
A

.64

46
Q

A counseling researcher has designed a study wherein observers will be in classrooms to observe and “chart” students’ behaviors. The researcher is aware that this study necessarily will have to take into account a phenomenon known as the

  • Hawthorne effect
  • Placebo effect
  • Halo effect
  • Self-fulfilling prophecy
A

Hawthorne effect

47
Q

If it is necessary to use volunteers in a research study, the research should

  • explain how volunteers may differ from nonvolunteers on critical variables
  • use samples that have atleast ten times the number of subjects as variables
  • statistically control for the effects of subjects’ willingness to volunteer
  • keep the description of the study’s purpose as simple and brief as possible
A

explain how volunteers may differ from nonvolunteers on critical variables

48
Q

A researcher wants to survey school counselors about their attitudes toward the ethics of doing research on human sexuality counseling. He obtains the membership directory of the American School Counselors Association and selects every twentieth name for the sample. This is an example of

  • cluster sampling
  • systematic sampling
  • stratified sampling
  • stratified random sampling
A

systematic sampling

49
Q

If a researcher suspects that subjects are responding to items in ways that will make the subjects “look good”, the researcher is concerned about

  • test anxiety
  • experimenter bias
  • social desirability
  • volunteerism effects
A

social desirability

50
Q

Stratified sampling is sometimes better than random sampling, especially for

  • avoiding sampling biases in homogeneous groups
  • generalizing the results to a diverse population
  • examining small differences between subgroups
  • comparing the performance of well-differentiated subgroups
A

comparing the performance of well-differentiated subgroups

51
Q

At a minimum, there should be sufficient detail reported in a research article published in a journal to allow

  • replication of the procedures used
  • consumers to understand the results
  • evaluation of external and internal validity
  • judgments about statistical adequacy
A

evaluation of external and internal validity

52
Q

When a research study is strong with respect to internal validity, it can be concluded that

  • the measurement instruments had strong validity
  • most extraneous variables had been controlled
  • the results are readily generalizable to the population
  • professional practices will be modified by the result
A

the measurement instruments had strong validity