Student Study Guide Questions Flashcards
1.) True or False:
The appropriate choice of theory depends on the nature of the problem, the setting, the target audience, and program goals.
Answer: True
Which is _not true _regarding the assessment of validity and reliability?
a. Reliability and validity should be measured each time an instrument is used.
b. Reliability and validity do not refer to the instrument, but the results produced.
c. It is appropriate to use past experiences or data when measuring validity and reliability.
d. It is important to know the instrument’s ability to elicit valid and reliable responses.
Answer: C
Which design characteristics would NOT improve causality?
a. Using a comparison or control group similar to the experimental group
b. Keeping sample sizes small to avoid participant neglect
c. Measuring outcome variables before and after an intervention
d. Minimizing threats to internal and external validity
Answer: B
Reliability and validity are both important factors when it comes to the measurement of the evaluation process of a program. Briefly explain the difference between the two and which one is better than the other.
The core essence of validity is accuracy and the core essence of reliability is consistency. Validity consists of four different types: face, content, criterion, and construct. Face and content validity are subjective and is used because they are easy, cheap, and fast. Criterion and construct are objective and focus on comparison or theory-based relationship. Reliability consists of internal consistency which looks to see if each individual item in the scale correlates well overall, and test-retest which uses the same group of people and the same test but gives the test at two different times. Validity is more important because if an instrument does not accurately measure what it says it will, then its reliability is irrelevant. It would be like supplying the wrong or inaccurate answer every time on a test. You would be consistent but not at all accurate.
What is the difference between formative and process evaluation? What are there main purposes and what are they primarily concerned with?
The main purpose of formative evaluation is to obtain feedback. Formative evaluation is concerned with determining if the proposed activities of a program are appropriate or ‘fit’ for the intended settings and audiences, also known as feasibility. Formative evaluation is used to ‘fine-tune’ the program during program development.
Process evaluation occurs once the program has already been established and uses empirical data to assess the delivery of services. It verifies what the program is, if it was delivered to the right audience, and determines if this audience received the correct dosage. In other words, how accurately and faithfully the program is carried out, also known as fidelity.
What is the purpose of program evaluation?
A. To determine worth or merit
B. To change behavior
C. To meet its objectives
D. B and C
E. A and B
Answer: E
Extent to which an instrument samples items from the universe of content desired is called
a) face validity
b) content validity
c) construct validity
d) criterion validity
answer: b
True/False:
The program planning process is driven by the program’s goals and objectives.
False-The planning process is driven by the needs assessment
What are the five-factors common to all planning models?
- Needs assessment
- setting goals & objectives
- planning or development
- Implementation
- Evaluation
Explain what treatment fidelity is and why it is important in program evaluation.
Treatment fidelity is the measure of how accurately and faithful a program is carried out or reproduced from a manual, protocol, or model. When fidelity is high, there is a greater chance of statistically significant behavior change. This subsequently produced greater outcomes. During the evaluation process, if there is a lack of fidelity present, it could lead the evaluator to mistake the effectiveness (or non-effectiveness) of a program
Which theory component fits the following description: concepts developed for use in a particular theory
A. Concepts
B. Variables
C. Models
D. Constructs
Answer: D. Constructs
Qualitative researchers are interested in meaning and primarily concerned with process.
True or False?
TRUE
What are the different types of needs assessments?
- Normative Need
- Perceived Need
- Relative Need
- Express Need
Which of the following is concerned with feasibility?
A. Process evaluation
B. Formative evaluation
C. Validity
D. Reliability
Correct answer: B
Which of the following is NOT a subjective opinion when it comes to validity?
A. content validity
B. face validity
C. criterion validity
D. all of the above are true
Answer: C
Criterion validity is objective.
