Chapter 1 & Readings Flashcards
______________ is the use of social research procedures to systematically investigate the effectiveness of social intervention programs.
Program Evaluation
-use reserach to study, appraise, and improve social programs
_____________ is credited for being the founding father of evaluation.
Ralph Tyler
Evaluation is the process of determining____, ____, or _____of something or the product of that process.
Merit, worth, value
Scriven’s defininition of merit.
the intrinsic value of evaluands
Scrivens definition of worth.
the value to an instituation or collective.
more extrinsic
Scriven’s def.. of value judgement.
refers to the judgement as to the merit, worth, or value of something.
Scriven’s 4 steps in the logic of evaluation
- select the criteria of merit
- set standards of performance on those criteria
- Gather data pertaining to the evaluand’s performance on the criteria relative to the standards
- Integrate the results into a final value judgement
Forumating testable ____________ is at the heart of good program evaluation.
evaluation questions
___________ is the agreement b/w the evaluator and the evaluation sponsor about what will be done in the evaluation
Evaluation Plan
What makes a good evaluation question?
Specific, measurable, answerable, realistic and reasonable, appropriate to the local needs, can contribute to knowledge development
Absolute Standard or Comparative Standard
Comparative standard should have a fair comparison
Extreme Standards
rare, it would be “all” program participants, or “none”
RLF 5 major domains
Needs Assessment, Theory Assessment, Implementation assessment, impact assessment, and efficiency assessment
Where is the first source of evaluation questions?
Evaluation sponor and program stakeholders
Backward mapping
Identifying desirable endpoints or outcomes and then determinining what must be done to get there
What was the article, “An outcome evaluation of the sources of strength suicide prevention program and delivered by adolescent peer leaders in high schools.” about?
Wyman, Brown, LoMurray, Schmeelk-Cone, Petrova Yu, Walsh, Tu, and Wang wrote it.
- Examined the effectiveness of a progaram called Sources of Strength suicide prevention in high school students
- 18 high schools, 6 city and 12 rural, random assignment, immediate intervention or wait- list controls
- surveys used for baseline and 4 mo. later
- Training improved
- 1st suicide prevention program involving peer leaders to enhance protective factors associated with reducing suicide at the school population level
Merit and Worth are both context dependent
False
Evaluators do not have to worry about unique cultural factors limiting their ability to generalize from theories primarily developed in the US.
False
The authors of your textbook describe evaluation as a “transdiscipline.” What is the best definition of transdiscipline?
A. It serves as a tool for other disciplines, while at the same time it has uniqueness as a discipline
B. It is part of all disciplines, but is not a unique discipline
C. It is a tool that can be used in only two disciplines.
D. It is a unique discipline that is not part of any other disciplines
A It serves as a tool for other disciplines, while at the same time it has uniquenes as a discipline.
Evaluators typically take on more than one role throughout an evaluation.
True
Part of an evaluator’s job is to establish social relations with stakeholders.
True
In what role is an evaluator playing if he or she were making potential conflicts visible and/or providing space for discussions about the situation to occur? A. Judge B. Reporter C. Leader D. Negotiator
Leader
Which of the following is NOT an evaluand?
A. A program to reduce the number of teenagers who smoke tobacco
B. A project to determine how to improve the accessibility of courts for deaf and hard-of-hearing people
C. Apple iPods and there effect on pacemakers
D. all of the above are evaluands
E. none of the above are evaluands
D. all of the above are evaluands
According to Scriven, merit is roughly equivalent to _____, and worth is roughly equivalent to ______.
A. value-or-cost-effectiveness; quality
B. quality; value-or-cost-effectiveness
C. truth; quality
D. quality; truth
B. quality, value or cost effectiveness
Which type of evaluation is conducted during the development or delivery of a program or product?
A. Formative evaluation
B. Summative evaluation
Formative
Which of the following is NOT one of the five main attributes of the Program Evaluation Standards? A. Utility B. Propriety C. Competence D. Feasibility
C. Competence
