Chapter 4 Flashcards
When did pragmatic paradigm begin, why and with who?
William James, John Dewey, George Herbert Mead and Arthur F. Bentley; 19th century; believed that truth could be discovered through the use of scientific methods
Which philosophers have distinquished themselves as neopragmists?
Kaplan, Rorty, and West; emphasis on common sense and practical thinking
What is the axiological assumption of Pragmatic?
Gain knowledge in the pursuit of desired ends, as influenced by the evaluators values and politics
Pragmatists see the value of an evaluation in terms of____and the____________.
how it is used; the results of that use
Ontological assumption of Pragmatic?
There is a single reality, and all individuals have their own unique interpretation of reality.
the value of evaluaions is not based on whether they discover the truth but on the demonstration that the results work with respect to the problem that is being studied.
What is epistemological assumption of PRagmatic?
Relationships in evaluation are determined by what the evaluator deems as appropriate to that particular study.
They are free to study what interests you and utilize the results in a way that can bring about positive consequence within your value system.
Methodological assumption of pragmatic?
Match methods to specific questions and purposes of research; mixed methods can be sued as evaluators work back and forth b/w various approaches
Daniel Stufflebeam
Began his career in the 60s by dev’t of objectives for educational programs, measurement of outcomes to see if measurement were acheived. He developed CIPP model.
What does the CIPP stand for in the CIPP model?
Context, input, process, and product;
Evaluators should have a more expansive role which starts with critical eval. of the program’s objec., what is needed to make the program work, the extent to which the program is being implemented as planned, and what the outcomes are.
Who were some Use Branch theorists?
Stufflebeam, Weiss, Wholey, Chelimsky, Patton, Preskill, Fetterman, Wandersman, King, Cousins, and Alkin
Stufflebeam also suggested that the evaluators focus should be on a process of ____________.
creating information to support managerial decisions
Carol Weiss worked in a ____________ perspective.
Social sceince; she explored the connection b/w evaluation and policy making; she saw program theory as the evaluator’s responsibility
Weiss recognized that evaluations are sometimes used for _______ reasons.
political, persuasion, or symbolic reasons
_____________ worked in public policy making and the culture of results-oriented managment practices in public an non-profit orgnaaizations. He suggested that the role of evaluators is to faciliate dev’t of agreed upon goals and strategies, measure intended outcomes, and encourage use of findings.
Joseph Wholey
Eleanor Chelimsky
1st director of evaluation at the U.S. General Accounting Office; shared wisdom and experience on the use of evaluation to influence policy
What 2 steps did Patton take to aid stakeholders in his evaluation study to understand and find evaluations useful?
- training programs to educ. consumers about what evaluation is and how it can benefit organizations.
- research on what influeces the degree of use of eval. findings as well as strategies to enhance that use.
What is an evaluation approach developed by Patton in which evaluation is carried out for and with intended primary users to collect info. related to specific intended users.
Utilization-focused evaluation
* Its unique in that he believed in collaborating throughout the process not just in the summative evaluation.
Developmental evaluation
Patton; organizations need to be continually adapting to changes in the enrvironment, continuous info. to support informed decisions
What did Hallie Preskill do?
her research revealed that instrumental use was more common at the local program level and that conceptual use was more common at the policy level
Who proposed empowerment evaluation? What does it entail?
Fetterman & Wandersman; program participants who conduct their own evaluations will be more likely to use the info. forthcoming from that eval.
What is the diff. b/w practical participatory evaluation and transformative participatory evaluation?
Prac. Part. Eval.-focus is on decision makers as users
Transformative-focus is on engaging all stakeholders, especially those who have traditionally been excluded from evaluations and from those decisions
Utilization-Focused Evaluation begins with the premise that evaluations should be ______ by their_______and_____.
judged; utility; actual use.
The focus is on intended use by users. Micahel Patton
How does Schriven define Models?
a conception or approach or sometimes even a method of doing evaluation. Models are paradigms as hypotheses are to theories; which meals less general but with some overlap.
Melvin Mark and Gary Henry believe that the goal of evaluation should be____________.
Social betterment
Context in the CIPP model evaluates______.
Needs, problems, assets and opportunities; defines goals and desired outcomes.
Input in the CIPP model evaluates_________.
Alternative approaches, participant characteristics, budgest, staffing plans: determines feasability and potential cost-effectiveness, assign staff , & schedule work
Process in the CIPP model evaluates________.
Implementation of plans; help staff make revisions in activities; judge performance and interpret outcomes.
Product in the CIPP model evaluates_______.
Identification & assessment of intended and unintended outcomes, both short & long-term; help staff keep focued on acheiving desired outcomes, gauge success of the program in addressing needs
Context evaluation is a type of _______ that can identify the ___, __, and ____ of a community in order to plan programs suitable for the community.
needs assessment; needs, assets, and resources as well (as problems in a defined environment)
Other than needs, assets, and resources, what else can context evaluation identify?
political climate that could influence the potential success of a program
Input Evaluation is a process of collecting information about the project’s ______, _______, _____, ______, ____, _______, _____, _____, _______, and ______.
mission, goals, plan, constituents, staff, timetable, resources, progress to date, accomplishments, and recognitions
Input evaluation assesses competing _________ and the _______ and __________of the selected approach.
strategies; work plans; budgets
Sidani and Sechrest identify input variables associated with clients, staff and setting. Client characteristics can be classified into 3 categories: ______
Characteristics of the program/staff include_______
Characteristics of the setting include_________
- Personal, presenting problem charactiers, resources avialble to clients which consist of internal & external factors
- personal and professional attributes or qualities of the persons deleivering the program services
- physical & psychosocial features of the environment
Process evaluation _______, _______, and _______program activities.
monitors, documents, assesses
Product or impact evaluation assesses a _________ or _______to the target audience.
a program’s effect on; reach
One disadvantage of the Use Branch or Pragmatic Branch is that the _______________ for whom information is provided are the most powerful.
Stakeholders
Utilization Focused Evaluation’s mission is to be sure that _____ and ________ are matched to the needs of the intended users.
Methods or models
UFE can be used for ____________ and _______ evaluations in conjunction with program developers; with quantitative, _______ or ______; for the purpose of cost analysis and CIPP evaluations; and for _________.
formative, summative; quality or mixed methods; needs assessments
________ _________ suggests that the pgoram staff is in charge of the direction and execution of the evaluation while the evaluator serves as a facilitator, coach, advisor, or guide.
Empowerment Evaluation
Fetterman and Wandersman (2007)
____________ _________ ___________ rests on the assumption that stakeholders who are in positions to make decisions about programs need to be involved in the evaluation process in meanigful ways.
Practical participatory evaluation
PRactical Participatory Evaluation and Empowerment Evauation are simliar, true or false
True
Brandon and Singh critiqued evaluation studies that focused on use and recommended that more attention be given to rigor in methods. True or False
True
According to evaluators Preskill and Torres, what are the three inquiry phases in the learning organization evaluation model?
Focusing the inquiry; carrying out the inquiry; and applying learning
A key criticism of the Empowerment Evaluation model is that program participants do not have the skills to conduct the evaluation. T or F
True
Context evaluation is designed to provide the “big picture” into which a program and its evaluation fit. T or F
True
Pragmatists such as Tashakkori and Teddlie believe that you (the researcher) are free to study what interests you and is of value to you, it’s okay to study it in different ways that you deem important, and results can and should be used in ways that bring about positive consequences in your value system. T or F
True
Abe Wandersman, Fetterman
proposed a model of evaluation known as empowerment evaluation
practical participatory evaluation
Brad Cousins
