CHAPTER 12 prt. 2

Question 1

is a systematic, formal, and scientific collection, organization, and interpretation of data to determine the worth ofany educational phenomenon.

Answer 1

educational evaluation

Question 2

three basic requirements of ensuring quality evaluation instruments are

Answer 2

validity, reliability, and practicality

Question 3

refers to the degree to which correct inferences can be made based on the information obtained from the given data.

This reflects the trueness and
accuracy of the evaluation data gathered.

Answer 3

Validity

Question 4

Validity of any data can be established through four basic means, namely:

Answer 4

construct
content
concurrent and
predictive validity.

Question 5

validity is the broadest type because it deals with the degree to which a certain instrument describes the theoretically accepted traits or characteristics of a certain concept under study.

Answer 5

Construct

Question 6

________ validity, on the other hand, refers to the degree by which the instrument contains an adequate number of items to represent each of the constructs being studied.

Answer 6

Content

Question 7

________ validity should also reflect the relative weights of each construct being measured. For example, if clinical competence can be broken down into five constructs and if these are considered to be equally important, then to establish the content validity of an evaluation tool, the items in this tool should equally represent the said constructs.

Answer 7

Content validity

Question 8

The _________ validity of an instrument is established by collecting data ot seeif the results obtained with the instrument agree with the results from other instruments administered at
approximately the same time to measure the same thing (Henerson, Morris, and Fitz-Gibbon
1978).

This si determined by computing the correlation coefficient, r, between data obtained from at least two different instruments.

Answer 8

concurrent

Question 9

The _________ validity of an instrument is established by demonstrating that the results from the instrument can be used to predict some future behavior (Henerson, Morris, and Fitz-Gibbon 1978).

Answer 9

predictive

Question 10

the data collection tool is able to generate consistent performance among the respondents being evaluated.

Answer 10

Reliable

Question 11

a _______ evaluation tool yieldsconsistent scores for each respondent from one administration of an instrument to another and from one set of items to another (Frankel
and Wallen 1993).

Answer 11

reliable

Question 12

Reliability could be established using several ways.

Answer 12

test-retest method

equivalentforms method

inter rater reliability test

practicality

Question 13

two different but equivalent (also called alternate or parallel) forms of an instrument areadministered to the same group ofrespondents during the same time period.

The two parallel instruments should be ideally based on the sameblueprint.

Again, the r test can be run to establish the reliability of the two instruments.

Answer 13

equivalent forms method

Question 14

The ______________ test, on the other hand, establishes consistency based on different raters who examined a particular examinee or respondent. For example, four consultants in a summative oral examination could examine aresident physician.

The scores given by the four raters can be tested for reliability and the higher the r obtained, the more consistent the raters’ ratings are.

Answer 14

inter rater reliability test

Question 15

This requisite means the test should be efficient, economical, and easy to score and interpret. It is a common mistake
among evaluators to construct an unusually long questionnaire such that respondents lose interest in completing the said tool. Such a long tool will not be practical in terms of resources that will be required; it will also be quite tiresome for respondents and raters.

Answer 15

Practicality

Question 16

1. The diplomates’ examination in obstetrics-gynecology consists of twelve areas in the said field. The written examination is composed of 200 multiple-choice questions. If al the twelve areas are equally important, how many items should each of them have in the said examination? What type of validity is ensured in this case?

Question 17

2. Granting that one of theexaminers, aleading personality ni gynecologic oncology insists that her part be more than the items in question #1, what requisite is violated?

Question 18

3. If a given academic program’s success is asserted by heavily biased clients during interviews and other participants in the survey questionnaire, what requisite/s is/are ensured/violated?

Question 19

refers to the capsule presentation of the entire evaluation report.

Answer 19

executive summary

Question 20

This si usually from three to fifteen pages long and should give readers an overview of the salient points of the evaluation study, from the background up to the recommendations.

Answer 20

executive summary

Question 21

To facilitate the understanding of the final report, and in cognizance of the extremely full schedules of most sponsors and stakeholders that may not have all the time to read a lengthy report, another one- page executive abstract can be presented prior to this executive summary.

Answer 21

executive summary

Question 22

The _______ is usually not more than 300 words, including the names of evaluators, title of the study, and auspices where the evaluation project was conducted.

Answer 22

abstract

Question 23

__________ part should contain a rationale on the evaluability of the program and a discussion on the purposes, audiences, scope, and limitations of the evaluation study.

Answer 23

introductory

Question 24

In this section, the evaluators have to discuss if the project is for a formative or summative purpose, and whether an internal or external evaluator shall conduct it. ‘

Answer 24

Introduction

Question 25

Can the results of the evaluation influence decisions about the program? The first question refers to the ________ criterion of evaluation. This implies chat the evaluation is designed to answer specific questions raised by those in charge of

Answer 25

utilization

Question 26

Can the evaluation be done in time to be useful? _______, as the second criterion, deals with when and how long the evaluation would be done to affect the next decisions about the program.

Answer 26

Timeliness

Question 27

Is the program significantenough to merit evaluation? The last criterion deals with ________, referring to the relevance and necessity of the program, especially fi it requires a considerable amount of resources.

Answer 27

significance

Question 28

Parts two and three of the basic steps in conducting an evaluation study can be simplified by making an ____________. Atypical _______ enumerates the different evaluative questions in the study, a corresponding discussion of data required, who can be the appropriate sources of such information, what instruments match the objectives and can generate the data needed, and how such data would be analyzed and interpreted.

Answer 28

evaluation matrix

Question 29

Al chapters contain sets of objectives that you, as readers, should be able to reach after you have finished reading them. The underlying principle in this format si to guide you on what you can accomplish and later on, appraise yourself accordingly on how far you have reached the targets.

Answer 29

Objectives-oriented evaluation model

Question 30

The model makes use of learning objectives as the standards ni determining the success or failure of any educational phenomenon, program, or experience. The pioneer evaluators also asserted that such objectives have to be formulated in strictly behavioral terms for easier evaluation

Answer 30

Objectives-oriented evaluation model

Question 31

Educators and funding institutions alike both appreciate the____________________ model m because the standards in determining the worth of a program are already clearly built-in in the program. However, critics also wrote that this model lacks the essential elements ofa real evaluation since it is generally focused only on the attainment of its objectives on student achievement.

Answer 31

objectives-oriented evaluation model

Question 32

________________________model is especially designed for administrators, hence, the title. This model rests on the rationale that evaluative information si an essential part of good decision making, and that the evaluator can best serve education by serving administrators, policy makers, school boards, teachers, and others in the school system (Worthen and Sanders 1987).

Answer 32

management-oriented evaluation

Question 33

In this particular framework ( Management-oriented evaluation model ), only the most popular and comprehensive model is discussed in detail:

Answer 33

the context, input, process, and product (CIPP, pronounced as "sip")

Question 34

Planning decisions: To identify the institutional context, the target population, and the opportunities for addressing needs, diagnose problems underlying the needs, and to judge whether the proposed objectives are sufficient for those needs

Answer 34

Context

Question 35

Structuring decisions: To identify and assess system capabilities, alternative program strategies, procedural designs for implementing strategies, budgets, and schedules

Answer 35

Input

Question 36

Implementing decisions: To identify or predict, inprocess, defects in the procedural design or its implementation, provide information for the preprogrammed decisions, and record and judge procedural events and activities

Answer 36

Process

Question 37

Recycling decisions: To collect descriptions and judgments of outcomes, relate them to obicctives, and determine the program's worth andmerit

Answer 37

Product