Exam 1 - Evaluation and Outcome Assessment Flashcards

1
Q

What is evaluation?

A

A systematic method for collecting, analyzing, and using data to examine the effectiveness and efficiency of programs to contribute to continuous program improvement.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

T/F: Health programs are population focused, while health services are on an individual level.

A

TRUE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is included in the Public Health Social Model?

A
  • Individual
  • Relationship
  • Community
  • Societal
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the term for biological and personal characteristics and behaviors for the social-ecological model?

A

INDIVIDUAL

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is included in the community part of the social-ecological model?

A

Organization and institutions including schools, workplaces, and neighborhoods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the purpose of evaluation?

A

To measure the effects of a program against goals set for it and thus contribute to subsequent decision making about the program

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What do public health programs aim to do?

A

Prevent or control disease, injury, disability, and death

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Name the five ways that public health programs operate, which has become more complex.

A

1) Socioeconomic
2) Demographic
3) Interpersonal
4) Inter-organizational
5) Fiscal/budgetary restrictions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does evaluation allow?

A
  • To monitor progress toward the program’s goals
  • To determine whether program components are producing the desired progress on outcomes
  • To permit comparisons among groups, particularly among populations with disproportionately high-risk factors and adverse health outcomes
  • To justify the need for further funding and support
  • To find opportunities for continuous quality improvement
  • To ensure that effective programs are maintained, and resources are not wasted on ineffective programs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What could be evaluated?

A
  • Direct service interventions
  • Community mobilization efforts
  • Research initiatives
  • Surveillance systems
  • Policy development activities
  • Outbreak investigators
  • Lab diagnostics
  • Communication campaigns
  • Infrastructure-building projects
  • Training and educational services
  • Administrative systems
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When do you not evaluate?

A
  • There are no questions about the program
  • The program has no clear direction
  • The stakeholders can’t agree on the program objectives
  • There is not enough money to conduct a sound evaluation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What tracks disease or risk behaviors?

A

Surveillance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What tracks changes in program outcomes over time?

A

Monitoring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What seeks to understand specifically why these changes occur?

A

Evaluation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Name the seven types of evaluation.

A

1) Community needs assessment
2) Process evaluation
3) Effect evaluation (Outcome evaluation)
4) Cost evaluations
5) Comprehensive evaluations
6) Meta-evaluation
7) Summative evaluations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does “My PECCCS” stand for?

A

My - Meta-evaluation

P - Process evaluation
E - Effect evaluation (Outcome evaluation)
C - Community needs assessment
C - Cost evaluations
C - Comprehensive evaluations 
S - Summative evaluations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What type of evaluation is performed to collect data about the health problems of a particular group?

A

Community needs (health) assessment

18
Q

Which type of evaluation focuses on the degree to which the program has been implemented as planned and on the quality of the program implementation?

A

Process evaluation

19
Q

The information obtained from a process evaluation is used to do what?

A

Plan, revise, and improve the program

20
Q

What is the Outcome evaluation also referred to as?

A

Effect or impact evaluation

21
Q

What key question does the Outcome evaluation seek to answer?

A

Did the program make a difference?

22
Q

Which evaluation type is done by researchers because it requires expertise in economics?

A

Cost evaluations

23
Q

T/F: Cost evaluations are performed late in the planning and evaluation cycle and are not likely to be available in time to make program improvements or revisions.

A

TRUE

24
Q

Which type of evaluation involves analyzing needs assessment data, process evaluation data, outcome evaluation data, cost evaluation data as a set of data?

A

Comprehensive evaluations

25
Q

T/F: Comprehensive evaluations are common.

A

FALSE

-Comprehensive evaluations are relatively uncommon due to the resources needed to integrate analysis of different data

26
Q

How are meta-evaluations done?

A

By combining the findings from previous outcome evaluations of various programs for the same health problems

27
Q

T/F: Meta-evaluations are most likely to be done by evaluation researchers.

A

TRUE

28
Q

When is the summative evaluation done?

A

At the conclusion of a program to provide a conclusive statement regarding program effects

29
Q

How many steps are there in the CDC’s Framework for Program Evaluation in Public Health?

A

6 steps

30
Q

Name the 6 steps of the CDC’s Framework for Program Evaluation in Public Health.

A

1) Engage stakeholders
2) Describe the program
3) Focus the evaluation design
4) Gather credible evidence
5) Justify conclusions
6) Ensure use and share lessons learned

31
Q

What are the purposes of the framework?

A
  • Summarize the essential elements of program evaluation
  • Provide a framework for conducting effective program evaluations
  • Clarify steps in program evaluation
  • Review standards for effective program evaluation
  • Address misconceptions regarding the purposes and methods of program evaluation
32
Q

Name the four standards of the CDC’s Framework for Program Evaluation in Public Health.

A

1) Utility
2) Feasibility
3) Propriety
4) Accuracy

33
Q

Who are stakeholders?

A

People or organizations invested in the program, interested in the results of the evaluation, and/or have a stake in what will be done with the results of the evaluation

34
Q

What is the term for the resources needed to implement the activities in step 2: describe the program?

A

INPUTS

35
Q

What is the term for what the program and staff do with those resources in step 2: describe the program?

A

ACTIVITIES

36
Q

What is the term for tangible products, capacities, or deliverables that result from the activities in step 2: describe the program?

A

OUTPUTS

37
Q

What is the term for changes that occur in other people or conditions because of the activities and outputs in step 2: describe the program?

A

OUTCOMES

38
Q

What is the term for the most distal/long-term outcomes in step 2: describe the program?

A

IMPACTS

39
Q

What is the term for contextual factors that are out of control of the program but may help or hinder achievement of the outcomes in step 2: describe the program?

A

MODERATORS

40
Q

What should gathering evidence include?

A

Consideration of indicators, sources of evidence (methods of data collection), quality, quantity, and logistics

41
Q

What are the 4 parts of the public health social ecological model?

A

1) Individual
2) Relationship
3) Community/Aggregate
4) Societal