Lessons 5-7 (Quiz 2) Flashcards
What is formative evaluation?
Collecting data in pilot situations while developing an intervention
What is the main purpose of formative evaluations?
Obtain feedback
What is formative evaluation concerned with?
Concerned with feasibility
- Are proposed activities appropriate?
- Do they FIT with setting & recipients?
Are there specific methodology or procedures?
NO
What are the 3 Fs of formative evaluation?
Feasibility
Fit
Fine Tuning
Is “internal” agency business reported to stakeholders?
NO
What are the 3 approaches to conduct formative evaluations?
Approach 1: Locate model standards
- Look @ what has already been successful
Approach 2: Get expert consultation
- Who knows what has been successful?
- Pay them to find out what they think
Approach 3: Form an evaluation committee
- Interview staff & visit similar programs
What are process evaluations primarily concerned with?
Delivery of services and dosage.
What is dosage?
Requirement of time.
Formative evaluation vs. Process evaluation?
Formative evaluation - used to FORM program in early stages - program development Process evaluation - Occurs once the program has been established - Concerned with program fidelity
What is program fidelity?
Program loyalty (how faithfully a program is carried out) - means not only doing it, but doing it well
Why should programs be concerned with fidelity?
High fidelity = greater chance of significant behavioral change
- programs with highest fidelity = great outcomes
Why should evaluators be concerned with fidelity?
lack of fidelity could lead an evaluator to mistake the effectiveness or non-effectiveness of a program
What are the main goals of process evaluation?
Program monitoring and quality assurance.
What can process evaluation identify?
variations in program delivery called “program drift”
Without process evaluation what may occur?
Type 3 error
What is a type 1 error?
Incorrectly inferring program effectiveness
- REJECTING a null hypothesis that is truly accurate
What is a null hypothesis?
null hypothesis = no difference in effectiveness or significant change
What is a type 2 error?
Failing to reject the null hypothesis
What is type 3 error?
related to fidelity (cannot give outcome because plan was not followed)
What is the evaluation big picture?
- Need assessment
- Formative evaluation
- Process evaluation
- Outcome evaluation
What does process evaluation provide feedback on?
On the quality of ongoing intervention delivery
What can process evaluation determine?
Determine if failure = poor program or poor implementation
How can you tell if the right program elements were delivered to the right people?
Collect data on program components
Data from pilot situations, feasibility, and fit are elements of which type of evaluation?
Formative evaluation
What is a natural complement to outcome evaluation?
Process evaluation
Delivery of services and dosage are focuses of which type of evaluation?
Process evaluation
What does process evaluation help prevent?.
Type 3 error
What are concepts?
The primary building blocks of a theory
What are the key concepts of a theory known as?
Known as the theory’s constructs
What is the ecological perspective?
It is a multilevel, interactive approach to examining the influences on health-related behaviors & conditions.
What does the ecological perspective recognize?
It recognizes that health-related behaviors and conditions are part of a larger system and can be approached from multiple levels.
What are the 5 levels of influence in the ecological model?
- Only 3 are used for the purposes of program planning
- Intrapersonal factors
- Interpersonal factors
- Institutional factors
- Community factors
- Public policy factors
What is the stimulus response theory?
A theory used to explain or modify behavior
What does the SR theory reflect?
The combination of classical conditioning and instrumental learning.
What do SR theorists believe?
They believe that learning results from reinforcements.
What are the 2 broad categories of environmental consequences?
reinforcement or punishment
positive and negative reinforcement
What was the theory of reasoned action developed for?
Developed to explain not just health behavior but all volitional behaviors (behaviors that can be performed at will)
- provides framework to study attitudes for behaviors
In the Theory of reasoned action what do the theorists distinguish among?
- Attitude
- degree to which performance of behavior is positively or negatively valued - Belief
- Intention
- person’s readiness to perform given behavior - Behavior
When do complications arise in the theory of reasoned action?
Complications are encountered when the theory is applied to behaviors that are not fully under volitional control
What is the theory of planned behavior and what problem does it address?
The theory of planned behavior is an extension of the theory of reasoned action that addresses the problem of incomplete volitional control
What is the theory of freeing aimed at?
Aimed at empowering education
What are the 3 stages of the theory of freeing?
- Listening stage
- the priority population is identifying issues and needs, not the planners - Dialogue process
- revolves around “code” - Action stage
What is the most frequently used theory in health education?
The health belief model
What does the HBM depend on?
Depends on simultaneous occurrence of 3 classes of factors:
- Existence of motivation
- Belief that one is susceptible to health problem aka perceived threat
- Belief that they will benefit
What does the transtheoretical model use?
It uses stages of change
What are the stages of change?
- Precontemplation
- Contemplation
- Preparation
- Action
- Maintenance
What are the two distinct phases of the health action process approach theory?
The HAPA is divided into 2 distinct phases- motivation to change and self-regulatory processes- and five stages: intention, planning, initiative, maintenance, and recovery.
How can a communities readiness be assessed?
Through key informants
What is a theory?
A systematic way of understanding events or situations
- A set of concepts that EXPLAINS or PREDICTS events
What do theories have?
Boundaries (think of an empty coffee cup- has shape but nothing inside)
What does theory provide a general explanation for?
Of why people act or do not act to maintain and/or promote their health
What do theories all researchers to investigate?
WHY
- why are people doing what they do/not doing?
WHO
- who is most suitable target for change?
WHAT
- what is our target?
HOW
- how going to do it an effective manner?
What does appropriate choice of theory depend on?
- nature of problem
- Setting
- Target audience
- Program goals
What are components of theories?
Concepts - building blocks Constructs - concepts unique to a particular theory Variables - operational forms of contracts Models -draw on a number of theories
What does the ecological perspective emphasize?
Interaction and interdependence of factors within and across ALL LEVELS of a health problem
What is a logic model?
Schematic way to portray relationships b/w goals and objectives
What does a logic model represent?
Represents a series of “if-then” relationships
- IF program activities are implemented successfully, THEN certain outcomes can be expected
What does a logic model a link b/w?
Program activities, objectives, outcomes, resources, and external influences
What does a logic model identify?
Identifies aspects of a program that should be monitored
What is the best measure of a programs success?
The answer to this question should be provided by stakeholders
How do we judge a program?
By standards
What can standards be set by?
Needs assessment (state and national data)
Input from experts in the field
Published and unpublished literature
Comparison with other programs
What are the elements of a measurable objective?
WHAT - outcome to be achieved WHEN - time point at which the change takes place WHO - target population HOW MUCH - how much change will occur?
