Evaluation Flashcards
What is evaluation?
Systematic process that judges worth or value of something
What is practice based evidence vs evidence based practice?
PBE- identifies the problem (while practicing you find a problem)
EBP- identifies a way to address the problem (addressing the problem using evidence to back up your actions)
What is implementation science?
How, when, with, who, and what way will evidence based practice be successful
Differences between evaluation vs assessment?
E- gather/summarize/interpret/use data to determine if the action was successful (data output)
A- gather/summarize/interpret/use data to direct action (data input)
5 types of evaluation?
Formative Evaluation → evaluates the process
Content Evaluation → evaluates if learners are acquiring skills and knowledge as it is being taught
Summative Evaluation → evaluates the outcome
Impact Evaluation → evaluates the greater effects on the institution or community
Total Program Evaluation → evaluates if all activities met the originally established goals.
6 steps of evaluation?
- Determine the focus
- Design the evaluation
- Conduct the evaluation
- Analyze/interpret data
- Summarize and report results
- Use results
What to consider when determining the focus of evaluation?
Your audience, purpose, questions, scope, and resources you have
What is evaluation research?
This is different from evaluation because there is no primary audience and evaluation models are used in research
Evaluation method components? 4 of them
- Types of data to collect
- How, when, where to collect data
- Who collects the data
- What data and from whom
Design structure of evaluation should be what? what should you consider?
Precise, exact, and logically organized. Consider number of groups to be included, number of evaluations/periods of evaluation, time between education/evaluation, and data collection
Evaluation instruments should be?
Literatures reviewed and practical/affordable.
Examples of evaluation instruments?
Cognitive tests, multiple questionnaires, scale, and checklists
Barriers to evaluation? 4 of them
Lack of clarity, lack of ability, fear of punishment, and loss of self esteem
When conducting the evaluation, what should the person do/understand in regards to barriers?
Understand barriers are inevitable, identify/understand barriers, and conduct the evaluation in a way to minimize barriers
When conducting the evaluation, what should you include?
Conduct a pilot test (mini version of the evaluation to identify problems), consider time, and involve humour
What does analyzing data help us to do?
Organize data into useful information and it answers evaluation questions
Reporting guidelines?
Focus on the audience, stick to the purpose, and use data as intended
Is summarizing and reporting results often not done?
Yes
T or F: analysis should be consistent with type of data collected
True
When a nurse evaluates their teaching and makes adjustments concurrently with teaching, this is an example of what type of evaluation?
Formative evaluation (process)
RSA model of evaluation components from least to most frequency of parts evaluated?
Impact (least), outcome (summative), content, process (most)
