Competency 4 - Evaluate Instructor Effectiveness Flashcards
Evaluate the impact of the instructional setting and equipment.
Assess classroom environment, ex. classroom lighting, temperature and hazards
Ensure all training equipment is operational
Have contingency plans just in case
Evaluate instructor’s performance
14 competencies, 70 performance statements
3 main areas - (3) Preparation, (8) Delivery, (3) Assessment
Scale is from 1-5 and a performance grade of 1-2 fails the whole instruction
Evaluate the KSB of instructor, not course content
Feedback - List the deltas, making 2 or 3 key points
Feed back should be timely, specific & relevant, need to pinpoint how the instructor should improve
Explain the purpose of the Level 1 evaluation.
Level 1 - Reaction
Advantages: Measures trainee’s personal opinions on course. Most common way to evaluate student’s reaction to course and provides a measure on trainee satisfaction with content, delivery and environmental factors.
Recruits: Receive a level 1 in week 8.
Disadvantage: Results should not be used as solid basis for changing the educational content.
Evaluate the purpose of a Level 2 evaluation.
Learning
Advantage: Test of knowledge and skills after the course, which is tied to objectives. Provides compelling evidence on whether the training program works.
Recruits: Take a test after each class.
Disadvantage: Requires more money and time than level 1 and great insight to the evaluation process to develop valid measures of learning.
Evaluate the purpose of a Level 3 evaluation.
Behavior
Advantages: Provides stronger evidence that the investment in training was worth it. Assess the practical value on how well the knowledge, skills and attitudes from the course are used on the job.
Recruits: Non-rates and supervisors take this, 6 months after they’ve graduated.
Disadvantages: Requires significantly more investment of time and money. Requires in-depth insight into performance interventions and root causes of performance deficiencies.
Explain the purpose of a level 4 evaluation.
Results
How well training intervention affects the entire organization.
Advantages: Strong evidence that the training program has an impact on the entire organizaiton.
Linkage from training to organization results is hard to establish.
Coast Guard has not done a level 4, too time consuming and costly.
To evaluate a course, you need answers to the following questions…
What do you reference?
Are the TPOs evaluated?
Is there a difference between what is written on the course curriculum outline and what the instructor is teaching?
Did analysis or qualifications lead to the course?
Is there a clear connection to the specific training - the workplace and does the workplace need it?
Vol. 13 Professional Development SOP App B
What is Vol. 1 of the SOP?
Introduction
What is Vol. 2 of the SOP?
Analysis
What is Vol. 3 of the SOP?
Evaluations
What is Vol. 4 of the SOP?
Job Aids
What is Vol. 5 of the SOP?
Resident Instruction
What is Vol. 6 of the SOP?
Curriculum Outline
What is Vol. 7 of the SOP?
Advanced Distributed Learning
What is Vol. 8 of the SOP?
Non-Instructional Interventions