Evaluation

Question 1

According to ACAD 02-001, Accreditation of NP Training, what is the goal of the Evaluation Phase of the SAT process?

Answer 1

It ensures training continues to produce qualified employees who perform at acceptable standards and who contribute to the organization’s core business objectives.

Question 2

What are the six key steps of the Evaluation Phase of SAT as identified in ACAD 02-001, Accreditation of NP Training?

Answer 2

1. Analyze and trend feedback such as trainee evaluation results, instructor observations, management observations and student feedback.
2. Analyze job performance feedback.
3. Perform periodic training self-assessments.
4. Identify weaknesses, initiate corrective actions and track them to completion. Perform root cause if a finding per ACAD 02-002.
5. Periodically review corrective actions for effectiveness.
6. Determine if the desired performance improvement was achieved when evaluation results.

Question 3

When are post training evaluations required?

Answer 3

Three to nine months following completion of training, or as requested by training or plant management.

Question 4

Who selects training programs for post-training evaluation?

Answer 4

The training review group (TRG) or training advisory committee (TAC) selects initial and/or continuing training courses for evaluation. Post-training evaluations are required for all initial training programs unless approved and documented in TRG or TAC meeting minutes.

Question 5

How is a post-training program evaluation conducted?

Answer 5

1. Select job incumbents, previously qualified peers (for evaluations of initial training only), and their supervisors for participation.
2. Select method(s) to be used during the evaluation (e.g., personal interview, written surveys, observations).
3. For initial training that includes on-the-job training and task performance evaluation (OJT/TPE), focused observations of newly qualified workers should be scheduled. These observations should include a sampling of tasks for which training and evaluation was recently completed by the workers.
4. Conduct the evaluation.
5. Summarize the data using TQF-201-EV03, Post Training Evaluation Summary or the EN-LI-104 snapshot assessment format and forward to training management. The snapshot assessment format is recommended for those evaluations that include more than a questionnaire (e.g., focused observations, material reviews, etc.).

Question 6

How are self-assessments of training completed and documented?

Answer 6

1. Perform self-assessments per EN-LI-104, Self Assessment and Benchmark Process and EN-TQ-214, Accredited Training Program Assessment Process.
2. Develop and submit an accreditation self-evaluation report (ASER) for each accredited program in accordance with EN-FAP-TQ-005, Accreditation Renewal Process.

Question 7

What performance indicators are monitored for potential performance gaps where training may be needed?

Answer 7

1. Review the training performance indicators produced in accordance with EN-FAP-TQ-001, Entergy Nuclear Standard Training Performance Indicators.
2. Review plant operating, maintenance, and industrial safety experiences to identify areas in which new or improved training may be needed to solve operational problems.
3. Review plant inspection, evaluation, and accreditation reports for training implications.
4. Review plant modifications and procedure changes to identify the need for revising or developing additional training.
5. Review industry operating and maintenance experiences for training implications.
6. Review regulatory changes for their effects on training.