111 Flashcards
Purpose of a testing program
To assess the trainee’s ability to perform and/or comprehend the objectives
Testing Program consist of
NAVEDTRA 132 - A testing plan, test administrator guides, and a remediation program.
Proficiency levels with regards to knowledge
Level 1: Knowledge / Comprehension - recalls and understands the information
Level 2: Application / Analysis - can use a concept and separate materials into component parts.
Level 3: Synthesis / Evaluation - able to build a structure/makes judgment about the value of ideas or materials
Proficiency levels with regards to skills
Level 1: Imitation - Instructor shares essential information
Level 2: Repetition - repeatedly practices the task with the instructor
Level 3: Habit - Performance of the skill becomes second nature
Why is piloting a test important?
It is a review process to assess test reliability and validity and make corrective adjustments before actually collecting data from the target population.
What happens if a student fails a test?
Re-test. If passed, the highest score the student can receive is the minimum passing grade. If not additional remediation is required.
State the purpose of test item analysis.
Analysis will provide continuous feedback on test performance
The three types of analysis discussed and required for use are:
Difficulty index
Index of Discrimination
Effectiveness of Alternatives
What is criticality index? How does it pertain to testing?
Determines the learning objective criticality.
Upper = Tested by progress;
Middle = Tested by job sheets;
Lower = Tested by informal quiz or assigning problem sheets
Criticality of Performance
-High (3) : Skill used during job performance
-Moderate (2) : Skill influences job performance
-Low (1) ; Skill has little influence on job performance
Frequency of Performance
-High (3) : Performed frequently
-Moderate (2) : Performed infrequently
-Low (1) ; Performed rarely
Discuss the different Types of knowledge/performance test items
Multiple-choice
True or false
Matching
Fill in the blank
Labeling or Identification (Matching)
Essay
Case Studies
Discuss the different sections of a testing plan
Section One: Course Data - LOP, CMS, FCR
Section Two: Course Roles & Responsibilities - CCMM & CS Designation Letter
Section Three: Course Waivers - Authorized Waivers
Section Four: Test Development - Source data used
Section Five: Test Administration - Testing Procedures
Section Six: Course Tests and Test Types
Sections Seven: Grading Criteria
Section Eight: Remediation
Section Nine: Test and Test Item analysis
Section Ten: Documentation