111 Testing Flashcards
State the purpose of a testing program
To ensure a quality testing process is implemented to effectively assess the trainee’s achievement of learning objectives.
What responsibilities does NETC hold for a testing program
Testing policy and guidance.
What responsibilities does NETC N7 hold for a testing program
Testing policy and guidance oversight and monitors compliance by Centers
What responsibilities does the Learning Center CO hold for a testing program
Serves as CCA
Manages Sites
Resolves difference
Incorporates TYCOM test banks, as appropriate.
What responsibilities does the Learning Center Director of Training hold for a testing program
Ensures testing programs are conducted
Oversees development of testing plans
What responsibilities does the CCMM hold for a testing program
Approves test design
Maintains master test item bank
What responsibilities does the Curriculum Developer hold for a testing program
Designs and develops testing plan, admin guides, and the tests.
What responsibilities does the Course Supervisor hold for a testing program
Ensures, monitors, and validates admin, security, and test item analysis.
What responsibilities do Participating Activities hold for a testing program
Provides comments, feedback, new test items and maintains test and test item analysis data.
State the primary course source data for creating test items
JDTA
OCCSTDS
CTTL/PPP Table
COI
Define a formal test
Test is graded and is used in the calculation of the trainee’s final grade.
Define an informal test
May or may not be graded - regardless, the grade will not be used in the calculation of the trainee’s final grade.
Define the three Skill Proficiency Levels
Level 1: Imitation
Level 2: Repetition
Level 3: Habit
Define the three Knowledge Proficiency Levels
Level 1: Knowledge/Comprehension
Level 2: Application/Analysis
Level 3: Synthesis/Evaluation
List the five categories for the performance and knowledge tests
Pre-test: For Validation of Material, Acceleration, Pre-requisite, Advanced Organizer
Progress: Test Blocks of Instruction
Comprehensive Test: Within Course or Final Exam
Oral Test: Normally by board, assesses trainees comprehension
Quiz: Short test to asses achievement of recently taught material
Discuss the process of piloting a test
It is a review process to assess test reliability and validity and make corrective adjustments before actually collecting data from the target population.
What are the two types of testing methods used in testing
Criterion-Referenced Test: Assesses whether required level of skill or knowledge is met
Norm-Referenced: Estimates individual skill or knowledge in relation to a group norm
Discuss test failure policies and associated grading criteria within your learning environment
Test (if failed), re-train, re-test.. If passed, the highest score the student can receive is an 80%.
Identify the ten sections of a testing plan
Course Data
Course roles and responsibilities
Course waivers
Test development
Test administration
Course tests and test types
Grading criteria
Remediation
Test and test item analysis
Documentation
State the purpose of test and test item analysis
To determine statistical validity, test and test item analysis techniques are required
What are the three types of analysis used in the test item analysis
Difficulty index, index of discrimination, and effectiveness of alternatives.
In a remediation program, discuss what primary and secondary goal is
A remediation program’s primary goal is to motivate and assist trainees in achieving the critical learning objectives of a course by providing additional instructional study time. A second goal of remediation is to remove barriers to learning.
What are three methods of remediation available to instructors
Targeted
Scalable
Iterative
What are the five sections of a remediation program
Re-test
Set-back
Drop from training and attrites
Counseling
Academic Review Board