111 Testing Flashcards
What is the purpose of the testing program?
To ensure a quality testing process is implemented to effectively assess the trainee’s achievement of learning objectives.
What are the primary source materials for test items? JPOCC
JDTA, OCCSTDS, CTTL/PPP Table, COI.
What are the secondary source materials for test items if JDTA data is not available? (OCPC)
A combination of Occupational Standards (OCCSTDs), CTTL, PPP Table, and COI.
Define Formal Test.
A formal test is graded and is used in the calculation of the trainee’s final grade.
Define Informal Test.
An informal test may or may not be graded, and regardless of the grade, it will not be used in the calculation of the trainee’s final grade.
What are the proficiency levels of Skill (IRH)?
Level 1: Imitation
Level 2: Repetition
Level 3: Habit.
What are the proficiency levels of Knowledge (KAS)?
Level 1: Knowledge/Comprehension
Level 2: Application/Analysis
Level 3: Synthesis/Evaluation.
What are the 5 categories of tests?
Pre-test, Progress Test, Comprehensive Test, Oral Test, Quiz.
What is the process of piloting a test?
Review by SMEs, piloting by CCMM, forwarded to LSO for approval, testing trainees in the end stages (results not to count), surveying test results, and using test item analysis to improve the test.
What are the test instruments (JPA MT MC LE CV)?
Job Sheet, Problem Sheet, Assignment Sheet, Multiple-choice, T/f, matching, completion, labeling, essay, case study, validation of test instruments
What are the two types of testing methods?
Criterion-Referenced Test (estimates if lok is met) and Norm-Referenced Test. (estimates individuals skill in relation to group)
What is the test failure policy?
If failed, the trainee will re-train and re-test. If passed, the highest score possible is 80%.
What are the sections of the Testing Plan? (COURSE DRWT, TEST A/D/TIA, GC, R,D
Course Data, Course Roles and Responsibilities, Course Waivers, Test Development, Test Administration, Course Tests and Test Types, Grading Criteria, Remediation, Test and Test Item Analysis, Documentation.
What is the purpose of test item analysis?
To determine statistical validity and improve the test using difficulty index, index of discrimination, and effectiveness of alternatives.
What is the primary goal of remediation?
To motivate and assist trainees in achieving the critical learning objectives by providing additional instructional time.
What is the secondary goal of remediation?
To remove barriers to learning, using different methods based on individual needs.
What are the methods of remediation (TSI)?
Targeted Remediation, Scalable Remediation, Iterative Remediation.
What is T Remediation?
Targeted remediation focuses on specific objectives where the trainee struggles, with one-on-one assistance.
What is S Remediation?
Scalable remediation helps trainees with difficulties in major portions of the course using a combination of resources.
What is I Remediation?
Iterative remediation is comprehensive review with one-on-one help, requiring a minimum of 20 questions per objective area to be answered with at least 80%.
What are the sections of a remediation program (RSDCA)?
Retest, Setback, Drop from training and attrites, Counseling, Academic Review Boards (ARBs).
