Section 2 C Flashcards
What reference governs testing?
NAVEDTRA 132
State the purpose of a testing program
to ensure a quality testing process is implemented to effectively assess the trainee’s achievement of learning.
Explain the roles and responsibilities for an effective testing program: NMETC/Naval Education and Training Command.
Testing policy guidance.
Explain the roles and responsibilities for an effective testing program: NMETC Academic Directorate/NETC N7
Oversight and monitors compliance by learning centers
Explain the roles and responsibilities for an effective testing program: learning centers Commanding Officer
Serves as CCA; incorporates TYCOM test banks
Explain the roles and responsibilities for an effective testing program: Director of Training
Ensures testing programs are conducted.
Explain the roles and responsibilities for an effective testing program: Learning Standards Officer (LSO).
Provides guidance to curriculum developers on testing.
Explain the roles and responsibilities for an effective testing program: Curriculum Control Model Manager (CCMM)
Approves test design; maintains test bank
Explain the roles and responsibilities for an effective testing program: Curriculum Developer
Designs/develops testing plan.
Explain the roles and responsibilities for an effective testing program: learning site/Det CO/OIC
Implements testing plan
Explain the roles and responsibilities for an effective testing program: Testing Officer
Test administration, grading, scores tests, maintains test bank.
Explain the roles and responsibilities for an effective testing program: Course Supervisor
Ensures, monitors, validates admin, security, and test item analysis
Explain the roles and responsibilities for an effective testing program: Participating Activities
Provides comments, feedback, new test items, and maintains test and test item analysis data.
State the primary course source data for creating test items.
Job Duty Task Analysis (JDTA)
List usable course source data to be used when the primary course source data is not available or has not been created.
Use a combination of Occupational Standards (OCCSTD), Course Training Task List (CTTL), Personal Performance Profile (PPP) Table, and a Curriculum Outline of Instruction (COI).
Define Formal Testing
Graded and is used in the calculation of the trainees final grade.
Define Informal Testing
May or may not be graded - regardless the grade will not be used in the calculation of the trainees final grade.
Define the following proficiency levels and the definition of the three levels contained with each.
- Skill: level 1 imitation; level 2 Repetition; level 3 Habit
- Knowledge: level 1 knowledge/comprehension; level 2 application/analysis; level 3 synthesis/evaluation.
List and discuss the five categories for performance and knowledge tests.
- Pre-test: validation of material, prerequisite.
- Progress test: given after blocks of instruction.
- Comprehensive test: Final course exam.
- Oral test: Normally administered by board.
- Quiz: tests recently taught material.
Discuss the process for piloting a test.
Reviewed by SME, piloting by CCMM and forwarded to the Learning Standards Officer (LSO) for approval, testing trainees who are at the end stages, surveying trainee test results, using test item analysis and survey to improve the test.
Describe the use of Job Sheet as it relates to knowledge and performance tests.
Direct trainee step-by-step performance.
Describe the use of Problem Sheet as it relates to knowledge and performance tests.
Present practical problems that require analysis.
Describe the use of Assignment Sheet as it relates to knowledge and performance tests.
Direct the study or homework efforts of trainees
Describe the use of Multiple-choice as it relates to knowledge and performance tests.
Most versatile of all knowledge test.
Describe the use of True or False as it relates to knowledge and performance tests.
Test questions that is either true or false.
Describe the use of Matching as it relates to knowledge and performance tests.
Two lists of connected words/phrases/pictures/symbols.
Describe the use of Completion as it relates to knowledge and performance tests.
Allow free response.
Describe the use of Labeling as it relates to knowledge and performance tests.
Measure ability to recall facts.
Describe the use of Essay as it relates to knowledge and performance tests.
Requires written response.
Describe the use of Case Study as it relates to knowledge and performance tests.
Used for complex issues for comprehension understanding.
Describe the use of Validation of Test Instruments as it relates to knowledge and performance tests.
Validating information on test.
What are the two types of testing method adopted by NMETC/NETC?
Criterion-referenced test and Norm-referenced test
Discuss test failure policies and associated grading criteria within your learning environment.
Re-train, re-test…if passed the highest score the highest grade the student can receive is an 80%.
Discuss how skill learning objective criticality is determined during performance test design.
- Developed using Job Sheets.
- Minimum criticality: criticality of performance and frequency of performance.
List the ten sections of a testing plan.
- Course Data
- Course Roles and Responsibilities
- Course Waivers
- Test Development
- Test Administration
- Course test and test types
- Grading criteria
- Remediation
- Test and test item analysis
- Documentation
State the purpose of test and test item analysis.
Determine statical validity.
3 types: difficulty index, index of discrimination, effectiveness of alternatives.
List and discuss the primary and secondary goal of remediation program.
- Motivate and assist trainees in achieving the critical learning objectives of a course by providing additional instructional study times.
- remove barriers of learning.
Discuss the three methods of remediation available to instructors.
Targeted: one-on-one mentorship for one objective
Scalable: one-on-one mentorship with SME of each major objective.
Iterative: Total recall approach
Discuss the following as it relates to the remediation program: Retest
when trainee does not achieve a test minimum passing grade.
Discuss the following as it relates to the remediation program: Setback
May cover a certain portion of the course
Discuss the following as it relates to the remediation program: Drop from training and attrite
Drop can be academic, nonacademic, or disenrollment
Discuss the following as it relates to the remediation program: Counseling
Preventive counseling in “A”/”C” schools, include performance and personal issues.
Discuss the following as it relates to the remediation program: Academic Review Board (ARB).
Will be convened when other means have not helped. Setback may be due to ARB.
