111 - Testing

Question 1

State the purpose of a Testing program

Answer 1

Ensure Quality testing to effectively assess trainees achievement of learning objectives

Question 2

State the primary course source data for creating test items

Answer 2

JDTA

Question 3

List the usable course data to be used when the primary course source data is not available or has not been created

Answer 3

OCCSTDs, CTTL, PPP table and COI

Question 4

Define the following tests:FormalInformal

Answer 4

Formal- graded, used toward final gradeInformal- May or may not be graded. Doesn’t count toward final grade

Question 5

Define the following proficiency levels and definition of the 3 levels contain within each: SkillKnowledge

Answer 5

Skill Level 1- ImitationLevel 2- RepetitionLevel 3 - HabitKnowledge Level 1- Knowledge/ ComprehensionLevel 2- Application/ AnalysisLevel 3- Synthesis/ Evaluation

Question 6

List the 5 categories for performance and knowledge tests

Answer 6

Pre-testProgress TestComprehensive TestOral TestQuiz

Question 7

Discuss the process of piloting a test

Answer 7

Reviewed by SME to ensure proper assessment of LOReview and approval by CCMM sent to LSO for final approvalTest a group of students under actual conditions w/ knowledge that test doesn’t count towards final gradecurriculum development will develop trainee critique to evaluate after testReview results

Question 8

Describe the use of each test instrument as they relate to knowledge and performance tests

Answer 8

Job, Assignment, Problem SheetsEssay, Case study, Completion, LabelingMatching, Multiple choice, T/FValidation of Test instrument- content validated: grammar, assess LO, appropriate level, open/closed and stated in course

Question 9

What are the 2 grading systems used

Answer 9

Criterion-referenced test- what we doNorm-referenced test- curve, Navy Advancement

Question 10

Discuss test failure policies and associated grading criteria within your learning environment

Answer 10

Min score 75%1st fail= 1 week MNS, remediation from instructor and retest2nd fail in 3 wks= ARB1 Knowledge and 1 PT fail in same area= ARBSame test fail twice= STOP training and go to BMS to await ARB

Question 11

Discuss during performance test design, how the skill learning objective criticality is determined

Answer 11

High- value of 3- is skill used during job performanceModerate- value of 2- skill influences job performanceLow- value of 1- skill has little influence on job performance

Question 12

Discuss during knowledge test design, how the knowledge learning objective criticality is determined to perform a task

Answer 12

using course source datacriticality of performance factors listed in the Testing plan

Question 13

LIst the 10 sections of a testing plan

Answer 13

Course dataCourse roles and responsibilitiesCourse waiversTest developmentTest administrationCourse tests and test typesGrading CriteriaRemediationTest and Test item AnalysisDocumentation

Question 14

State the purpose of test and test item analysis

Answer 14

Determine statistical validity:difficulty index- calculation of difficultyindex of discrimination- with norm-reference testingeffectiveness of alternatives- multiple choicetest item analysis is documented in the courses testing plan

Question 15

In a remediation program, discuss what primary and secondary goal is

Answer 15

Primary- motivate and assist trainees in achieving the critical learning objectives by more instructionSecondary- Remove barriers to learning

Question 16

Discuss the 3 methods of remediation available to instructors

Answer 16

Targeted- student has issues (small portion) in accomplishing objectives during normal class time. one on one mentorship of SMEScalable- student lacks with major portion of objectives. Direct engagementIterative- retained nothing. one on one total recall

Question 17

Discuss the following of the remediation programRetestSetbackDrop from training and attritesCounselingARB

Answer 17

Retest-when trainee failsSetback- when trainee needs more time for objectivesDrop and attrites- every effort made, DFT if unsuited, unwilling, unable to learn. Attrite- if released form navyCounseling- in a and c schools for performance and personal problemsARB- when all else fails