Evaluation Flashcards
3 types of evaluation
POW
Performance (authentic)
Oral
Written (traditional)
What are the characteristics of an effective oral question?
CCC AO
Clear
Concise
Challenging
Applicable to subject matter and student level
One idea (who, what, where, when, why, how - not a mix)
What types of questions should be avoided?
POTBIT
Puzzle – many parts and subparts Oversize – “What do you do before beginning an engine overhaul?”; too general Toss up – more than 1 answer Bewilderment – not clear about content Irrelevant questions Trick questions – battle of wits
How should an instructor respond to student questions?
UAS
Understand question
Answer direct and accurate
Student satisfied with answer
How can we effectively listen to students?
3D CANT CUB
Don’t judge
Don’t interrupt
Don’t insist on last word
Concentrate
Avoid rehearsed answers
Non-verbal behavior
Think before answering
Close enough to hear
Underlying feelings
Biases
What are the characteristics of a good written test?
CURVOD
Comprehensiveness – sample all the objectives
Usability – easy to understand and grade
Reliability – yields consistent results
Validity – measures what should be measured
Objectivity – doesn’t reflect biases of person grading it
Discrimination – detect small differences in achievement
Explain how written tests are developed:
OICC
Level of learning objectives (RUAC)
Indicators of desired behaviors
Criterion objectives
Criterion referenced test items
Step 1: Measure the Understanding level of a normal approach
Step 2: Understands normal approach, why we use, how to set it up, control inputs used, indications
Step 3: Student will pass exam with 70%
Step 4: Make questions that will measure the behaviors