Assessment and Critique Flashcards
What are the Assessment Methods
- Traditional - Reliable, consistent
- Authentic - Application and Correlation
- Collaborative
- Oral
Practical tests for pilot certification are ________-referenced
criterion
How can an instructor assess if their student fully understands the principles and objectives of a given flight maneuver?
Have the student demonstrate a different maneuver that has some of the same principles and objectives.
Describe the process of Collaborative Assessment
Self-Assessment
- Replay
- Reconstruct
- Reflect
- Redirect
Assessment by the Instructor
What is Authentic Assessment?
Authentic Assessment focuses on real-world tasks requiring the learner to perform at the Application and Correllation levels of learning. It is learner-centric in that it doubles as a learning experience.
Describe the types of Authentic Assessment rubrics for aeronautical proficiency.
Skill-based - for flight maneuvers and procedures
Decision-based - for single-pilot resource management and risk management
What is a critique?
Informal
Feedback provided to the learner
immediately after the performance - to eliminate errors
What is an assessment?
An evaluation of a learner’s performance and achievement to provide feedback and gauge progress relative to a unit of learning.
What are some types of critique?
Instructor-led Critique
Instructor/Learner Critique
Learner-led Critique
Self-critique
Written-critique
What are the levels in a skills-based Authentic Assessment?
Describe
Explain
Practice
Perform
What are the levels in a decision-based Authentic Assessment?
Describe
Practice
Manage-Decide
What is the purpose of an assessment?
Contributes to the learning process
Evidence learning objectives obtained
Feedback on quality of instruction
Helps learners self-evaluate
Shows learners where to focus improvement
When does a written test have “validity”?
When it measures what it is supposed to measure.
When does a written test have “reliability”?
When it yields consistent results.
When does a written test achieve “positive discrimination:?
When it measures small differences in achievement between students.
When is a written test said to be “comprehensive”?
When it effectively measures overall objectives.
What type of test item creates the greatest probability of guessing?
True-False
What are the characteristics of an effective assessment?
- Flexible
- Acceptable
- Specific
- Thoughtful
- Comprehensive
- Objective
- Constructive
- Orrganized
- (FAST COCO)
Characteristics of effective questioning
Centers on one main point
Adapted to the student
Brief and concise
Adapted to the ability of the learner
Presents a challenge
(CABAP)
Types of questions to avoid
- Toss-up or Yes/No
- Oversized
- Puzzle
- Bewilderment
- Irrelevant
- Trick
- (TOP BIT)
Evaluation of student performance and accomplishment during a lesson should be based on what?
Objectives and goals established in the lesson plan.
What kind of question requires an answer based on memory or recall?
A fact question
What are the elements of an effective written test?
- Reliability - Produces consistent results
- Validity - measures what it is supposed to
- Comprehensiveness - covers everything it needs to
- Discrimination - measures small differences
Which is the main disadvantage of supply-type test questions?
They cannot be graded uniformly or objectively.
When students are tested against a measurable standard, this type of test is called what?
Criterion-referenced
Which type of test is desirable for evaluating training that involves an operation, procedure or process?
Performance
What is Traditional Assessment?
Traditional assessment usually refers to written tests with a single correct answer to each question.
Describe the Collaborative Critique process.
Learner is asked to:
- Replay - Learner describes the session from start to finish. Instructor probes for accuracy and to get more context on thoughts assumptions etc.
- Reconstruct - Learner considers what could or should have been done to mitigate errors identified.
- Reflect - Instructor invites student to reflect: What was the most important lesson learned? What needs most improvement?
- Redirect - Instructor invites student to look forward: How can I apply what was learned to my next flight?
What are key benefits of the Collaborative Critique approach?
For the student: Develops skills and habits for Self Awareness, Self Assessment and Judgement.
For the Instructor: Allows evaulation of student judgement.
What are the grading levels for a maneuver or procedure?
Describe - describes rote elements, but needs assistance to execute
Explain - explains underlying concepts, but needs assistance to execute
Practice - practices with coaching and assistance
Perform - performs to ACS standards without coaching or assistance
What are the grading levels for risk/decision-making skills?
Explain - student can verbally identify, describe and understand the risks in the scenario, but needs to be prompted to identify risks and make decisions
Practice - student can identify, understand and apply SRM principles to the scenario. Coaching and assistance quickly corrects minor errors. The pilot is an active decision-maker.
Manage/Decide - student gathers the necessary information, identifies the possible courses of action, evaluate the risks inherent in each and make a good decision. Instructor intervention is not required.
What is the process for developing a criterion-referenced test?
- Determine Level-of-learning objectives
- List indicators of desired behaviors
- Establish criterion objectives
- Develop criterion-referenced test items
What is the difference between assessment and critique?
An assessment is a more formal evaluation of a student’s knowledge or performance against a standard.
A critique is informal feedback on a student’s performance usually given immediately after.
Stage checks, knowledge tests and checkrides are assessment. A debrief following a flight lesson is critique.
