Assessment and Critique Flashcards

1
Q

What are the Assessment Methods

A
  1. Traditional - Reliable, consistent
  2. Authentic - Application and Correlation
  3. Collaborative
  4. Oral
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Practical tests for pilot certification are ________-referenced

A

criterion

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How can an instructor assess if their student fully understands the principles and objectives of a given flight maneuver?

A

Have the student demonstrate a different maneuver that has some of the same principles and objectives.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe the process of Collaborative Assessment

A

Self-Assessment

  • Replay
  • Reconstruct
  • Reflect
  • Redirect

Assessment by the Instructor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is Authentic Assessment?

A

Authentic Assessment focuses on real-world tasks requiring the learner to perform at the Application and Correllation levels of learning. It is learner-centric in that it doubles as a learning experience.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Describe the types of Authentic Assessment rubrics for aeronautical proficiency.

A

Skill-based - for flight maneuvers and procedures

Decision-based - for single-pilot resource management and risk management

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a critique?

A

Informal

Feedback provided to the learner

immediately after the performance - to eliminate errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an assessment?

A

An evaluation of a learner’s performance and achievement to provide feedback and gauge progress relative to a unit of learning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are some types of critique?

A

Instructor-led Critique

Instructor/Learner Critique

Learner-led Critique

Self-critique

Written-critique

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the levels in a skills-based Authentic Assessment?

A

Describe

Explain

Practice

Perform

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the levels in a decision-based Authentic Assessment?

A

Describe

Practice

Manage-Decide

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the purpose of an assessment?

A

Contributes to the learning process

Evidence learning objectives obtained

Feedback on quality of instruction

Helps learners self-evaluate

Shows learners where to focus improvement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When does a written test have “validity”?

A

When it measures what it is supposed to measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

When does a written test have “reliability”?

A

When it yields consistent results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

When does a written test achieve “positive discrimination:?

A

When it measures small differences in achievement between students.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When is a written test said to be “comprehensive”?

A

When it effectively measures overall objectives.

17
Q

What type of test item creates the greatest probability of guessing?

A

True-False

18
Q

What are the characteristics of an effective assessment?

A
  • Flexible
  • Acceptable
  • Specific
  • Thoughtful
  • Comprehensive
  • Objective
  • Constructive
  • Orrganized
  • (FAST COCO)
19
Q

Characteristics of effective questioning

A

Centers on one main point

Adapted to the student

Brief and concise

Adapted to the ability of the learner

Presents a challenge

(CABAP)

20
Q

Types of questions to avoid

A
  • Toss-up or Yes/No
  • Oversized
  • Puzzle
  • Bewilderment
  • Irrelevant
  • Trick
  • (TOP BIT)
21
Q

Evaluation of student performance and accomplishment during a lesson should be based on what?

A

Objectives and goals established in the lesson plan.

22
Q

What kind of question requires an answer based on memory or recall?

A

A fact question

23
Q

What are the elements of an effective written test?

A
  1. Reliability - Produces consistent results
  2. Validity - measures what it is supposed to
  3. Comprehensiveness - covers everything it needs to
  4. Discrimination - measures small differences
24
Q

Which is the main disadvantage of supply-type test questions?

A

They cannot be graded uniformly or objectively.

25
Q

When students are tested against a measurable standard, this type of test is called what?

A

Criterion-referenced

26
Q

Which type of test is desirable for evaluating training that involves an operation, procedure or process?

A

Performance

27
Q

What is Traditional Assessment?

A

Traditional assessment usually refers to written tests with a single correct answer to each question.

28
Q

Describe the Collaborative Critique process.

A

Learner is asked to:

  1. Replay - Learner describes the session from start to finish. Instructor probes for accuracy and to get more context on thoughts assumptions etc.
  2. Reconstruct - Learner considers what could or should have been done to mitigate errors identified.
  3. Reflect - Instructor invites student to reflect: What was the most important lesson learned? What needs most improvement?
  4. Redirect - Instructor invites student to look forward: How can I apply what was learned to my next flight?
29
Q

What are key benefits of the Collaborative Critique approach?

A

For the student: Develops skills and habits for Self Awareness, Self Assessment and Judgement.

For the Instructor: Allows evaulation of student judgement.

30
Q

What are the grading levels for a maneuver or procedure?

A

Describe - describes rote elements, but needs assistance to execute

Explain - explains underlying concepts, but needs assistance to execute

Practice - practices with coaching and assistance

Perform - performs to ACS standards without coaching or assistance

31
Q

What are the grading levels for risk/decision-making skills?

A

Explain - student can verbally identify, describe and understand the risks in the scenario, but needs to be prompted to identify risks and make decisions

Practice - student can identify, understand and apply SRM principles to the scenario. Coaching and assistance quickly corrects minor errors. The pilot is an active decision-maker.

Manage/Decide - student gathers the necessary information, identifies the possible courses of action, evaluate the risks inherent in each and make a good decision. Instructor intervention is not required.

32
Q

What is the process for developing a criterion-referenced test?

A
  1. Determine Level-of-learning objectives
  2. List indicators of desired behaviors
  3. Establish criterion objectives
  4. Develop criterion-referenced test items
33
Q

What is the difference between assessment and critique?

A

An assessment is a more formal evaluation of a student’s knowledge or performance against a standard.

A critique is informal feedback on a student’s performance usually given immediately after.

Stage checks, knowledge tests and checkrides are assessment. A debrief following a flight lesson is critique.