Exam 3 Flashcards
Subjective Assessment
non quantifiable
test environment is artificial
Alternative assessments
rubrics, questionnaires, rating scales, portfolios, observations, interviews
formative evaluation
designed to improve performance
criterion referenced
tied to a specific level of performance/independent of others
authentic assessment
when the skill, performance or task evaluations are conducted in realistic environments that are actually faced in real life
ised in both formative (ongoing) and summative (end) assessments
has ecological relevance
many skills assessed while active
assess when to use a skill an dhow to use a skill
used in educational settings.
Primary trait rubric
assess very specific guidelines
scoring rubrics should be
valid
goals understandable by all parties involved
scoring criteria is clear
precise enough to be valid
assessment should = skills assessed
practical
top level of a rubric assesses
how crucial each concept is
time spent on skill development
age and ability level
amount of exposure to concept
Halo effect
prior info biases an observer positively or negatively
questionnaire
qualitative research
what do questionnaires assess
knowledge, opinions, preferences
needs large groups
how to develop a questionnaire
purpose statement, planning for administration, planning for evaluation
must be IRB approved
presentation of questionnaire
easy to read, clear, understandable, font, color, enough options, length, check boxes or open ended questions
Systematic observation
looking for patterns, behaviors, has specific purpose to collect data,
targets certain behaviors
issue with systematic observation
alot of error built in,
not always valid/reliable
bias is difficult to exclude
systematic observation used to:
document typical performance/behavior
document unusual behavior
confirm results of another assessment (triangulation)
compare clients’ behaviors
Checklists
checklists, rating scales, anecdotal records, critical incident reports, record if present or absent, useful to assess mastery
Rating Scale
can indicate a 'degree' easy to administer and score hard to contract personal bias is an issue 4-6 points should be provided for rating
Anecdotal Records
snapshot of actual behavior
allows recording of environment antecedents and consequences of behaviors
allows recording in non-standardized form
can be time consuming
hard to be objective
Interviews
asking questions
can be individual, face to face, face to face - group, mediated via forms of communication,
interviews setup types
structured, semi-structured, unstructured
considerations for an interview
focus of your research, what you want to learn, time and resources, what do you already know
affective domain
values, interests, emotional responses
behavior/personality
difficult to measure, always changing, personal understanding is different
Affective MEasures
Likert, Borg RPE, Myers-Briggs personality, spot competition analysis