3. constructing a scale, setting up a data file Flashcards
what do you need to know when deciding on a test construct?
Need to know exactly what the aim is as there are different functions of tests
what are the questions to ask when deciding on a test construct?
o Defining variables o Who are you aiming to test? o How will it be administered? o How will it be scored? o How will you interpret the scores? o What will results be used for?
what are screening tests?
Analysis of job; items tap all behaviours required to execute tasks
intelligence tests
Define intelligence etc (lots more in a few weeks)
personality inventories
Theoretical or empirical (more in the types and traits lecture and tutorial)
achievement tests
o Most prolific kind of test
o Students learn and remember more when tested often
o Teachers may not pay enough attention to test construction or to the evaluation of the tests they use
o Tests need to do more than tap rote learning
o They need to be a taxonomy of cognitive objectives
what are the categories of the taxonomy of educational objectives?
knowledge, comprehension, application, analysis, synthesis, evaluation
what is included in knowledge in the taxonomy of education objectives
List, define, identify, name
what is included in comprehension in the taxonomy of education objectives
Convert, explain, summarise
what is included in application in the taxonomy of education objectives
Computing, determining, solving
what is included in synthesis in the taxonomy of education objectives
Design, devise, plan, formulate
what is included in evaluation in the taxonomy of education objectives
Compare, contrast, critique, judge, evaluate
what does the planing of question types depend on?
Planning the question type depends on the objective for example, short answer & completion items suit testing knowledge
why should you prepare more items than you need?
Prepare more items than you need to allow for getting rid of poorly performing ones
what are examples of selected-response formats?
o True/false
o Matching
o Multiple-choice
o Likert scales
what are examples of constructed-response formats?
o Short answer
o Essay
o Story telling
what can true/false items encourage?
May encourage rote learning
what are true/false items not appropriate to measure?
Not appropriate to measure complex constructs. because there is a 50% chance of correctly guessing
what are things to consider when using true/false items
o Make sure statements address important questions that are clearly true or false
o Avoid double negatives, ambiguous or trick items
o Use an even amount of true and false items that are of equal length
o Make some false statements have an air of truth to increase difficulty
what are matching items?
Multiple premises and multiple options
what do matching items usually tap onto?
Usually only tap rote memory
what are some criteria for matching items?
- Use clear format/tables – all items on 1 page
- Use 6-15 premises (items, statements) and a few extra response options to match to
- Number premises and place letters before responses
what can multiple-choice questions measure?
simple and complex learning objectives
what do multiple choice questions emphasise?
Emphasis on recognition rather than recall
what are some criteria for multiple-choice questions?
- Place as much of the item in the stem to avoid repetition
- 3 options for younger kids, 4 or 5 for older
- Make options plausible but only 1 correct
- Use various levels of difficulty
- Ensure some questions are knowledge-based and others are applied, comprehension or analytically based.
- May use a vignette and attach a number of MC items that are related to it
what are short answer responses?
o Short question or leave a blank
o Doesn’t rely on recognition
what do essays measure?
Measure capacity to organise, relate, communicate
what do essays encourage?
Encourage learning at deeper level
how can essays be used?
Can be used by verbally skilled as a bluff or the question is not answered
what are essays open to?
May be open to subjective marking
what are involved inadministrating?
- Individual or group
- Pencil and paper
- Test booklets
- Computers
- Answer sheets
- Test directions/instructions
what are the characteristics of oral testing?
Subject specific (e.g., French) and arguably subjective, anxiety provoking for many
what is oral testing less likely to attract?
cheating
what can oral testing tap onto?
Can tap responses at higher intellectual level & in those who do not read and write well (e.g., young children)
why evidences that written Moderate and oral testing measure diffierent things?
Moderate correlations between oral and written evidence so they tap something different
what do oral and written tests need?
firm criteria
what are performance tests sometimes called
authentic assessment
what re examples of performance testing?
Playing the instrument, making the table or letter-rack, plumb bob, cake, acting, singing, painting, pruning, tree lopping, speaking another language, portfolios, the scale you are creating to some extent
