TEST DEVELOPMENT Flashcards

1
Q

TRUE OR FALSE. An expert panel may be used in the process of test development to provide ratings of item reliability

A

FALSE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

TRUE OR FALSE. Item discrimination refers to the ability of a test item to identify those who score above the median versus below the median

A

FALSE.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

When assessment tool diminishes its ability to distinguish testtakers at the low end of an ability or trait

A

Floor effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

In a matching item, the testtaker is presented with two columns: _____on the left and ________ on the right

A

Premises; responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Ceiling effect happens when assessment tool diminishes its ability to distinguish testtakers at the high end of an ability or trait

A

Ceiling effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Can be a true or false exam

A

Binary-choice items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Useful in measuring responses that require applications and original solutions

A

Essay,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Testtaker responds with one of two responses

A

→ Binary-choice items,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Has 3 elements (stem, correct option, distractors)

A

Multiple-choice,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Consists of premises and responses

A

Matching,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Probability of obtaining correct item is .5% choice items

A

Binary-choice items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Sorting attitude as: acceptable, not acceptable

A

→ Categorical Scaling,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Ranking which among the 20 behaviors provided are acceptable and not acceptable (1 is least acceptable 20 is most acceptable)

A

→ Rating Scale,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Items are arranged from weaker to stronger expressions of belief, attitude or feeling being measured

A

→ Comparative scaling,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Respondents who agree with stronger statements will agree with milder statements

A

→ Guttman Scale,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Describing one’s happiness on a scale of 1 to 10

A

→ Rating Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Compare test takers with each other

A

norm-referenced

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

addresses the issue whether a test taker will meet the criteria

A

criterion-referenced

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

setting rules for assigning numbers

A

scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

L.L. thursstone

A

scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

units that makes up a test

A

test items

22
Q

refers to all techniques used to assess the characteristics of test items and evaluate their quality

A

test analysis

23
Q

rely on judgement from reviewers concerning the substantive and stylistic characteristics of items as well ass their accuracy and fairness

A

qualitative item analysis

24
Q

involves a variety of statistical procedures designed to ascertain the psychometric characteristics of items based on their responses obtained from the samples used in the test development

A

quantitative item analysis

25
Q

require the examinee to create responses within the structure provided by each item.

A

Constructed-Response Items

26
Q

the incorrect alternatives,

A

Distractors

27
Q

the question part of a multiple-choice item.

A

Stem

28
Q

You can assess higher-level thinking with ______

A

multiple choice questions.

29
Q

a measurement format that requires learners to classify a series of examples
using the same alternatives.

A

Matching

30
Q

Content should be homogeneous (all material of the same type).

A

Matching

31
Q

a measurement format that includes
statements of varying complexity that learners have to
judge as being correct or incorrect.

A

True-false format

32
Q

a measurement format that
includes a question or an incomplete statement that
requires the learner to supply appropriate words,
numbers, or symbols.

A

Completion format

33
Q

It is very difficult to create ______ items where

only one answer is correct.

A

Completion

34
Q

a measurement format that requires
students to make extended written responses to questions
or problems.

A

Essay format

35
Q

Scoring them is a challenge.

A

Essay format

36
Q

is a scoring scale that describes the criteria for grading.

A

rubric

37
Q

A form of assessment in which students demonstrate their
knowledge and skill by carrying out an activity or producing a
product.

A

Performance Assessment

38
Q

a relatively large and easily accessible

collection of test questions

A

Item Bank

39
Q

interactive
computer-administered test-taking process wherein
items presented to the testtaker are based in part on
the testtaker’s performance on previous items.

A

Computerized Adaptive Testing

40
Q

ability of the computer to
tailor the content of the test items on the
basis of responses to previous items

A

Item branching

41
Q

test taker responses earn credit toward placement in a particular class or category with other test takers whose pattern of responses is presumably similar in some way.

A

Class scoring

42
Q

comparing a testtaker’s
score on one scale within a test to another
scale within the same test

A

Ipsative scoring

43
Q

people who are similar in critical respects
to the people for whom the test was
designed for

A

Test Tryout

44
Q

the percentage or proportion of test takers who

correctly answer the item

A

Item Difficulty Index (Item Difficulty

Level)

45
Q

Refers to how well an item can accurately discriminate between test takers who differ on the construct being measured

A

Item Discrimination

46
Q

Item Discrimination Formula

A

D= pHIGH - pLOW

47
Q

items for which equally able persons from different cultural group have different probabilities of success

A

item bias

48
Q

assessing the quality of each alternatives

A

analysis of item alternatives

49
Q

graphic discrimination of item difficulty & discrimination

A

item-characteristic curve

50
Q

the degree that a test item is biased

A

item fairness