Lecture 1

Question 1

What is the definition of a test?

Answer 1

A test is an instrument for the measurement of a person’s maximum or typical performance under standardized conditions, where the performance is assumed to reflect one or more latent attributes

Question 2

A test is defined to measure performance, 2 types of performances have been distinguished …

Answer 2

1. Maximum performance test: the person does his best to solve on or more problems, it measures achievement.
2. Typical performance test: the person responds to one or more tasks, where the responses are typical for the person. Personality or attitude test

Question 3

What is the dimensionality of a test?

Answer 3

The dimensionality of a test is equal to the number of latent attributes

Question 4

Maximum performance tests are further divided in ..

Answer 4

• power tests (when it is about accuracy)

- speed tests

Question 5

What is the difference between aptitude/ability and achievement tests?

Answer 5

An aptitude tests measures abilities that are not explicitly taught in education.
An achievement tests is an instrument for measuring performance that is explicitly taught in training and education programs

Question 6

Typical performance tests are divided into three tests, according to the attribute that the test is measuring.

Answer 6

• personality tests
• interest inventories
• attitude questionnaire

Question 7

The development of a maximum performance test starts with developing a plan, what are the essential aspects of this plan?

Answer 7

1. Construct of interest
2. Measurement mode
3. Objectives of the test
4. Populations and sub populations
5. Conceptual framework
6. Response mode
7. Administration mode

Question 8

Tests are used for many different purposes, some distinctions:

Answer 8

• scientific versus practical purposes
• individual test taker versus group of test takers
• description versus diagnosis version decision making

Question 9

What are the most used measurement modes?

Answer 9

• self-performance mode
• self-evaluation mode
• other-evaluation mode

Question 10

The main distinction in the item response mode is between …

Answer 10

Free response mode or choice response mode

Question 11

Name the three possible item response scales for achievement tests

Answer 11

• dichotomous: 2 ordered categories correct/incorrect
• ordinal-polytomous: has more than 2 ordered categories
• partial ordinal-polytomous

Question 12

Name four possible administration modes

Answer 12

• Oral administration
• paper and pencil administration
• computerized test
• computerized adaptive test

Question 13

Name three types of pilot studies

Answer 13

1. Experts pilots
2. Test taker pilots
3. Rater’s pilots

Question 14

What does kappa’s coefficient measure?

Answer 14

Kappa measures consistency. Can be used for interrater consistency or intrarater consistency

Question 15

How is kappa coefficient computed?

Answer 15

Kappa = (O-E)/(1-E)
O = observed proportion of identical ratings
E = expected proportion of agreement

E -> fy * fx / n –> allemaal bij elkaar optellen en delen door totaal

Question 16

What does a kappa coefficient of 1 mean? And 0?

Answer 16

Kappa = 1 -> perfect consistency
Kappa = 0 -> completely unrelated

Question 17

DuBois describes the history of modern testing, he describes 3 roots of modern testing

Answer 17

• civil service examinations
• the assessment of academic behavior
• study study of individual differences in behavior