Chapter 10 Flashcards
What are the 10 steps to develop a test?
Organize them in the correct order:
Compile test manual
Develop the norms
Write administration instructions
Conduct pilot test(s)
Define test universe, target audience and test purpose
Validate the test
Revise the test
Develop a test plan
Conduct item analysis
Compose the test items
- Define test universe, target audience and test purpose
- Develop a test plan
- Compose the test items
- Write administration instructions
- Conduct pilot test(s)
- Conduct item analysis
- Revise the test
- Validate the test
- Develop the norms
- Compile test manual
The set of knowledge or behavior that the test represents. Important to define each construct operationally.
Which step is this?
Defining the testing universe
Inclusion/exclusion
Defining the target audience
How results will be used (compared to others; prescriptive approach, compare to oneself; ipsative approach, predict success; criterion approach)
Test a theory or to make a decision about an individual.
Defining the test purpose
Specifies the characteristics of the test, including an operational definition of the construct and the content to be measured (the testing universe), the format for the questions, and the administration and scoring of the test.
What step is this?
- Test plan
What is test format?
What are 2 types?
4pts
Refers to the type of questions that the test will contain.
- Objective test format: has one “correct” answer
- Subjective test format: does not have 1 designated “correct” answer
–> Projective tests: ambiguous pictures
Administering and scoring the test:
Is probably the most common method for determining an individual’s final test score.
Which type of model of scoring is this?
Cumulative, categorical or ipsative?
Give an example.
2pts
Cumulative model of scoring
- Ex- Exam
Administering and scoring the test:
Is used to place test takers in a particular group or class.
Which type of model of scoring is this?
Cumulative, categorical or ipsative?
Give an example.
2pts
Categorical model of scoring
Ex- Diagnostic
Administering and scoring the test:
The test taker is usually presented with two to four statements in a forced-choice format.
Which type of model of scoring is this?
Cumulative, categorical or ipsative?
Give an example.
2pts
Ipsative model of scoring
Ex- Personality test
What are 3 objective item examples?
What are these :
____: a question or partial sentence in the multiple-choice format.
______: are incorrect responses.
- Multiple choice
–> Stem
–> Distractors - True/false
- Forced choice
What are 4 subjective items examples?
- Essay questions
- Interview questions
- Projective techniques
- Sentence completion
Require test takers to directly demonstrate their skills and abilities to perform a group of complex behaviors and tasks.
What type of complex item format is this?
Performance assessments
What type of complex item format is this?
Require test takers to demonstrate their skills and abilities to perform a complex task.
Simulations
What type of complex item format is this?
Is a collection of work products that a person gathers over time to demonstrate his or her skills and abilities in a particular area.
Portfolio
What are response sets?
Patterns of responding that result in false or misleading information
Responding to items in a random fashion by marking answers without reading or considering them.
Which refers to the inclination of some test takers to try to answer items in a way that will cause a desired outcome or diagnosis.
- Random responding
- Faking
A Comparison of Objective and Subjective Formats
Sampling:
Development:
Scoring:
Respond sets:
Sampling: Objective allows you to look at a larger testing universe
Development: Objective items are longer to develop (especially distractors)
Scoring: Objectives items are much faster to grade
Response rate: Can try to guess in objective tests, but can fake in subjective tests
Is a scientific investigation of evidence that suggests that the test scores are reliable and valid for their specified purpose.
Pilot test
What is the target audience?
A. the group who participated in developing a test
B. the group of individuals who will take the test
C. those test takers who participated in the first validation study for the test
D. those test users who ask for a new test to be developed
B. the group of individuals who will take the test
The first step in test development is to define the ______.
A. test developer, test user, and test publisher
B. subject of the test, the need for the test, and the market for the test
C. testing universe, the target audience, and purpose of the test
D. process for piloting the test
C. testing universe, the target audience, and purpose of the test
When an individual must achieve a certain score to qualify for membership in a group, which one of the following approaches to test interpretation is being used?
A. normative
B. criterion
C. content
D. predictive
B. criterion
Which one of the following is an objective test format?
A. interview
B. essay
C. rating scale
D. multiple-choice question
D. multiple-choice question
Tests in which the test taker is required to make up stories about a set of ambiguous pictures would be considered to be ______.
A. objective tests
B. subjective tests
C. projective tests
D. essay tests
C. projective tests
What are the incorrect responses in a multiple-choice test item called?
A. stems
B. stimuli
C. distracters
D. answers
C. distracters
