Brainscape's Knowledge GenomeTM


Top Flashcards (Certified)
All Flashcards

PSYCHOLOGICAL ASSESSMENT - Midterm > TEST DEVELOPMENT & NORM > Flashcards

TEST DEVELOPMENT & NORM Flashcards

1
Q

The process of developing a test occurs in five stages:

A
  1. test conceptualization (idea)
  2. test construction (writing up)
  3. test tryout (pilot testing)
  4. item analysis
  5. test revison

test administration (final) 50

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What stage of test development involves the initial idea and purpose of the test, including determining what the test will measure?

A

Test Conceptualization

(1st Stage)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

1st Stage - Test Conceptualization

What is the term for the preliminary research that surrounds the creation of a test prototype?

A

Pilot Work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

1st Stage - Test Conceptualization

What process involves evaluating test items to determine if they should be included in the final version of the test?

A

Pilot Study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

1st Stage - Test Conceptualization

What are the three key questions a test developer must ask during test conceptualization?

A

a) What is the test designed to measure?
b) What is the objective of the test?
c) Is there a need for this test?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What stage in test development involves writing and structuring the test items based on the conceptualized idea?

A

Test Construction

(2nd Stage)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

2nd Stage - Test Construction

What is the process of setting rules for assigning numbers in measurement?

A

Scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

2nd Stage - Test Construction

Scaling Methods:

A

a. rating scale
b. Likert scale (Likert, 1932)
c. Method of Paired Comparisons
d. Comparative Scaling
e. Categorical Scaling
f. Guttman scale (1944, 1947)
g. Scalogram Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

2nd Stage - Test Construction

What type of scale involves grouping words, statements, or symbols to indicate the strength of a trait, attitude, or emotion?

A

Rating Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

2nd Stage - Test Construction

A survey asks students to rate their stress level on a scale from 1 to 10, with 1 being “Not Stressed at All” and 10 being “Extremely Stressed.” What type of scaling method is used?

A

Rating Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

2nd Stage - Test Construction

Which scale presents test-takers with a five-point or seven-point response format to measure attitudes?

A

Likert Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

2nd Stage - Test Construction

A researcher asks participants to respond to the statement “I feel confident in my ability to solve problems” using the following options:
1 - Strongly Disagree
2 - Disagree
3 - Neutral
4 - Agree
5 - Strongly Agree
What type of scaling method is used in this survey?

A

Likert Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

2nd Stage - Test Construction

In which scaling method are test-takers presented with two stimuli and asked to compare them?

A

Method of Paired Comparisons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

2nd Stage - Test Construction

A hiring manager shows a candidate two job descriptions and asks, “Which role do you find more suitable for your skills?” What scaling method is being applied?

A

Method of Paired Comparisons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

2nd Stage - Test Construction

What type of scaling requires judgments of a stimulus in comparison with every other stimulus on the scale?

A

Comparative Scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

2nd Stage - Test Construction

A group of coffee lovers is asked to rank five coffee brands from least favorite to most favorite. What type of scaling method is used?

A

Comparative Scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

2nd Stage - Test Construction

What type of scaling involves categorizing stimuli into two or more alternatives, such as “Agree” or “Disagree”?

A

Categorical Scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

2nd Stage - Test Construction

A researcher presents a list of common workplace behaviors and asks employees to classify them as:

  • Ethical
  • Unethical
  • Depends on the Situation

What scaling method is used in this classification?

A

Categorical Scaling

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

2nd Stage - Test Construction

Which scale arranges items sequentially from weaker to stronger expressions of an attitude, belief, or feeling?

A

Guttman Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

2nd Stage - Test Construction

A survey asks participants whether they agree or disagree with the following statements:

  1. “All citizens should have access to basic healthcare.”
  2. “The government should provide healthcare for low-income individuals.”
  3. “Private insurance should be replaced with a universal healthcare system.”

If a participant agrees with statement 3, they are likely to agree with statements 1 and 2.

What type of scaling method is used?

A

Guttman Scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

2nd Stage - Test Construction

What is the item-analysis procedure that involves a graphic mapping of a test-taker’s responses?

A

Scalogram Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

2nd Stage - Test Construction

A psychologist visually maps responses to a questionnaire on self-esteem to analyze patterns and consistency in participants’ answers. What type of scaling method is used?

A

Scalogram Analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

2nd Stage - Test Construction (Writing Items)

What to consider when writing items?

A
  • What range of content should the items cover?
  • Which of the many different types of item formats should be employed?
  • How many items should be written in total and for each content area covered?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

2nd Stage - Test Construction (Writing Items)

What is the term for the reservoir of items from which the final test items will be selected?

A

Item Pool

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

2nd Stage - Test Construction

What term refers to the form, structure, and arrangement of individual test items?

A

Item Format

26
Q

2nd Stage - Test Construction (Writing Items)

Two Types of Item Format.

A
  • Selected-Response Format
  • Constructed-Response Format
27
Q

2nd Stage - Test Construction (Writing Items)

Which type of item format requires test-takers to choose an answer from a given set of options?

A

Selected-Response Format

28
Q

2nd Stage - Test Construction (Writing Items)

Which type of item format requires test-takers to supply or create their own answer?

A

Constructed-Response Format

29
Q

In which stage of test development is a prototype of the test administered to a sample group to assess its effectiveness before finalization?

A

Test Tryout

(3rd Stage)

30
Q

3rd Stage - Test Tryout

During test tryout, the test should be administered to individuals who are similar to the target test population. Why is this important?

A

To ensure the test is valid and appropriate for its intended users.

31
Q

3rd Stage - Test Tryout

How many subjects should ideally be included in a test tryout per test item?

A

No fewer than five, and preferably ten per item.

32
Q

3rd Stage - Test Tryout

Why should the conditions of a test tryout be as identical as possible to the standardized test administration conditions?

A

To maintain uniformity and reliability in test results.

33
Q

What stage of test development involves selecting the best items from a pool of tryout items

A

Item Analysis

(4th Stage)

34
Q

4th Stage - Item Analysis

What statistical measure indicates the proportion of test-takers who answered an item correctly and helps determine whether an item is too easy or too difficult?

A

The Item-Difficulty Index

35
Q

4th Stage - Item Analysis

Which index provides an indication of a test’s internal consistency and helps determine if the test is reliable?

A

The Item-Reliability Index

36
Q

4th Stage - Item Analysis

What statistical tool is used to determine whether test items measure the same construct and help identify items that need to be revised or eliminated?

A

Factor Analysis

37
Q

4th Stage - Item Analysis

Which index provides an indication of how well a test measures what it is supposed to measure and contributes to a test’s criterion-related validity?

A

The Item-Validity Index

38
Q

4th Stage - Item Analysis

What measure evaluates how well a test item differentiates between high and low scorers, with a higher value indicating better discrimination?

A

The Item-Discrimination Index

39
Q

4th Stage - Item Analysis

If an item has a negative discrimination index (d-value), what does it indicate about low and high scorers?

A

It indicates that low scorers are more likely to answer the item correctly than high scorers, meaning the item should be revised or eliminated.

40
Q

4th Stage - Item Analysis

What graphical representation shows both item difficulty and discrimination?

A

The Item-Characteristics Curve

41
Q

4th Stage - Item Analysis

What type of item analysis involves non-statistical procedures such as interviews and discussions to explore how individual test items work?

A

Qualitative Item Analysis

42
Q

4th Stage - Item Analysis

What cognitive assessment technique involves having respondents verbalize their thoughts as they complete a test to provide insight into their reasoning process?

A

Think-Aloud Administration

43
Q

4th Stage - Item Analysis

What qualitative item analysis method involves gathering specialists to review test items and provide feedback on their quality?

A

Expert Panels

44
Q

4th Stage - Item Analysis

Types of Item Analysis and Index

A

a. The Item-Difficulty Index
b. The Item-Reliability Index
c. The Item-Validity Index
d. The Item-Discrimination Index
e. Item-Characteristics Curve
f. Qualitative Item Analysis

45
Q

It involves refining test items based on item analysis results, such as difficulty, reliability, validity, and discrimination indices, to improve the overall quality of the test.

A

Test Revision

(5th Stage)

46
Q

5th Stage - Test Revision

What process involves revalidating a test on a different sample of test-takers to ensure its predictive validity remains consistent?

A

Cross-validation

47
Q

5th Stage - Test Revision

What test validation process is conducted on two or more tests using the same sample of test-takers?

A

Co-Validation

48
Q

What is the final stage in test development where the test is officially administered under standardized conditions to the target population?

A

Test Administration

49
Q

Behavior that is usual, average, normal, standard, expected, or typical.

50
Q

NORM

What refers to the test performance data of a specific group used as a reference for evaluating individual test scores?

51
Q

NORM

What is the term for a group of individuals whose test performance is analyzed to serve as a reference for others?

A

Normative sample

52
Q

NORM

What is the process of deriving norms called?

53
Q

NORM

It may be modified to describe a particular type of norm derivation.

54
Q

NORM

Types of Norms

A
  • Percentiles
  • Developmental Norms: Age Norms & Grade Norms
  • National Norms
  • Subgroup Norms
  • Local Norms
55
Q

Types of Norms

Which type of norm expresses a test score relative to the percentage of people who scored lower?

A

Percentiles

56
Q

Types of Norms

Which type of norm is based on the typical performance of individuals at a specific age or grade level?

A

Developmental Norms

57
Q

Types of Norms

What are the two types of developmental norms?

A

Age Norms & Grade Norms

58
Q

Types of Norms

What type of norms represent the test performance of individuals from across a country?

A

National Norms

59
Q

Types of Norms

What type of norms are established for specific groups within a larger population, such as gender or ethnicity?

A

Subgroup Norms

60
Q

Types of Norms

What type of norms are created based on test performance within a particular region or institution?

A

Local Norms

PSYCHOLOGICAL ASSESSMENT - Midterm (6 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2025 Bold Learning Solutions. Terms and Conditions