PSych

Question 1

What are norms?

Answer 1

Average scores collected from a large group (the norm group)

Norms help interpret an individual’s raw score by comparing it to others’ scores.

Question 2

How does a norm-referenced test interpret scores?

Answer 2

Converts raw scores into relative rankings using percentiles, z-scores, or standard scores.

Question 3

What is a percentile rank?

Answer 3

Shows the percentage of people in the norm group who scored lower than the individual.

Question 4

What is a Z-score?

Answer 4

Measures how far a score is from the mean in standard deviation (SD) units.

Question 5

What does an IQ score of 130 indicate?

Answer 5

Top 2% of the population.

Question 6

What are developmental norms?

Answer 6

Average ages or milestones at which children typically achieve certain skills, behaviors, or abilities.

Question 7

Define an ordinal scale.

Answer 7

Data is ranked in order, but differences between ranks may not be equal.

Question 8

What are within-group norms?

Answer 8

Compares an individual’s performance within a specific group (e.g., same age, gender, education level).

Question 9

What is a normative sample?

Answer 9

A group used to establish average performance (norms) on a test.

Question 10

Differentiate between standardization sample and normative sample.

Answer 10

Standardization sample helps develop the test; normative sample establishes norms.

Question 11

What are convenience norms?

Answer 11

Norms created based on easily available data, which may introduce bias.

Question 12

What is the difference between percentile and percentage?

Answer 12

Percentile ranks a value in a dataset; percentage represents a proportion of the total.

Question 13

What is a ceiling test?

Answer 13

Measures the upper limits of ability.

Question 14

What is a floor test?

Answer 14

Measures the lower limits of ability.

Question 15

What does a standard score (Z-score) indicate?

Answer 15

How far a data point is from the mean in terms of standard deviations.

Question 16

What is a linear transformation?

Answer 16

Changes the scale but keeps relationships the same.

Question 17

What is the purpose of equating procedures?

Answer 17

Ensures fair comparisons of test scores across different test versions.

Question 18

What is alternate forms equating?

Answer 18

Compares two different versions of the test.

Question 19

What does reliability refer to?

Answer 19

The consistency and stability of a measurement instrument over time.

Question 20

What is measurement error?

Answer 20

The difference between a person’s true score and their observed score on a test.

Question 21

What is inter-rater reliability?

Answer 21

Measures agreement between multiple raters or judges.

Question 22

Define split-half reliability.

Answer 22

Assesses internal consistency by comparing two halves of a test.

Question 23

What does Cronbach’s Alpha measure?

Answer 23

How closely related a set of items are within a test.

Question 24

What is the Standard Error of Measurement (SEM)?

Answer 24

Estimates the variability in an individual’s test score due to measurement error.

Question 25

What is confirmatory factor analysis (CFA)?

Answer 25

Used to confirm if data fits a hypothesized measurement structure.

Question 26

What is differential item functioning (DIF)?

Answer 26

Identifies biased test items affecting different groups.

Question 27

What is the significance of statistical significance?

Answer 27

Ensures results are not due to random chance.

Question 28

What does DIF stand for in the context of testing?

Answer 28

Differential Item Functioning ## Footnote DIF identifies biased test items affecting different groups.

Question 29

What is the primary purpose of Item Response Theory (IRT)?

Answer 29

Analyzes individual item responses to ensure fairness.

Question 30

When should Maximum Likelihood (ML) be used in statistical modeling?

Answer 30

For normal distributions with ≥5 levels.

Question 31

What statistical method is recommended for non-normal data with ≥5 levels?

Answer 31

Maximum Likelihood Ratio (MLR).

Question 32

Which method should be used for data with ≤5 levels?

Answer 32

DWLS.

Question 33

What statistical method is suitable for categorical data?

Answer 33

WLSMV.

Question 34

Define reliability in the context of measurement instruments.

Answer 34

Consistency and stability of a measurement instrument over time.

Question 35

What does validity refer to in testing?

Answer 35

Whether the test measures what it is supposed to measure.

Question 36

Can a test be reliable but not valid?

Answer 36

Yes, a test can be reliable but not valid.

Question 37

What is a true score?

Answer 37

The actual ability or characteristic being measured.

Question 38

What does the observed score represent?

Answer 38

The score obtained from a test.

Question 39

What is the Standard Error of Measurement (SEM)?

Answer 39

Estimates the range in which the true score likely falls.

Question 40

What type of reliability measures the stability of test results over time?

Answer 40

Test-Retest Reliability.

Question 41

What is Inter-Rater Reliability?

Answer 41

Ensures consistency in human judgment.

Question 42

What statistic is commonly used to measure internal consistency?

Answer 42

Cronbach’s alpha (α).

Question 43

What is Parallel-Forms Reliability?

Answer 43

Measures consistency between different versions of the same test.

Question 44

What does Split-Half Reliability assess?

Answer 44

Internal consistency by dividing a test into two halves.

Question 45

What is the Kuder-Richardson Formula (KR-20) used for?

Answer 45

Dichotomous test items (e.g., true/false).

Question 46

What is the purpose of confirmatory factor analysis (CFA)?

Answer 46

Verifies whether observed variables align with a hypothesized structure of latent variables.

Question 47

What does measurement invariance ensure?

Answer 47

A measurement tool works equally across different groups.

Question 48

What is the Chi-Square Test (χ²) used for?

Answer 48

To compare observed vs. expected frequencies.

Question 49

What is criterion validity?

Answer 49

Examines how well a test predicts outcomes or correlates with an established standard.

Question 50

What is the difference between concurrent and predictive validity?

Answer 50

Concurrent validity assesses results at the same time, while predictive validity evaluates future performance.

Question 51

What does the term 'predictor' refer to in validation?

Answer 51

Factors or test scores used to forecast future performance.

Question 52

What is diagnostic utility in testing?

Answer 52

How accurately a test classifies people into correct categories.

Question 53

What are true positives (TP) in diagnostic testing?

Answer 53

People who have the condition and are correctly identified by the test.

Question 54

What does the Youden Index measure?

Answer 54

The effectiveness of a diagnostic test.

Question 55

What is qualitative item analysis?

Answer 55

Relies on the judgments of reviewers regarding the substantive characteristics of test items.

Question 56

What does quantitative item analysis use to assess test items?

Answer 56

Statistical procedures based on responses from test samples.

Question 57

What is the first step in test development?

Answer 57

Define the purpose of the test.

Question 58

What is the purpose of a test blueprint?

Answer 58

Outline the test structure and alignment with the test's purpose.

Question 59

What is meant by content validity?

Answer 59

Does the test cover the full scope of the concept being measured?

Question 60

What are advantages of selected-response items?

Answer 60

* Fast * Objective * Easy to score * Time-efficient

Question 61

What are disadvantages of forced-choice items?

Answer 61

Difficult for respondents if both options seem equally applicable.

Question 62

What is the first step after revisions and validation in test development?

Answer 62

Finalize the test for full use.

Question 63

What is the purpose of continuous monitoring and review in test development?

Answer 63

To update the test based on feedback, research, and changes in the field.

Question 64

What are the advantages of selected-response items?

Answer 64

* Fast * Objective * Easy to score * Time-efficient

Question 65

What are the disadvantages of selected-response items?

Answer 65

* Risk of guessing * Careless mistakes * Difficulty capturing detailed insights

Question 66

What do forced-choice items help reveal?

Answer 66

Personality traits by requiring a forced decision.

Question 67

What is a disadvantage of forced-choice items?

Answer 67

Difficult for respondents if both options seem equally applicable.

Question 68

What is an advantage of constructed-response items?

Answer 68

Provides richer, more detailed insights.

Question 69

What is a disadvantage of constructed-response items?

Answer 69

* Requires more time to grade * Needs skilled graders * Can affect score consistency

Question 70

Define item validity.

Answer 70

Measures whether a test item accurately assesses the intended skill or knowledge.

Question 71

Provide an example of item validity.

Answer 71

A grammar question in a math test lacks item validity.

Question 72

Define item discrimination.

Answer 72

Evaluates how well an item differentiates between high- and low-performing test-takers.

Question 73

What does a high discrimination index indicate?

Answer 73

The item distinguishes between strong and weak test-takers.

Question 74

How is item difficulty calculated?

Answer 74

Percentage of test-takers who answered correctly.

Question 75

What is an ideal difficulty level for test items?

Answer 75

A balance between too easy and too hard.

Question 76

What are distractors in multiple-choice questions?

Answer 76

Incorrect answer choices designed to appear plausible to those who don’t know the correct answer.

Question 77

What is the purpose of distractors?

Answer 77

Ensures that test-takers must think critically rather than guess easily.

Question 78

Define item-test regression.

Answer 78

Examines how individual test items relate to the overall test score.

Question 79

What is the ideal characteristic of test items?

Answer 79

Moderately difficult and highly discriminative.

Question 80

What is required for ensuring fairness, validity, and reliability in test development?

Answer 80

A well-structured test involves qualitative and quantitative analysis.

Question 81

What is essential for maintaining the test’s accuracy and relevance over time?

Answer 81

Regular review and monitoring.