Basic Assumptions About Psychological Testing and Assessment

Question 1

What is Assumption 1?

Answer 1

Psychological Traits and States Exists

Question 2

Distinguishable, relatively enduring way in which an individual differs from another

Answer 2

Trait

Question 3

Distinguishes a person from another but is less enduring

Answer 3

State

Question 4

Based on observing a sample of Behavior

Answer 4

Trait and the magnitude of the trait

Question 5

ways to observe/measure

Answer 5

• Direct Observation
• Analysis of Self-Report Statements
• Pencil-or-Paper Tests

Question 6

Psychological Traits:

Answer 6

• Intelligence
• Specific Intellectual Abilities
• Cognitive Style
• Adjustment
• Specific Personality Traits

Question 7

Some people deny that traits exist and there is
a controversy how they exist

Answer 7

true

Question 8

informed, scientific concept developed or constructed to describe or explain behavior

Answer 8

Construct

Question 9

What is Assumption 2?

Answer 9

Psychological Traits and States can be Quantified and Measured

Question 10

Develop items that provides _____ to the trait

Answer 10

insight

Question 11

Develop appropriate test items and appropriate way to _____ the items

Answer 11

score

Question 12

method of scoring whereby points or scores accumulated on individual items or subtests are tallied, and the higher the total sum, the higher the individual is presumed to be on the ability, trait, or other characteristic being measured

Answer 12

Cumulative Scoring

Question 13

What is Assumption 3

Answer 13

Test-Related Behavior Predicts Non-Test-Related Behavior

Question 14

tasks in some tests _____the actual behaviors that the test user is attempting to understand

Answer 14

mimic

Question 15

tests yield only a sample of the behavior that can be expected to be emitted under contest conditions –

Answer 15

Predict or postdict

Question 16

To estimate or suppose something which took place in past; to conjecture something that occurred beforehand.

Answer 16

Postdict

Question 17

say or estimate that (a specified thing) will happen in the future or will be a consequence of something

Answer 17

predict

Question 18

What is Assumption 4?

Answer 18

Tests and Other Measurement Technique Have Strengths and Weaknesses

Question 19

strength and weakness can be based on:

Answer 19

• how a test was developed
• the circumstances under which it is appropriate to administer the test
• how the test should be administered
• to whom
• how the test results should be interpreted
• limitation

Question 20

What is Assumption 5?

Answer 20

Various Sources of Error are Part of the Assessment Process

Question 21

mistake, miscalculation, etc. – In assessment: more that what is expected

Answer 21

Error

Question 22

the component of a test score attributable to sources other than the trait or ability measured

Answer 22

Error Variance

Question 23

What is Assumption 6?

Answer 23

Testing and Assessment Can be Conducted in a Fair & Unbiased Manner Assumption

Question 24

What is Assumption 7?

Answer 24

Testing and Assessment Benefit Society

Question 25

The raw score (X) obtained by any individual is made up of a true component/true score (T) and a random error (E) component

Answer 25

Classical Test Theory

Question 26

Formula for Classical Test Theory

Answer 26

X = T + A

Question 27

Assumes that the items selected for any one test are just sample of items from an infinite domain of potential items

Answer 27

Domain Sampling Theory

Question 28

Domain sampling is the most common CTT used for...

Answer 28

practical purposes

Question 29

Concerns of CTTs is to __ with random error of the raw score

Answer 29

cope

Question 30

The less random error in the measure, the more the raw score reflects the...

Answer 30

true score

Question 31

Assumptions of the Theory of True & Error Scores

Answer 31

– The raw score is made up of the true score plus random error (𝑋 = 𝑇 + 𝐸); the average of raw scores is the best estimate of the true score – Random errors around the true score would be normally distributed; the expected value of error = 0 – Random errors are uncorrelated – Random errors are uncorrelated to the T

Question 32

is consistent across an entire population

Answer 32

SEM

Question 33

As the test become longer, it becomes increasingly...

Answer 33

reliable

Question 34

The important statistics about test items (i.e. difficulty) is dependent on the sample of respondents being representative of the population

Answer 34

true

Question 35

Scores in the population are assumed to be

Answer 35

– A) measured at the interval level – B) normally distributed – When these are not met, Test Developers convert scores, combine scales, and others to ensure the assumption is met

Question 36

When item responses change, the properties of a test does not change

Answer 36

false

Question 37

Developed to address the shortcomings and limitations of the CTT

Answer 37

Item Response Theory (IRT)

Question 37

Who developed IRT

Answer 37

Lord and Novik (1968)

Question 38

CTT focus is on the pattern of responses the respondent makes to the set of items

Answer 38

no, this is IRT

Question 39

In IRT, it does not assume that all items are parallel

Answer 39

true

Question 40

CTT focus is on the single score that one obtains on the test

Answer 40

true

Question 41

In IRT, all items are treaterd as though they are parallel

Answer 41

false, this is CTT

Question 42

_______ there is a linkage between a response to any item on a test and the characteristic being assessed by the test.

Answer 42

Fundamental assumption:

Question 44

Characteristic is a latent trait

Answer 44

true

Question 45

Linkage is the probability of a negative response to any single item on a test is a function of the individual’s level

Answer 45

false, it is postive response

Question 46

Critical feature that is analyzed in IRT is the entire pattern of item responses to all test items by an individual.

Answer 46

true

Question 47

If IRT: Pattern of Item Responses; then CTT:___

Answer 47

Raw Scores of the Test

Question 48

IRT: _____

Answer 48

Assessment of Measurement Error at any level of

Question 49

CTT:

Answer 49

Measurement Error is the same at every level of the test score