Week 3

Question 1

Overarching theory of psychometric theory

Answer 1

Is classical testing theory

Question 2

Classical testing theory

Answer 2

X is equal to t plus e
X (observed score), t (true score), e (error)

Question 3

Content analysis

Answer 3

Getting content from individuals who are actually affected by the product you are showing

Question 4

Critical incidents

Answer 4

Interviewing individuals about the Katrina hurricane, listening to the responses people saying there is not enough canned goods, these types of interviews can be helpful to future incidents

Question 5

Direct observations

Answer 5

Directing peoples behavior

Question 6

Step 2: Identifying behaviors that represent a construct

Answer 6

Content analysis, critical incidents, direct observation & expert judgments

Question 7

Step 3 preparing the test specifications

Answer 7

Need to develop specific sub-areas that make up the larger construct and test developer needs to assign weights to each sub-area

Question 8

Step 4- item construction

Answer 8

Select an item format that is feasible for the intended examinees and need to write appropriate items-also consider how long you want the test to be in terms of time

Question 9

Aptitude and achievement test use what type of answer choices

Answer 9

Use true or false, multiple choice and matching

Question 10

Attitude and personality traits answer choices

Answer 10

Agree-disagree, likert format, bipolar checklist

Question 11

Step 1 identifying the purpose of the test

Answer 11

Need to identify both the material to be tested and for whom you are developing the test

Question 12

Step 5 item review

Answer 12

Experts review items for accuracy grammar, appropriateness to the construct

Question 13

Step 6 preliminary item piloting

Answer 13

Give test out a small group and debrief about test to determine points of difficulty

Question 14

True score

Answer 14

Testing someone an infinite number of times

Question 15

Two types of error

Answer 15

Random and systematic error

Question 16

Random error

Answer 16

It doesn’t happen the same every time. Any error due to chance

Question 17

What is chance based on?

Answer 17

Probability, which is based on infinity

Question 18

Systematic error

Answer 18

Any error that reoccurs repeatedly based on the characteristic of the person being tested

Question 19

Person R correlation

Answer 19

Association between two variables that are measured on interval and continuous scales

Question 20

Variance

Answer 20

Variability (area)

Question 21

Anything with an exponent its root is always

Answer 21

Variance =X^2

Question 22

Non dichotomous scoring system variance

Answer 22

(X1-X)^2 + (X2-X)^2+…. Divided by N

Question 23

Correlations matrix

Answer 23

Shows how related the items are to one another
0-.3 weak, .4-.6 moderate & .7 and above strong correlation

Question 24

Variance item for dichotomous

Answer 24

Item mean times (1-item mean)

Question 25

Phi formula

Answer 25

2 variables association on a categorical or nominal scale

Question 26

Phi coefficient goes from what numbers

Answer 26

0 to 1

Question 27

Phi formula actual formula

Answer 27

bc-ad divided by the square root of (a+b)x(a+c)x(c+d)+(b+d)

Question 28

Which items go first on the phi formula

Answer 28

The lower number item always goes on top of the box and the higher number item goes on the left side

Question 29

Where do you look when beginning the phi formula?

Answer 29

Make a square and look for the raw scores for the items compare them to one another and plug them into the formula

Question 30

Item quality

Answer 30

Determining how good an item is and if we need to take them out, look at which items have better quality

Question 31

Is the scale project non dichotomous?

Answer 31

Yes

Question 32

Dichotomous response formats

Answer 32

Look at aptitude/achievement, either wrong or right answer, looks at variance, mean, phi coefficient, variance and covariance matrix

Question 33

Non dichotomous response format

Answer 33

Attitude/personality, likert scale, look at mean, variance & correlation matrix

Question 34

Non dichotomous variance you want items to be

Answer 34

Higher variance are better quality items! If you want to capture trait you need higher variance/variability

Question 35

How do we determine a non dichotomous item to be appropriate?

Answer 35

The way we determine the item is appropriate if the mean is closest to the midpoint on a scale

Question 36

Mean

Answer 36

Average responding for your sample for that item and denotes strength of sentiment

Question 37

Variance related to standard deviation

Answer 37

Standard deviation ^2 is variance

Question 38

Mean for dichotomous

Answer 38

The higher the mean the easier the question, the lower the mean the more difficult the question

Question 39

Variance in dichotomous

Answer 39

There should be low variance between groups because there are only 2 options, we do not want variability we want similar variance scores, variance should be closest to zero

Question 40

Do the negatives matter in variance-covariance matrix item scores?

Answer 40

The negative does not have a qualifier here

Question 41

Covariance

Answer 41

How the items vary with each other

Question 42

Two types of scoring

Answer 42

Dichotomous & Non-dichotomous