Adding a test of achievement to compliment your IQ test

Question 1

Structure for this question?

Answer 1

1. Ability vs achievement assessment (Gottfredson & Saklofske, 2005)
2. 3 vital pieces of information about the test that could go into my decision.
3. Conclusion

Question 2

What are the 3 pieces of information I am going to describe in my answer?

Answer 2

1. Culture and experience
2. Standardization
3. Incremental Validity

Question 3

What is the first step

Answer 3

Distinguish between ability and achievement

Question 4

Ability is the X, while achievement is the Y

Answer 4

Ability is the cause, while achievement is the effect

Question 5

What is ability?

Answer 5

Ability refers to a latent construct (i.e., one’s potential) that cannot be directly observed but is relatively stable across time and situations. It represents individual differences in capacities and propensities.

Question 6

What is achievement?

Answer 6

Achievement refers to one’s accomplishments. For example, an intelligence test that is a test of achievement will need to sample the appropriate fund of knowledge that it seeks to test

Question 7

Why would standardization be an important component to consider?

Answer 7

So that I can compare the scores across measures (Strauss)

Question 8

Within standarization, what two things would I be looking for specifically?

Answer 8

I would want the IQ and achievement test to have:

1. Raw scores that were normally distributed in the population to allow for comparison between standard scores
2. been standardized with the same/similar samples to allow for comparison between the standardized scores

Question 9

Why is it important that the raw scores be normally distributed in the population to allow for comparison between standard scores?

Answer 9

Because non-normal population distributions prevent standardized scores from reflecting the actual population rank (Strauss)

Question 10

Why is it important that both tests have been standardized with the same samples?

Answer 10

Because if they are normed on a very different population then you cannot consider the standard score to be representative of your group (consider the 50th percentile score on a memory test normed with university students vs with older adults)

Question 11

Why would incremental validity be an important component to consider?

Answer 11

Because the I would want to know that the addition of the achievement test is improving the prediction of the clinically relevant criterion above and beyond want the IQ test alone is doing (Hunsley, 2003)

Question 12

When is incremental validity particularly important?

Answer 12

When a new scale is created as an addition to an existing multiscale inventory

Question 13

Would I want to look at the incremental validity of the achievement test over alternative measures available to assess the same construct?

Answer 13

Yes

Question 14

In considering incremental validity, I would would want make sure that the data from the IQ and the achievement tests shared minimal method variance - why?

Answer 14

If tests have shared systematic error, then their association will increase, which could look like convergent evidence of validity and increase confidence in judgement

Question 15

In considering incremental validity, I would would want make sure that the data from the IQ and the achievement tests shared minimal method variance. What else would I want to make sure of?

Answer 15

That the achievement test scores were derived from independent sources of information.

Question 16

Why would I want to be sure that the achievement test scores were derived from independent sources of information?

Answer 16

o Accuracy of predictions increases when data sources provide nonredundant information
o Nonoverlapping sources of data are required for improving the accuracy of clinical decisions

Question 17

Why would I need to consider culture and experience in adding the achievement test to my battery?

Answer 17

Because the IQ test score needs to predict achievement in a relevant domain

Question 18

Do test scores have large differences between ethnic and racial groups

Answer 18

Yes, there are o Large differences between ethnic and racial groups on test scores due to differential opportunities and experiences

Question 19

What is it important to consider in tests of achievement?

Answer 19

In tests of achievement, it is important to consider examinee’s opportunities to learn and to sample from their knowledge

e.g., mechanics tests predict achievement in a mechanics course in males, not females (Gottfredson & Saklofske, 2005)