STATS 9 HOMOGENEITY Flashcards

1
Q

Fundamentally, what is test validity?

A

The extent to which the test measures the attribute it is supposed to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define test homogeneity?

A

A test measuring just ONE attribute

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is a (common) Factor?

A

a common cause making all items in a homogeneous test correlate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are factor models?

A

Single factor model - in a homogeneous test, all items score are made up of common factor (true score) and unique factor (error score)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Do unobserved factors have a natural scale?

A

NO, the scale of F is arbitrary, we always set it as a standardised variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is Communality and Uniqueness?

A

Because the common factor and the unique parts are mutually uncorrelated, item variance can be partitioned into variance due to the common factor and unique variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the objectives of factor analysis?

A

To see if a test is homogeneous by “fitting” a common factor model to data, finding a set of factor loadings (coefficients) that would reproduce item scores as close as possible to the observed item scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the basic logic of the scree test? How can we determine the number of factors from the scree plot?

A

Scree tests for homogeneity by seeing if one factor accounts for all shared item variance. Any remaining variance is presumably only unique item variance, so there should be no shared variance left. 1st factor should be high, the rest should be rubble. The number of plots on the scree plot will be equal to the number of factors in the analysis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is validity? How do we know is a scale is valid?

A

Confirmation that the scale is homogeneous paired with a convincing conceptual (not statistical) analysis!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Why can’t the coefficient alpha be used to establish scale homogeneity?

A

Cronbach’s Alpha is NOT a measure of test homogeneity! Alpha is an estimate of RELIABILITY that ASSUMES tests are homogeneous!!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Should the common factor and unique parts be correlated?

A

No! The common and unique parts of a factor must be uncorrelated! OTHERWISE IT WOULD NOT BE HOMOGENEOUS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does a score of 0 represent in a factor scale?

A

Exactly average!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is standardised factor loading?

A

Standardised factor loading is the correlation between the factor and the item

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How can we interpret a scree test?

A

The first Eigenvalue should be much larger than the second, etc. We can interpret this as meaning the first factor is the only important factor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Why do we want small residuals when doing factor analysis?

A

Means our factor models explain the variance! / Our predictions are accurate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the marker item in factor loadings?

A

The item that correlates with the factor most strongly