Factor Analysis Flashcards

1
Q

What is the aim of FA

A

To reduce a larger set of variables into a smaller set of components

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

The ‘smaller set of components’ in FA aims to…

A

Account for most of the variance in the original variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How is factor analysis done?

A

By analysing patterns of correlations between variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Groups of variables that relate highly to each other…

A

Constitute a factor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is one type of factor analysis?

A

Principle components analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Difference between PCA and FA?

A

FA is often used with a smaller set of variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Idea underlying the PCA equation…

A

Equation that MAXIMISES the variance accounted for by a component

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The second component should be ______ with the first

A

Uncorrelated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

The second component should be uncorrelated with the first, yet still

A

Accounting for max amount of variance remaining

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

A Factor loading is…

A

The correlation between a variable and a component

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

“The correlation between a variable and a component” - What is this?

A

Factor loading

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What would we do with factor loadings to tell us the variance this component explains over others?

A

Squaring and summing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Absolute loadings above >.3 are…

A

Salient and interpreted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Where do we find the factor loadings in SPSS?

A

Component matrix

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

The level of correlation considered worthy of a variables inclusion is usually…

A

> .3

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

You would examine the correlation matrix to see…

A

If there are any variables NOT strongly correlated with any other variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Communalities are…

A

Proportion of variance in a variable accounted for by EXTRACTED COMPONENTS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

If you were to retain all components in the analysis, you will be able to account for all the variance in the variables. Why don’t we just do this?

A

This not the purpose

Purpose is to explain as much variance as poss whilst using as few variables as poss

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Total Variance Explained table…How many components are usually extracted?

A

Generally only the first few

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is an Eigenvalue?

A

The measure of VARIANCE accounted for by a COMPONENT

Sum of squared loadings within a component

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

An Eigenvalue of 1 represents the….

A

Variance of one variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Eigenvalues

25 variables represents…

A

25 eigenvalues

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the most popular method for choosing COMPONENTS to retain?

A

Eigen-value one criterion (Kaiser criterion)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is Kaiser’s criterion recommendation?

A

Eigenvalue less than 1 should not be retained

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Kaiser's Criterion states that a variable less than one indicates...
That the component explains less than a variable would
26
How is an Eigenvalue calculate?
Sum of squared loadings within a component
27
Eigenvalues range between...
0-total number of components
28
An Eigenvalue larger than ____ is GOOD
1
29
An Eigenvalue larger than 1 indicates the factor...
Should be selected
30
A communality of ____ suggests that the variable is _______ and should be _______
< .3 Unreliable Removed
31
Aside from Kaiser's Criterion, what else can we use to decide which components to keep?
Scree plot
32
What does a scree plot tell us
Total variance explained by each component against its respective component
33
Scree plot How do we know which components to retain
Those before last inflection point
34
Scree plot The inflection point represents
The point at which the graph begins to level out | Subsequent components add little
35
"The point at which the graph begins to level out Subsequent components add little" What does this description refer to?
Inflection point
36
A scree plot is another way of...
Deciding which components to keep/remove
37
The first Factor Loading matrix SPSS will display is...
Unrotated
38
What is one way of visualising the clusters of variables that form the components?
Plot variables in a factor space
39
Our ideal result would be where each variable loads uniquely onto...
ONE COMPONENT ONLY
40
Our ideal result would be where each variable loads uniquely onto one component only. However, what do we often find?
Cross-loading
41
Two ways of solving cross-loading?
Orthogonal/oblique rotation
42
What is orthogonal rotation?
Where we rotate the axis to fit the data we've got
43
What is the difference between orthogonal and oblique rotation?
Oblique moves through each axes independently until they go through items
44
Why are orthogonal/oblique rotations used?
- Solves cross-loading | - Makes interpretation easier
45
6 STEPS OF FACTOR ANALYSIS
``` a) Matrix of Correlations B) Extract factors (Kaiser's) & Scree plot C) Examine FLs and communalities D) Do factors need rotating E) Check FLs again ```
46
A PCA can be used to solve three major problems...
a) Removing unrelated variables b) Reducing redundancy c) Removing multicollinearity
47
What is multicollinearity
Two or more variables that are highly correlated
48
"Two or more variables that are highly correlated " Whats this
Multicollinearity
49
What does 'redundancy' refer to
Some of the variables are measuring the SAME UNDERLYING CONSTRUCT (not what you want)
50
What do we look at: SPSS
M of Correlations Communalities Eigenvalues Factor loadings
51
Orthogonal rotation can sometimes create factors that are _______ or ________ with each other
Correlated | Uncorrelated
52
The proportion of variance each variable explains in the principle (extracted) components What is this describing
Communalities
53
Comment on Factor Loadings All items load highly onto the first component. Only some items load highly (both positively and negatively) onto the second factor. Does this indicate a simple factor structure?
No - they need to be rotated
54
Factor loadings are the
Correlation between variable and component
55
"Correlation between a variable and a COMPONENT" What is this
Factor loadings
56
Communalities What is the cut-off for removal
.3
57
If there are 2 components making up the component matrix, this tells us...
2 components have been extracted
58
Orthogonal rotation keeps the axes at ______ ________, whereas Oblique does not
Right angles
59
How do you decide if it is complex structure when there are 3 components?
If there are items that load highly onto more than 1 component
60
Inspection of the commonalities revealed that the two factors accounted for (>.30)
Sufficient amount of variance in all items
61
Inspection of the commonalities revealed that the two factors accounted for sufficient amounts of variance in all items (>.30), indicating that
All items were reliable
62
The rotated factor loadings were plotted, which confirmed the clear
X factor structure
63
Write-up Inspection of the FL's indicated that all items loaded strongly (>.40) on both factors. The factor loadings were therefore
Plotted
64
Write-up The unrotated factor loadings were then plotted which indicated
The factors should be subjected to rotation
65
Write-up The rotated factor loadings were also plotted, which
Confirmed a clear two-factor structure
66
Write-up Inspection of the commonalities revealed that the two factors accounted for
Sufficient amounts of variance in the items (>.30)