Factor Analysis Flashcards
What is the aim of FA
To reduce a larger set of variables into a smaller set of components
The ‘smaller set of components’ in FA aims to…
Account for most of the variance in the original variables
How is factor analysis done?
By analysing patterns of correlations between variables
Groups of variables that relate highly to each other…
Constitute a factor
What is one type of factor analysis?
Principle components analysis
Difference between PCA and FA?
FA is often used with a smaller set of variables
Idea underlying the PCA equation…
Equation that MAXIMISES the variance accounted for by a component
The second component should be ______ with the first
Uncorrelated
The second component should be uncorrelated with the first, yet still
Accounting for max amount of variance remaining
A Factor loading is…
The correlation between a variable and a component
“The correlation between a variable and a component” - What is this?
Factor loading
What would we do with factor loadings to tell us the variance this component explains over others?
Squaring and summing
Absolute loadings above >.3 are…
Salient and interpreted
Where do we find the factor loadings in SPSS?
Component matrix
The level of correlation considered worthy of a variables inclusion is usually…
> .3
You would examine the correlation matrix to see…
If there are any variables NOT strongly correlated with any other variable
Communalities are…
Proportion of variance in a variable accounted for by EXTRACTED COMPONENTS
If you were to retain all components in the analysis, you will be able to account for all the variance in the variables. Why don’t we just do this?
This not the purpose
Purpose is to explain as much variance as poss whilst using as few variables as poss
Total Variance Explained table…How many components are usually extracted?
Generally only the first few
What is an Eigenvalue?
The measure of VARIANCE accounted for by a COMPONENT
Sum of squared loadings within a component
An Eigenvalue of 1 represents the….
Variance of one variable
Eigenvalues
25 variables represents…
25 eigenvalues
What is the most popular method for choosing COMPONENTS to retain?
Eigen-value one criterion (Kaiser criterion)
What is Kaiser’s criterion recommendation?
Eigenvalue less than 1 should not be retained
Kaiser’s Criterion states that a variable less than one indicates…
That the component explains less than a variable would
How is an Eigenvalue calculate?
Sum of squared loadings within a component