Factor Analysis Flashcards
what is factor analysis?
looking at the structure of a concept using data and simplying seeing if there’s any structure between variables
what is the importance of the structure?
should be psychologically meaningful
how do we conduct factor analysis?
take lots of data on different variables, look for a specific pattern and see if you can simply it down to one or two psychological meaningful elements which have the underlying structure of the concept
what is the definition of factor analysis?
powerful tool when you want to simplify complex data, find hidden patterns, and set the stage for deeper, more focused analysis
what is an example of a test using factor analysis?
WAIS-R -> measuring general intelligence
what do we want to figure out with tests like WAIS-R?
- what the underlying structure of these tests
- what the actual structure is when we look at the data underneath -> having psychologically meaningful elements that underline a score
what is factor analysis about?
simplification
* structure beneath two variables -> breaking it down into 1 or 2 meaningful psychological elements
what does orthogonal mean?
people can vary along them independently
(variation on one does not affect the variation on the other -> factors are uncorrelated and not related to each other)
elements of analysis
- need a way to diagnose or find a structure underlying the data -> extract dimensions (or factors) from the data set
- need a way of representing the structural elements within the analysis which allows us to make decisions into whether they are important or not -> need to be able to make judgments about the factors and relate it back to the individual item’s we’ve got (need to see how the individual elements we have relate to the structure)
- some form of structural element that represent these factors
what does analysis allow us to do?
- allows us to make judgements about the factors
- information about how the individual item, score etc. relate to the structural dimension/factors
- how much each item relate to the structural element
how should we extract dimensions (or factors) from data set?
using principle component analysis (incl rotation)
what are sone structural events that represent these factors (allowing us to make judgement about them)
eigenvectors and values
what are factor loading?
information about how the individual items, scores etc. relate to structural factor
what is principal component analysis (PCA)?
- takes a cloud of data points and finds the ‘principal axes’ of that cloud -> which are at right angles to each other
what does PCA allow you to find?
factors (structure) in factor analysis
* PCA is a way of doing factor analysis
* principal axis underlie our data
* a way in which we extract structure from a cloud of data
what are principal components sometimes called?
eigenvectors (with associated eigenvalues)
PCA
a dimensionality reduction method that is often used to reduce the dimensionality of large data sets, by transforming a large set of variables into a smaller one that still contains most of the information in the large set.
what are eigenvectors?
a mathematical foundation of the factors / components
what does each eigenvector have?
an eigenvalue
what is an eigenvalue?
tells you how important each individual eigenvector (representation of the factors) is and therefore how important each factor is
how do we use the eigenvalues?
- values tell you which factors are important
which eigenvectors can we ignore?
those with small eigenvalues (as they’re pointless)
which eigenvectors should we not ignore?
eigenvalues which are big/large as they are important/explain a lot of the variation (because of how strong they are)
-> will give you a graph like a positive correlation instead of no correlation
which two methods can we use to know which factors are important?
Kaiser’s Extraction and Screeplot