Week 12: More advanced Methods - Factor Analysis Flashcards
Factor analysis -
involves grouping similar variables into dimension / factors
T/F Multiple variables can be grouped into a couple of factors and a couple of factors pre defined and the relationship to the multiple variables can be tested
True
T/F Factor analysis is quite different from any of the statistical procedures that use data for comparison or prediction
True
Factor analysis is most commonly used in what approach?
an exploratory approach to data analysis (Exploratory Factor Analysis; EFA)
Exploratory Factor analysis is good for what 2 things?
- good to examine the structure within a large number of variables
- good to explain the nature of their interrelationships
Factor analysis can also be used in what way?
also a confirmatory manner to data analysis (Confirmatory Factor Analysis; CFA)
Confirmatory Factor Analysis is used in what two ways?
- used to verify the factor structure of a set of observed variables
- used to test the hypothesis that a relationship between observed variables and their underlying latent constructs exists
T/F Factor analysis is more controversial than other analytic methods leaving room for subjectivity and judgment
True
What method is crucial to provide structure to data sets with multiple observed variables?
Multivariate analysis
EFA is a factor analysis used to do what?
- explore the possible underlying factor structure of a set of observed variables without imposing a predefined structure of the outcome
- identify the underlying factor structure
- describe and identify the number of factors
What are 3 goals of EFA?
- to determine the number of latent constructs underlying a set of variables
- to provide a means of explaining variation among variables using a few newly created factors
- to define the content of meaning of factors
3 Assumptions underlying EFA?
- continuous level of measurement with normal distribution
- sample size should be large enough more than 200 and 5 observations per variable
- correlation > 0.3 between the variables
Limitations of EFA?
- variables could be sample specific, not generalizable
- non-normal distribution of data
- sample size larger than the required is desirable to accommodate the possible missing data
- No causal inferences can be made from correlations alone
CFA is a factor analysis used to do what?
test the hypothesis that there exists a relationship between the observed variables and their underlying latent constructs
CFA procedure:
- review the relevant theory and research literature to support model specification
- specify a model
- collect data
- assess model fit by
- hypothesis testing
- fit indices look up
e. g.) CFI (Confirmatory Factor Index)
Limitations of CFA:
- sample size required to be sufficiently large
- multivariate normality
- outliers
- missing data
What happens if an unacceptable model fit is found in CFA?
an EFA can be performed to identify the underlying factor structure, describe and identify the number of factors
When developing factors, what is a factor loading?
the coefficient as a measure of the correlation between the individual variable and the overall factor
Criteria for significance of factor loadings (FL) when developing factors:
FL > 0.3: minimum consideration
FL > 0.4: more important
FL > 0.5: practically significant
How do you perform extraction of factors?
Pull out only the components using a cutoff point where value at least 1
What is rotation of factors?
a process of developing a unique statistical solution so that each variable relates highly to only one factor
After rotation of factors, what do you do?
Naming factors
3 Limitations of factor analysis:
- Be cautious about how ‘factors’ are interpreted they are not real measurement entities only hypothetical statistical concepts giving factor a name doesn’t make it real
- Data may be organized differently by using different extraction or rotation methods these differences can alter a factor’s essential meaning
- The generated factors may be totally uninterpretable within the framework of the research question
T/F The application of factor analysis involves grouping similar variables into factors
True
What type of analysis is used to explore the possible underlying factor structure of a set of observed variables without imposing a predefined structure of the outcome?
Exploratory factor analysis (EFA)
What type of analysis is used used to test the hypothesis that there exists a relationship between the observed variables and their underlying latent constructs?
Confirmatory factor analysis (CFA)
What are the steps of of an exploratory factor analysis ?
- developing factors
- extracting factors
- rotating factors
- naming factors
Limitations of factor analysis stem from what?
subjectivity and judgmental nature in decisions:
- factors are not real measurement entities only being hypothetical statistical concepts
- the resulting data structure is subject to different selection of extraction or rotation methods
- the generated factors may be totally uninterpretable within the framework of the research question