L1: Intro to Psychological Measurement Flashcards
Psychological Construct - Definition
a theoretical & unobservable concept of psychological differences between people
Psychological Test - Definition
measurement instrument to quantify the individual differences in a psychological construct
What are ways in which psychological tests differ? (6)
1) Content
2) Response Required (open ended vs closed)
3) Method of Administration (individual vs group)
4) Use (criterion vs norm referenced)
5) Timing (speed vs power)
6) The meaning of indicators (formative vs reflective)
Criterion Referenced Test - Definition
Test designed to compare test result to predetermined criteria
Norm Referenced Test - Definition
Test designed to compare individual test results to the results of other test-takers
What is an example of a criterion referenced test?
High school exam
What is an example of a norm referenced test?
IQ test
Speed Test - Definition
time limited test where questions are relatively easy, and it is measured how many questions someone answers in a period of time
Power Test - Definition
test with no time limit where items are of different difficulty levels, and it is measured how far of a level of items someone can answer
Reflective Measurement - Definition
- the construct is assumed to be causing the differences in test scores.
- all items are correlated with each other, as higher values of the construct will necessarily also increase scores on all of the test items.
- arrows go construct to item
Formative Measurement - Definition
- the item response defines the construct
- items are not necessarily correlated, as they can all independently contribute to the construct
- arrows go item to construct
List the challenges in psychological measurement (6)
1) Complexity - how can be isolate & measure complex and high-dimensional concepts?
2) Reactivity - people respond differently when they know they are being observed
3) Observer Bias - expectations of the researcher influences the test
4) Composite Scores - does the composite score adequately reflect the construct?
5) Sensitivity - how sensitive should a test scale be?
6) Awareness - many administrators of psychological tests do not know the psychometric qualities of it
Challenge - Reactivity
people tend to respond differently when they know they are being observed
Observer Bias - Definition
the expectations of the researcher have the potential to influence the test
Challenge - Composite Scores
Does the composite score adequately reflect the construct being measured?
Challenge - Test Sensitivity
It is not possible to know beforehand how sensitive a tests scale should be. If you include too few response categories, you miss our on individual differences. If you include too many response categories, you cannot distinguish between different categories
Challenge - Test Awareness
Many test administrators do not know the psychometric properties & qualities of the test they are using
Dimensionality of a test - Definition
the number of constructs that a test measures
Unidimensional Test - Definition
a test that measures 1 construct
Multidimensional Test - Definition
a test that measures multiple constructs
Types of Multidimensional Tests (3)
1) with uncorrelated dimensions
2) with correlated dimensions
3) with higher order factors
What is an example of a multidimensional test with correlated dimensions?
Big-5
What is an example of a multidimensional test with higher order factors?
WAIS-IV
Factor Analysis - Definition
Statistical method to study the dimensionality of a test
Exploratory Factor Analysis - Definition
Factor analysis where there is no preexisting theory about the structure
Confirmatory Factor Analysis - Definition
Factor analysis where there is a preexisting theory about the structure
What are the steps of exploratory factor analysis?
1) Correlation Matrix
2) Check Eigevalues
3) Select a Number of Factors
4) Interpret the Factors
What does a correlation matrix tell you?
A correlation matrix summarises all possible correlations amongst all items of your data
What does the eigenvalue of a factor tell you?
How much of the total variance in the data can be accounted for by that factor
How do you determine how many factors to analyse on the basis of a scree plot?
Using a scree plot, look for the inflection point and select all factors before this point.
Factor Loading - Definition
Shows the correlation between each item and a factor
Simple Factor Structure - Definition
a factor structure where an item is high in one factor and low in all the others (it clearly belongs to one factor)
Orthogonal Rotation - Definition
A transformational system used in factor analysis in which the latent variables/factors are required to remain uncorrelated with one another
What transformation takes place within an orthogonal rotation?
- Factor 1 = X axis
- Factor 2 = Y axis
-The axis is rotated, and you check to see if the individually plotted items are closer to the X or Y axis now
What are types of orthogonal rotations?
- Varimax Rotation
- Quartimax Rotation
- Equamax Rotation
What matrixes are used for orthogonal rotations?
Factor Matrix / Factor Loadings
Oblique Rotation - Definition
A transformational system used in factor analysis when two or more factors are correlated
What are types of oblique rotations?
- Direct Oblimin
- Promax
- Simplimax
What matrixes are used for oblique rotations?
- Pattern Matrix
- Structure Matrix
Which transformation is preferred and why?
Oblique rotations are preferred to orthogonal rotations because they make associations as clear as possible (there is the biggest difference between factors)
What are the pros of using factor scores? (3)
1) Reducing the amount of data you use
2) Advantages over the sum score
3) Avoids multicollinearity
What is the Kaiser Criterion?
Rule for selecting eigenvalues that stipulates that you should select all factors with an eigenvalue greater than one
What is the problem with the Kaiser Criterion?
It likely results in an overestimation of the number of factors
How many test scores are produced for unidimensional tests?
1
How many test scores are produced for multidimensional tests?
1 test score for each individual dimension & higher order factor
Which matrix controls for factor correlations?
Pattern Matrix
Which matrix involves a rotation?
Pattern Matrix
Which matrix shows a more clear simple structure?
Pattern Matrix
In which matrix are factors uncorrelated?
Factor Matrix
In which matrix is there no controlling for factor correlations?
- Structure Matrix
- Factor Matrix
Which matrix does not involve a rotation?
Factor Matrix
