L1: Intro to Psychological Measurement Flashcards

1
Q

Psychological Construct - Definition

A

a theoretical & unobservable concept of psychological differences between people

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Psychological Test - Definition

A

measurement instrument to quantify the individual differences in a psychological construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are ways in which psychological tests differ? (6)

A

1) Content
2) Response Required (open ended vs closed)
3) Method of Administration (individual vs group)
4) Use (criterion vs norm referenced)
5) Timing (speed vs power)
6) The meaning of indicators (formative vs reflective)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Criterion Referenced Test - Definition

A

Test designed to compare test result to predetermined criteria

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Norm Referenced Test - Definition

A

Test designed to compare individual test results to the results of other test-takers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is an example of a criterion referenced test?

A

High school exam

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is an example of a norm referenced test?

A

IQ test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Speed Test - Definition

A

time limited test where questions are relatively easy, and it is measured how many questions someone answers in a period of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Power Test - Definition

A

test with no time limit where items are of different difficulty levels, and it is measured how far of a level of items someone can answer

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Reflective Measurement - Definition

A
  • the construct is assumed to be causing the differences in test scores.
  • all items are correlated with each other, as higher values of the construct will necessarily also increase scores on all of the test items.
  • arrows go construct to item
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Formative Measurement - Definition

A
  • the item response defines the construct
  • items are not necessarily correlated, as they can all independently contribute to the construct
  • arrows go item to construct
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

List the challenges in psychological measurement (6)

A

1) Complexity - how can be isolate & measure complex and high-dimensional concepts?
2) Reactivity - people respond differently when they know they are being observed
3) Observer Bias - expectations of the researcher influences the test
4) Composite Scores - does the composite score adequately reflect the construct?
5) Sensitivity - how sensitive should a test scale be?
6) Awareness - many administrators of psychological tests do not know the psychometric qualities of it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Challenge - Reactivity

A

people tend to respond differently when they know they are being observed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Observer Bias - Definition

A

the expectations of the researcher have the potential to influence the test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Challenge - Composite Scores

A

Does the composite score adequately reflect the construct being measured?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Challenge - Test Sensitivity

A

It is not possible to know beforehand how sensitive a tests scale should be. If you include too few response categories, you miss our on individual differences. If you include too many response categories, you cannot distinguish between different categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Challenge - Test Awareness

A

Many test administrators do not know the psychometric properties & qualities of the test they are using

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Dimensionality of a test - Definition

A

the number of constructs that a test measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Unidimensional Test - Definition

A

a test that measures 1 construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Multidimensional Test - Definition

A

a test that measures multiple constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Types of Multidimensional Tests (3)

A

1) with uncorrelated dimensions
2) with correlated dimensions
3) with higher order factors

22
Q

What is an example of a multidimensional test with correlated dimensions?

A

Big-5

23
Q

What is an example of a multidimensional test with higher order factors?

A

WAIS-IV

24
Q

Factor Analysis - Definition

A

Statistical method to study the dimensionality of a test

25
Q

Exploratory Factor Analysis - Definition

A

Factor analysis where there is no preexisting theory about the structure

26
Q

Confirmatory Factor Analysis - Definition

A

Factor analysis where there is a preexisting theory about the structure

27
Q

What are the steps of exploratory factor analysis?

A

1) Correlation Matrix
2) Check Eigevalues
3) Select a Number of Factors
4) Interpret the Factors

28
Q

What does a correlation matrix tell you?

A

A correlation matrix summarises all possible correlations amongst all items of your data

29
Q

What does the eigenvalue of a factor tell you?

A

How much of the total variance in the data can be accounted for by that factor

30
Q

How do you determine how many factors to analyse on the basis of a scree plot?

A

Using a scree plot, look for the inflection point and select all factors before this point.

31
Q

Factor Loading - Definition

A

Shows the correlation between each item and a factor

32
Q

Simple Factor Structure - Definition

A

a factor structure where an item is high in one factor and low in all the others (it clearly belongs to one factor)

33
Q

Orthogonal Rotation - Definition

A

A transformational system used in factor analysis in which the latent variables/factors are required to remain uncorrelated with one another

34
Q

What transformation takes place within an orthogonal rotation?

A
  • Factor 1 = X axis
  • Factor 2 = Y axis
    -The axis is rotated, and you check to see if the individually plotted items are closer to the X or Y axis now
35
Q

What are types of orthogonal rotations?

A
  • Varimax Rotation
  • Quartimax Rotation
  • Equamax Rotation
36
Q

What matrixes are used for orthogonal rotations?

A

Factor Matrix / Factor Loadings

37
Q

Oblique Rotation - Definition

A

A transformational system used in factor analysis when two or more factors are correlated

38
Q

What are types of oblique rotations?

A
  • Direct Oblimin
  • Promax
  • Simplimax
39
Q

What matrixes are used for oblique rotations?

A
  • Pattern Matrix
  • Structure Matrix
40
Q

Which transformation is preferred and why?

A

Oblique rotations are preferred to orthogonal rotations because they make associations as clear as possible (there is the biggest difference between factors)

41
Q

What are the pros of using factor scores? (3)

A

1) Reducing the amount of data you use
2) Advantages over the sum score
3) Avoids multicollinearity

42
Q

What is the Kaiser Criterion?

A

Rule for selecting eigenvalues that stipulates that you should select all factors with an eigenvalue greater than one

43
Q

What is the problem with the Kaiser Criterion?

A

It likely results in an overestimation of the number of factors

44
Q

How many test scores are produced for unidimensional tests?

A

1

45
Q

How many test scores are produced for multidimensional tests?

A

1 test score for each individual dimension & higher order factor

46
Q

Which matrix controls for factor correlations?

A

Pattern Matrix

47
Q

Which matrix involves a rotation?

A

Pattern Matrix

48
Q

Which matrix shows a more clear simple structure?

A

Pattern Matrix

49
Q

In which matrix are factors uncorrelated?

A

Factor Matrix

50
Q

In which matrix is there no controlling for factor correlations?

A
  • Structure Matrix
  • Factor Matrix
51
Q

Which matrix does not involve a rotation?

A

Factor Matrix