PSYCHOMETRICS Flashcards

1
Q

Define Psychometrics

A

measurement of theory and test applications of quantitative assessment of psychological constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why are psychometric important?

A
  1. Indirect assessment and development of latent attributes
  2. used to make important decisions
  3. best, fairest, economical method
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define psychological measurement

A

Process of assigning numbers to a person

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Limitations of psychological tests

A
  1. Precision & Accuracy
  2. Single psychological attribute
  3. assumes psychological constructs real and exist
  4. Psychological numbers can be represented by numbers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is sampling?

A

Selecting to observe a part of target population, estimate characteristics of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Representativeness of sample

A

How representative of the sample of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Biasedness

A

Degree of systematic/random error of sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Psychological test score

A

Generating single numerical value, quantitative representation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Objective scoring

A

standardised questionnaires

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Subjective scoring

A

Assessor judgement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Standardisation

A

Process of transforming scale to universal indexes (IQ)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Reasons for Standardising

A
  1. Makes it easier to compare

2. Generations of population norms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Use of Standardising

A
  1. Records population attributes

2. Compare individual attributes to population levels.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Z-scores

A

z = x-u/o

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is validity?

A

Degree to which test measures what it claims to measure. appropriateness, usefulness, meaningfulness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Construct validity?

A

Degree to which constructs possess sound theoretical foundation. operationalisation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Convergence validity?

A

High correlation with items/tests that measure the same/related constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Divergent validity?

A

Low correlation with items/tests that assess unrelated constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Criterion validity?

A

Degree of correlation with one or more parallel or outcome criteria. correlation coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

concurrent validity?

A

criterion is present

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

predictive validity?

A

criterion is future

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

internal validity?

A

confidence in causal relationships between measured constructs

23
Q

external validity?

A

valid construct across different settings (time, age, populations)

24
Q

content validity?

A

scores represent the content area they claim to (e.g. content of a final should be representation of learned content)

25
Q

problems with validity?

A
  1. psychological constructs are abstract and latent
  2. reality of psychological world – can’t be valid/invalid
  3. what is meaningful/useful can change
26
Q

what is reliability?

A

degree of consistency or stability of measurement across time and context. how well does measurement assess claim?

27
Q

What is classical test theory?

A
X = T + E (true score + error) 
reliability index (r) = varianceT/varianceX
28
Q

Issues with CTT

A
  1. True scores – temporal score instability & chance fluctuations
  2. Systematic error
29
Q

Individual error sources

A
  1. Idiosyncratic - language, mood, fatigue

2. Generic - faking, random responses

30
Q

Item error sources

A
  1. content related - lack of clarity
  2. format related - biases
  3. admin related - distracting settings
31
Q

internal consistency reliability

A

degree of consistency in response to scale items of same construct. cronbach alpha

32
Q

cronbach alpha cut-offs

A

conservative 0.8 liberal 0.6

33
Q

test-retest reliability

A

assess stability of test scores over time. usually take the test at least 2 diff times

34
Q

issues with test-retest

A
  1. drop-outs/non-response bias
  2. temporal instability of constructs
  3. optimal time-interval
35
Q

inter-rater reliability

A

reliability based on 2+ independent judges who rate the items

36
Q

standard error of measurement

A

average degree of random error

37
Q

what is confidence interval

A

CI is range of observed scores within which the true score is expected to lie

38
Q

What is factor analysis?

A

FA is referred to advanced multivariate statistics which help uncover latent structure/construct from a set of observed attributes

39
Q

FA used for?

A
  1. condense large number into smaller latent constructs

2. holistic assessment tool

40
Q

what is item in FA

A

observed measured element of attribute

41
Q

what is factor/component in FA

A

latent dimension (construct) made up of related items

42
Q

Factor loading?

A

Statistical relationship between factor and item. > |0.4| is considered good

43
Q

When is factor considered potentially meaningful?

A

the items loaded need to be related quantitatively and qualitatively

44
Q

major FA types (3)

A
  1. CFA (confirm or validate already hypothesised construct)
  2. EFA (exploratory, identify possible construct)
  3. PCA (principal components; assumes all variance can be explained by same latent structure)
45
Q

What is orthogonal factors

A

dimensions independent from each other e.g. neuroticism and extraversion

46
Q

what is oblique factors

A

dimensions related to each other e.g. Gf and Gc factors of intelligence

47
Q

factorability?

A

suitability of item to be included in FA model

48
Q

simple structure?

A

items form distinct factors or spatial clustered, based on degree of associations

49
Q

rotation?

A

geometric transformation to generate model that contains simpler structure

50
Q

varimax rotation?

A

orthogonal rotation - rotate unrelated, maximises the variance

51
Q

oblimin rotation?

A

oblique rotation, more related factors

52
Q

Kaiser criterion?

A

retain any factor with eigenvalue of greater or equal to 1

53
Q

Scree plot rule

A
variance explained rule (retain all 80-90% total variance)
comprehensibility rule (retain all that are clearly interpretable
54
Q

applications for psychometric knowledge

A
  1. criminal/clinical profiling

2. psychobiography/psychohistory