PSYCHOMETRICS Flashcards

1
Q

Define Psychometrics

A

measurement of theory and test applications of quantitative assessment of psychological constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why are psychometric important?

A
  1. Indirect assessment and development of latent attributes
  2. used to make important decisions
  3. best, fairest, economical method
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define psychological measurement

A

Process of assigning numbers to a person

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Limitations of psychological tests

A
  1. Precision & Accuracy
  2. Single psychological attribute
  3. assumes psychological constructs real and exist
  4. Psychological numbers can be represented by numbers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is sampling?

A

Selecting to observe a part of target population, estimate characteristics of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Representativeness of sample

A

How representative of the sample of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Biasedness

A

Degree of systematic/random error of sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Psychological test score

A

Generating single numerical value, quantitative representation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Objective scoring

A

standardised questionnaires

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Subjective scoring

A

Assessor judgement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Standardisation

A

Process of transforming scale to universal indexes (IQ)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Reasons for Standardising

A
  1. Makes it easier to compare

2. Generations of population norms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Use of Standardising

A
  1. Records population attributes

2. Compare individual attributes to population levels.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Z-scores

A

z = x-u/o

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is validity?

A

Degree to which test measures what it claims to measure. appropriateness, usefulness, meaningfulness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Construct validity?

A

Degree to which constructs possess sound theoretical foundation. operationalisation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Convergence validity?

A

High correlation with items/tests that measure the same/related constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Divergent validity?

A

Low correlation with items/tests that assess unrelated constructs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Criterion validity?

A

Degree of correlation with one or more parallel or outcome criteria. correlation coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

concurrent validity?

A

criterion is present

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

predictive validity?

A

criterion is future

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

internal validity?

A

confidence in causal relationships between measured constructs

23
Q

external validity?

A

valid construct across different settings (time, age, populations)

24
Q

content validity?

A

scores represent the content area they claim to (e.g. content of a final should be representation of learned content)

25
problems with validity?
1. psychological constructs are abstract and latent 2. reality of psychological world -- can't be valid/invalid 3. what is meaningful/useful can change
26
what is reliability?
degree of consistency or stability of measurement across time and context. how well does measurement assess claim?
27
What is classical test theory?
``` X = T + E (true score + error) reliability index (r) = varianceT/varianceX ```
28
Issues with CTT
1. True scores -- temporal score instability & chance fluctuations 2. Systematic error
29
Individual error sources
1. Idiosyncratic - language, mood, fatigue | 2. Generic - faking, random responses
30
Item error sources
1. content related - lack of clarity 2. format related - biases 3. admin related - distracting settings
31
internal consistency reliability
degree of consistency in response to scale items of same construct. cronbach alpha
32
cronbach alpha cut-offs
conservative 0.8 liberal 0.6
33
test-retest reliability
assess stability of test scores over time. usually take the test at least 2 diff times
34
issues with test-retest
1. drop-outs/non-response bias 2. temporal instability of constructs 3. optimal time-interval
35
inter-rater reliability
reliability based on 2+ independent judges who rate the items
36
standard error of measurement
average degree of random error
37
what is confidence interval
CI is range of observed scores within which the true score is expected to lie
38
What is factor analysis?
FA is referred to advanced multivariate statistics which help uncover latent structure/construct from a set of observed attributes
39
FA used for?
1. condense large number into smaller latent constructs | 2. holistic assessment tool
40
what is item in FA
observed measured element of attribute
41
what is factor/component in FA
latent dimension (construct) made up of related items
42
Factor loading?
Statistical relationship between factor and item. > |0.4| is considered good
43
When is factor considered potentially meaningful?
the items loaded need to be related quantitatively and qualitatively
44
major FA types (3)
1. CFA (confirm or validate already hypothesised construct) 2. EFA (exploratory, identify possible construct) 3. PCA (principal components; assumes all variance can be explained by same latent structure)
45
What is orthogonal factors
dimensions independent from each other e.g. neuroticism and extraversion
46
what is oblique factors
dimensions related to each other e.g. Gf and Gc factors of intelligence
47
factorability?
suitability of item to be included in FA model
48
simple structure?
items form distinct factors or spatial clustered, based on degree of associations
49
rotation?
geometric transformation to generate model that contains simpler structure
50
varimax rotation?
orthogonal rotation - rotate unrelated, maximises the variance
51
oblimin rotation?
oblique rotation, more related factors
52
Kaiser criterion?
retain any factor with eigenvalue of greater or equal to 1
53
Scree plot rule
``` variance explained rule (retain all 80-90% total variance) comprehensibility rule (retain all that are clearly interpretable ```
54
applications for psychometric knowledge
1. criminal/clinical profiling | 2. psychobiography/psychohistory