week 5 Flashcards

1
Q

What are psychometrics

A

A collection of techniques for evaluating the development and use of psychological measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is reliability

A

free as possible from random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is validity

A

Does what it says on the tin

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is unidimensionality

A

measuring just the one thing we want to measure, or have we ended up measuring other things too

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is discrimination

A

how well do our items distinguish between levels of the thing we’re measuring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is equivalence

A

Does the measure perform the same way for different groups of people

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is norm-referencing

A

How are scores distributed in the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How are they standardised

A

rigorously tested for validity and reliability
Norm-referenced: compare scores against population norms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are errors

A

It is unlikely any psychological measure will be 100% accurate
Observed score= true score plus error
Errors can be random in nature
Errors can be systematic in nature

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How do we reduce random error

A

repeat measurement and average them
although this isn’t simple for psychological variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How do we reduce systematic errors

A

Use multiple measurements each with different downsides
That way the variable of interest is measured consistently, but the noise is not
This is why psychological instruments tend to take he form of questionnaires rather than single questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is reliability

A

a measure is reliable if it is accurate and consistent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is validity

A

A measure is valid if it measures what you think it is measuring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are the types of reliability

A

Test-retest
parallel form reliability
Internal consistency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is test-retest and strengths and weakness

A

Re doing the test to see if results were the same
Strengths: demonstrates the measure is temporally stable
weakness: based on a total score, what about emotion or motivation, How long between testing sessions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is parallel forms of reliability

A

Two alternative forms of the same standardised measure
reduces risk of learning effects when evaluating reliability over time

17
Q

What is internal consistency

A

a subscale should be unidimensional
So we look at whether every item on the subscale measures this dimension
If first 5 items in a scale are measuring the same thing, responses to these items will be highly correlated
Internal consistency is a way to look at this across items

18
Q

Cronbach’s alpha

A

A number that reflects two things: mean correlation between items in a subscale and number of items in a sub scale

19
Q

Half split technique

A

another way of quantifying internal consistency. Compare scores across two halves of a measure

20
Q

Internal consistency: strength and weakness

A

Strengths: its essential poor internal consistency can only be due to items measuring different things
Weakness: if you increase the number of items, you increase Cronbach’s alpha- so exercise with very brief or very long measures
Extremely high Cronbach’s alpha values might be bloated too narrow a range of questions was asked

21
Q

Inter-rater reliability

A

Largely used on coding of observational data: could be somewhat subjective, or somewhat objective

22
Q

Internal validity

A

can the causal relationship that we established be explained by others?

23
Q

External validity

A

can we generalise to other situations, other populations

24
Q

Construct validity

A

How well we are measuring what we want to measure

25
Q

Translation validity

A

is the operationalisation a good reflection of the construct

26
Q

Criterion validity

A

How well does the measure agree with some external standard

27
Q

On the face of things

A

does the instrument appear to measure the construct

28
Q

Content

A

to what extent do the items actually represent the whole of the construct dimension that we are trying to measure

29
Q

What do standardised measures do

A

give clear instructions
give instructions on how the measure give instructions on how the measure is administered

30
Q

Predictive validity

A

does a score on the measure predict the value of another variable in the future

31
Q

Concurrent validity

A

does the measure now correlate with information from a related measure

32
Q

Convergent validity

A

does the measure correlate with another variable that it should theoretically be related to

33
Q

Discriminant validity

A

does the measure correlate with a conceptually unrelated construct

34
Q

Advantages of using standardised measures

A

Rigorous design process
Validity and reliability repeated tested
test have descriptive statistics for population norms which you can use to compare with your own