Concepts in Psychometric Testing Flashcards

1
Q

What are the 4 key methods of assessing behaviour?

A
  1. Self-report
  2. Other-report
  3. Observation
  4. Biological Measurement.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a common concern about projective tests?

A

There is a substantial lack of evidence of reliability and validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q
  1. What are maximal tests?

2. Where were they developed from?

A
  1. test of ability

2. From a perspective of making sure those assessed have required knowledge on a topic.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the steps to developing tests of topical performance/personality?

A
  1. Construct
  2. theory
  3. Item generation -Top down or bottom up?
  4. Exploration of factors
  5. Confirmation of factors
  6. Validation & reliability
  7. Norms and deployment.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is internal reliability?

A

Within a study, how often do measures agree?

We want measures to be internally reliable - we wouldn’t want a thermometer that couldn’t consistently measure the temperature in the same place.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is external reliability / replicability?

What is conceptual replication?

What is direct replication?

A

Across a study, how often do findings agree?

Same idea, different method, different sample/data
Same idea, same methods, different sample/data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is convergent validity?

A

The statistical relationship between 2 similar measures. i.e., measures of happiness and life satisfaction converge.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is concurrent validity?

A

The statistical relationship with a similar assessment of the same construct. i.e., a new measure of happiness is concurrent with an old one.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is face validity?

A

Does this have the appearance of good measurement? i.e., to what extent can overlapping circles represent community feeling.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is content validity?

A

The value of the included/excluded content for representing a construct i.e., single item measures not fully representing all aspects of construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why is having too high reliability bad?

A

Theres likely too narrow of a scope of measure, might not be enough space for participants to vary.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What can you use to make getting validity easy?

A

Using correlations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q
  1. What is a Z score?

2. What do the different Z-scores mean?

A
  1. A ratio of a person’s distance from the mean in terms of the spread of data.
  2. Z = 0 is the mean response
    - Z= between 0 and 1 indicates someone is above the mean but in a normal range.
    - Z = between 0 and -1 indicates someone is below the mean but within the normal range.

A Z score more than +1 indicates an atypically high score and lower than -1 indicates an atypically low score.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What can we do to Z scores to make them clearer to interpret?

A

We can scale them.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the normal result scale for IQ scores?

A

Norm scored M=100, SD=15

Thus, norm range of IQ is 85-115. Abnormally low or high is above or below this range.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What 3 things should you do when telling someone about their score on a test? e.g., Z score ?

A
  1. What their norm-references score means relative to population.
  2. How this understanding of norms might describe their behaviour.
  3. What are the limitations and benefits of the particular assessment.
17
Q

When communicating to someone their scores on a test you should tell them the limitations and benefits of the assessment they took. What should you include in this?

A

How this was assessed?

Conceptual arguments around the quality of a measure (i.e., realism vs. instrumentalism vs. constructivism).

Recognition that trait measures include reference to states.

18
Q

What 4 key things to bear in mind when wanting to interpret an unseen test?

A
  1. A persons score
  2. Norms
  3. Directionality of a score
  4. General philosophy of a test.
19
Q

What is HEXACO?

A

A lexical model similar to the Big Five but a 6 factor solution.

It is self-reported, lexical model of personality, develop using factor analyses of statements people might describe themselves with.

20
Q

How do you work out a Z score for a score on a test e.g., HEXACO?

A

Z = X - M / SD

Z = Participants score - mean / standard deviation.

21
Q

How to calculate a T score?

A

T = 10z + 50
e.g., someones Z score is 1.63.

T = 10 x 1.63 = 16.27 + 50 = 66.27.

So, this someones score is 66.27%.

22
Q

How to calculate a Sten score?

A

E.g., someones Z score is 1.63.

Sten = 2z + 5.5.

Sten = 2 x 1.63 = 3.26 + 5.5 = 8.75.

So this persons Sten score is 8.75.

23
Q

What is the normal range for:

  1. Z scores
  2. T scores
  3. Sten scores?
A
  1. -1.00 - 1.00
  2. 40 - 60
  3. 3.5 - 7.5