Hays, Cha. 5: Measurement Concepts Flashcards

1
Q

What is reliability?

A

Looking to see if you get the same results from the same test from the same person during a short amount of time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Instrument assessments look for _____, while personality tests look for _____.

A

growth; stability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why do we need to be careful when assessing children for personality disorders?

A

They are still developing their personality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is measurement error?

A

The goal is to reduce the error, but there is going to be some error in your test (known as “error score”)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the two parts (scores) of each test?

A

True score & error score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

(T/F) No score will be perfectly reliable or perfectly without error.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are correlation coefficients (aka reliability coefficients)?

A

When assessing reliability, the statistical measures that determine degree of relationship b/w two factors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the range of values for correlation coefficients?

A

-1 to +1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

(T/F) No relationship will be perfect (score of -1 or +1)

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

(T/F) The bigger the number, the stronger the relationship

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

(T/F) If the number is “-“, there is a negative effect; as one factor increases, the other factor decreases

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the base correlation coefficients for achievement tests an personality tests?

A

Achievement Test: .85-.90

Personality Test: .50-.60

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the types of reliability?

A

Test-retest
Split-half
Alternate form
Inter-rater reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is test-retest?

A

Give test on one occasion, give test again later to same group of people and correlation the scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is alternate form in reliability?

A

Measuring same construct same way, but with different questions. Give test to a group of people then give the alternate version and correlate scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the best way to assess reliability?

A

Test-retest combined with Alternate form.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is usually used to assess reliability?

A

Split-half and inter-item (cheap and simple)

18
Q

What is inter-rater reliability?

A

Whether different raters will have same results on same assessment

19
Q

What is validity?

A

Does the test measure what it says it’s going to measure? Is the test measuring a construct adequately?

20
Q

Validity Notes

A

More difficult to assess than reliability

Assessments are usually only good for one of two assessments at most

21
Q

What are the different types of validity?

A
Validity coefficients
Face validity
Content validity
Criterion related validity
Construct validity
Treatment validity
22
Q

What are validity coefficients?

A

The statistical measures that determine degree of relationship b/w two factors.
- Usually lower than reliability coefficients.

23
Q

What is face validity?

A

Does it look like the test is measuring what it is supposed to measure?
- Should increase motivation for test-taker to do well

24
Q

What is content validity?

A

Is the test assessing the appropriate content for the body of study that a group of students has gone through

  • Applies mostly to achievement tests
  • A group of experts looks at a group of items to make sure they fit
25
What is criterion related validity?
Comparing scores with performance
26
What are two types of criterion related validity?
- Concurrent validity: Give a new test at the same time as an older one measuring the same thing, then correlating their scores. The results should be equal - Predictive validity: Prediction of how well a person will do with a certain construct (ex: pilot training, ASVAB)
27
Can we predict low base-rate behaviors (suicide, murder)?
Can be done (Suicide and homicide prediction can be done, but has false-positives because it’s a low base-rate behavior (doesn’t occur very often), so the assessments can’t be used)
28
What is a low base-rate behavior?
A behavior (suicide and murder) that does not occur often.
29
What is a false-positive?
Saying someone is a certain way when they aren't.
30
What is a false-negative?
Saying someone is not a certain way when they are.
31
What is construct validity?
Are you really measuring what you’re trying to, or you measuring something else?
32
Can you have a reliable test that is not valid?
Yes
33
Can you have a valid test that is not reliable?
No
34
Reliability is _____ the concept of validity.
subsumed under
35
What is treatment validity?
Do these tests and their results make any difference in treatment? - If the person tested concurs and is motivated to take the test, and the results are shared: then it will aid in treatment
36
What is a response-set (aka response style)?
- When you’re giving an instrument, and the person responds to that instrument in a way that are not what is looked for (through distortion or deception) - We want people to be honest on answers, but some people unintentionally distort subconsciously (ex: checking all “no” at doctor checklist)
37
What are validity scales used for?
Assessing for distortion
38
What tests use validity scales?
Any large, broad scale personality measure
39
If a person denies any negative behavior, they are probably...
lying. Every one has "chinks in their armor"
40
What will validity scales show?
Distortion - denial of all negative behaviors Inconsistencies A lot of blank answers A lot of "cannot say" answers "Yes" responses to extremely odd or infrequent behaviors