Brainscape's Knowledge GenomeTM


Top Flashcards (Certified)
All Flashcards

Statistics > Scale Development > Flashcards

Scale Development Flashcards

1
Q

Ideally, the variance in a response to a question will be due to the underlying construct we’re measuring. However, it will also be caused by…

A

Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a reliable scale?

A

Consistency of the scale in measuring a variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Split-half reliability

A

Split into two

Two halves should correlate strongly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Which is the best measure of reliability?

A

Internal reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Split-half reliability

If the scale is reliable, the two halves should…

A

Correlate strongly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is internal reliability a very accurate measure?

A

Averages over many correlations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

The coefficient alpha indicates…

A

Proportion of variance attributable to TRUE score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

DeVellis recommends that a coefficient alpha of <0.6 is

A

Unacceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

DeVellis recommends that a coefficient alpha of >.9 indicates

A

Probably should shorten the scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

3 ways of testing for reliability

A

Internal reliability
Split-half
Test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How is Cronbach’s alpha limited?

A

It is not a measure of unidimensionality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is test-retest reliability?

A

Scores at one point in time should be correlated with scores at another point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A high test-retest reliability means there is a

A

Strong correlation between two administrations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Low test-retest reliability might reflect ________ rather than unreliability

A

Temporal instability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Low test-retest reliability does not always indicate unreliability…

A

May indicate temporal instability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is validity?

A

Extent to which scores from scale reflect variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Scale validity can be increased by (2)

A

a) Interviews with target sample to generate Qs

b) Ask experts to rate Qs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is construct validity?

A

Does the scale correlate to other constructs in line with theoretical expectations?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How to assess construct validity (1)

A

Administer 2 similar scales

Should correlate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

3 kinds of validity

A

Content
Construct
Predictive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Predictive validity

A

Can the scale accurately predict a future criterion?

E.g. can an intelligence scale predict University-goers 10 years later?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Do we aim for or avoid kurtosis?

A

Avoid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

How to work out skewness?

A

Z = S (skewness) / SE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

If Z is LARGER than 3.08, this indicates

A

Highly significant levels of skewness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
If Z is larger than _____, this indicates significant levels of skewness/kurtosis
3.08
26
If __ is larger than 3.08, this indicates significant levels of skewness/kurtosis
Z
27
Is a highly significant level of skewness/kurtosis a good thing?
No | Indicates too much deviation from normal distribution
28
If Z = 3.08, P =
< 0.01
29
If the Z score is greater than 3.08, then the item should be...
Removed from the scale
30
Reliability can be assessed using C....
Cronbach's Alpha
31
Cronbach's Alpha can assess reliability Look out for...
Low correlations
32
Cronbach's Alpha SPSS indicates the ________ if the item was to be _________!
Alpha coefficient Deleted
33
If data is skewed, the peak will..
Be shifted away from centre of distribution
34
Skewness is a measure of ________, or more precisely, __________
Symmetry Lack of symmetry
35
(Histogram) A distribution/data set is symmetric if it ...
Looks the same left to right
36
Data sets with high kurtosis tend to have heavy...
Tails/outliers
37
The ________ is an effective graphical technique for showing both the skewness and kurtosis of a dataset
Histogram
38
The kurtosis for standard normal distribution is
3
39
This measure is a measure of outliers...
Kurtosis
40
This measure is a measure of normal/non-normal distribution
Skewness
41
Skewness tells us the amount/direction of
Skew
42
Which of the following decreases the probability of a type I error? a) Increasing the SD b) Increasing the sample size c) Decreasing the significance level
Decreasing the significance level
43
There are three types of scale reliability:
Test-retest Internal consistency Inter-rater
44
Which type of scale reliability refers to over-time reliability?
Test-retest
45
Which type of scale reliability refers to across items reliability?
Internal consistency
46
Which type of scale reliability refers to across researchers reliability?
Inter-rater
47
Assessing test-retest reliability requires using the measure...
1. On a group of people 2. Readministering the scale at a later date 3. The scores should correlate
48
"The consistency of responses across a multi-item measure"
Internal consistency
49
(Internal consistency) If people’s responses to the different items are not correlated with each other, then they may not
Be measuring the same underlying construct
50
How might internal consistency be assessed?
Split-half consistency
51
How might internal consistency be assessed statistically?
Cronbach's Alpha
52
Cronbach's Alpha A value of ___ plus is generally taken to show good internal consistency
.80
53
Cronbach's Alpha is a statistical measure of
Internal consistency
54
Validity is the extent to which scores from a measure
Represent the variable they're meant to
55
Content Validity can also be assessed by comparing the scale against the ___________ of the variable
Conceptual definition
56
Skewness and Kurtosis are both worked out by
S or K divided by S SE or K SE
57
3 ways of checking for normality of scales
1. Skewness 2. Kurtosis 3. Histogram
58
The X item was found to be significantly skewed (Z = x, p = x)
And was therefore dropped from subsequent analyses
59
___________ measures internal consistency
Coefficient Alpha
60
Coefficient alpha measures
Internal consistency
61
To what extent does a scale of depression look like its measuring depression?
Content validity
62
How to work out SE from S/K + Z?
S/K DIVIDED BY Z

Statistics (9 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2025 Bold Learning Solutions. Terms and Conditions