Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Statistics > Scale Development > Flashcards

Scale Development Flashcards

1
Q

Ideally, the variance in a response to a question will be due to the underlying construct we’re measuring. However, it will also be caused by…

A

Error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is a reliable scale?

A

Consistency of the scale in measuring a variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Split-half reliability

A

Split into two

Two halves should correlate strongly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Which is the best measure of reliability?

A

Internal reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Split-half reliability

If the scale is reliable, the two halves should…

A

Correlate strongly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Why is internal reliability a very accurate measure?

A

Averages over many correlations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

The coefficient alpha indicates…

A

Proportion of variance attributable to TRUE score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

DeVellis recommends that a coefficient alpha of <0.6 is

A

Unacceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

DeVellis recommends that a coefficient alpha of >.9 indicates

A

Probably should shorten the scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

3 ways of testing for reliability

A

Internal reliability
Split-half
Test-retest reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How is Cronbach’s alpha limited?

A

It is not a measure of unidimensionality

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is test-retest reliability?

A

Scores at one point in time should be correlated with scores at another point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A high test-retest reliability means there is a

A

Strong correlation between two administrations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Low test-retest reliability might reflect ________ rather than unreliability

A

Temporal instability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Low test-retest reliability does not always indicate unreliability…

A

May indicate temporal instability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is validity?

A

Extent to which scores from scale reflect variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Scale validity can be increased by (2)

A

a) Interviews with target sample to generate Qs

b) Ask experts to rate Qs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is construct validity?

A

Does the scale correlate to other constructs in line with theoretical expectations?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How to assess construct validity (1)

A

Administer 2 similar scales

Should correlate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

3 kinds of validity

A

Content
Construct
Predictive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Predictive validity

A

Can the scale accurately predict a future criterion?

E.g. can an intelligence scale predict University-goers 10 years later?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Do we aim for or avoid kurtosis?

A

Avoid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

How to work out skewness?

A

Z = S (skewness) / SE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

If Z is LARGER than 3.08, this indicates

A

Highly significant levels of skewness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

If Z is larger than _____, this indicates significant levels of skewness/kurtosis

A

3.08

26
Q

If __ is larger than 3.08, this indicates significant levels of skewness/kurtosis

A

Z

27
Q

Is a highly significant level of skewness/kurtosis a good thing?

A

No

Indicates too much deviation from normal distribution

28
Q

If Z = 3.08, P =

A

< 0.01

29
Q

If the Z score is greater than 3.08, then the item should be…

A

Removed from the scale

30
Q

Reliability can be assessed using C….

A

Cronbach’s Alpha

31
Q

Cronbach’s Alpha can assess reliability

Look out for…

A

Low correlations

32
Q

Cronbach’s Alpha

SPSS indicates the ________ if the item was to be _________!

A

Alpha coefficient

Deleted

33
Q

If data is skewed, the peak will..

A

Be shifted away from centre of distribution

34
Q

Skewness is a measure of ________, or more precisely, __________

A

Symmetry

Lack of symmetry

35
Q

(Histogram) A distribution/data set is symmetric if it …

A

Looks the same left to right

36
Q

Data sets with high kurtosis tend to have heavy…

A

Tails/outliers

37
Q

The ________ is an effective graphical technique for showing both the skewness and kurtosis of a dataset

A

Histogram

38
Q

The kurtosis for standard normal distribution is

A

3

39
Q

This measure is a measure of outliers…

A

Kurtosis

40
Q

This measure is a measure of normal/non-normal distribution

A

Skewness

41
Q

Skewness tells us the amount/direction of

A

Skew

42
Q

Which of the following decreases the probability of a type I error?

a) Increasing the SD
b) Increasing the sample size
c) Decreasing the significance level

A

Decreasing the significance level

43
Q

There are three types of scale reliability:

A

Test-retest
Internal consistency
Inter-rater

44
Q

Which type of scale reliability refers to over-time reliability?

A

Test-retest

45
Q

Which type of scale reliability refers to across items reliability?

A

Internal consistency

46
Q

Which type of scale reliability refers to across researchers reliability?

A

Inter-rater

47
Q

Assessing test-retest reliability requires using the measure…

A
  1. On a group of people
  2. Readministering the scale at a later date
  3. The scores should correlate
48
Q

“The consistency of responses across a multi-item measure”

A

Internal consistency

49
Q

(Internal consistency)

If people’s responses to the different items are not correlated with each other, then they may not

A

Be measuring the same underlying construct

50
Q

How might internal consistency be assessed?

A

Split-half consistency

51
Q

How might internal consistency be assessed statistically?

A

Cronbach’s Alpha

52
Q

Cronbach’s Alpha

A value of ___ plus is generally taken to show good internal consistency

A

.80

53
Q

Cronbach’s Alpha is a statistical measure of

A

Internal consistency

54
Q

Validity is the extent to which scores from a measure

A

Represent the variable they’re meant to

55
Q

Content Validity can also be assessed by comparing the scale against the ___________ of the variable

A

Conceptual definition

56
Q

Skewness and Kurtosis are both worked out by

A

S or K divided by S SE or K SE

57
Q

3 ways of checking for normality of scales

A
  1. Skewness
  2. Kurtosis
  3. Histogram
58
Q

The X item was found to be significantly skewed (Z = x, p = x)

A

And was therefore dropped from subsequent analyses

59
Q

___________ measures internal consistency

A

Coefficient Alpha

60
Q

Coefficient alpha measures

A

Internal consistency

61
Q

To what extent does a scale of depression look like its measuring depression?

A

Content validity

62
Q

How to work out SE from S/K + Z?

A

S/K DIVIDED BY Z

Statistics (9 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions