Rating Scales and Other Considerations for Surveys Flashcards

1
Q

What is the purpose of rating scales in a survey?

A

To ask people to provide “how much” judgements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Rating scales are particularly useful for measuring…?

A

Attitudes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the different formats of rating scales? Give 6 examples

A

1) Dichotomous, multichotomous
2) Likert scale
3) Graphic rating scale
4) Non-verbal scale
5) Ranking scale
6) Semantic differential scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are dichotomous rating scales?

A

A two-point scale that presents options that are absolutely opposite to each other

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

A two-point scale that presents options that are absolutely opposite to each other

This is known as…?

A

Dichotomous rating scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

This type of response option does not give the respondent an opportunity to be neutral on his answer to a question

What type of rating scale is this?

A

Dichotomous rating scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are multichotomous rating scales?

A

Presenting a variety of options Ps could respond with and giving them the option to choose as either only one response or as many responses that apply to them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Presenting a variety of options Ps could respond with and giving them the option to choose as many that apply to them

This is known as…?

A

Multichotomous rating scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are Likert scales?

A

A rating scale used to measure opinions, attitudes, or behaviour, ranging from strongly disagree/agree, somewhat disagree/agree and neither disagree/agree

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

A rating scale used to measure opinions, attitudes, or behaviour, ranging from strongly disagree/agree, somewhat disagree/agree and neither disagree/agree

This is known as…?

A

Likert scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are graphic rating scales?

A

Respondents can choose a particular option on a line or scale to show how they feel about something, ranging from a scale of 1-3, 1-5 or 1-10

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Respondents can choose a particular option on a line or scale to show how they feel about something, ranging from a scale of 1-3, 1-5 or 1-10

This is known as…?

A

Graphic rating scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are ranking scales?

A

Scales which force respondents to rank a list of items with only one selection in each rank

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Scales which force respondents to rank a list of items with only one selection in each rank

This is known as…?

A

Ranking scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are semantic differential scales?

A

A scale that uses two bipolar adjectives, one negative adjective on the left of the scale, and one positive adjective on the right of the scale.

Participants indicate where they feel a product or experience lies on a 7-point scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

A scale that uses two bipolar adjectives, one negative adjective on the left of the scale, and one positive adjective on the right of the scale.

Participants indicate where they feel a product or experience lies on a 7-point scale

This is known as…?

A

Semantic differential scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What type of rating scale is this?

Should there be a referendum for Welsh
independence?

Yes No

A

Dichotomous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What type of rating scale is this?

  • Two response options
  • The simplest type of quantification
A

Dichotomous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What type of rating scale is this?

How many hours did you spend revising last week?

  • Less than 5 hours
  • 5 to 10 hours
  • 10 to 20 hours
  • More than 20 hours
A

Multichotomous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What type of rating scale is this?

Which study activities did you engage in?

  • watching podcasts
  • making notes
  • reading textbooks
  • reading papers
A

Multichotomous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What type of rating scale is this?

It gives multiple options for only one response or gives multiple options for multiple responses

A

Multichotomous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What type of rating scale is this?

How attractive is your partner?

  • Not at all attractive
  • Somewhat attractive
  • Reasonably attractive
  • Very attractive
A

Likert scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What type of rating scale is this?

  • Consists of multi-point responses
  • Aim to ensure equal spacing of response options
A

Likert scales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What should we keep in mind when using Likert scales? List 4 things

A
  • Response acquiescence
  • Potential introduction of double negatives
  • Verbal responses for all, or only for anchors?
  • Inclusion of neutral response?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What type of rating scale is this?

A scale that uses (happy - neutral - sad) emoticons and non-verbal response options

A

Non-verbal rating scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is a non-verbal rating scale?

A

A scale that uses (happy - neutral - sad) emoticons and non-verbal response options

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What type of scale involves pointing to the face that shows your answer?

A

Non-verbal rating scale

28
Q

What type of rating scale is this?

Measures the relative importance of several items

A

Ranking scale

29
Q

What type of rating scale is this?

Rank the anxiety you experience in the following group situations (from 1 most anxious, to 4 least anxious)

A

Ranking scale

30
Q

What type of rating scale is this?

Ps asked to mark along a continuous line which is anchored at each end

A

Graphic rating scale

31
Q

What type of rating scale is this?

How would you rate the music lessons you received in school?

Not very enjoyable ————— Very enjoyable

A

Graphic rating scale

32
Q

What type of rating scale is this?

Ps marked along a line and a score is recorded by measuring where the line was marked

A

Graphic rating scale

33
Q

What type of rating scale is this?

More indirect measurement of attitude

A

Semantic differential scales

34
Q

What type of rating scale is this?

Respondents indicate thoughts and feelings by marking a response on scales between bipolar opposite adjectives

A

Semantic differential scales

35
Q

What type of rating scale is this?

Music lessons in school were:
Valuable : _ : _ : _ : _ : _ : Wasteful
Irrelevant : _ : _ : _ : _ : _ : Worthwhile

A

Semantic differential scales

36
Q

What are survey response rates?

A

The percentage of questionnaires completed and returned from those distributed

37
Q

The percentage of questionnaires completed and returned from those distributed

This is known as…?

A

Survey response rates

38
Q

What are the 5 ways we can maximise survey response rates?

A

1) Keeping questionnaires short
2) Keeping questionnaires simple and clear
3) Including a pre-paid envelope with postal surveys
4) Sending a reminder (after one or two weeks)
5) Offering an incentive

39
Q

What 4 things make a good questionnaire construction?

A

1) Questionnaires can measure one or more variables
2) Typically multiple items to a measure single variable
3) Variable score is calculated
4) Better measurements with more items

40
Q

Why should we include multiple questionnaire items to measure a single variable?

A

To minimise the impact of response errors

41
Q

What happens when there are too few response options in a questionnaire?

A

Results in low sensitivity

42
Q

What happens when there are too many response options in a questionnaire?

A

Results in low reliability

43
Q

What are psychometrics?

A

The science of measuring psychological constructs

44
Q

The science of measuring psychological constructs

This is known as…?

A

Psychometrics

45
Q

What 5 things do psychometrics measure?

A

1) Personality
2) Cognitive ability
3) Attitudes
4) Knowledge
5) Educational attainment

46
Q

How is the quality of questionnaires assessed? List 2 criteria

A

1) Temporal consistency
2) Internal consistency

47
Q

What is temporal consistency?

A

The extent to which our tool would provide the same results under the same conditions

48
Q

The extent to which our tool would provide the same results under the same conditions

This is known as…?

A

Temporal consistency

49
Q

What is internal consistency?

A

The extent to which our tool is measuring the construct we are interested in

50
Q

The extent to which our tool is measuring the construct we are interested in

This is known as…?

A

Internal consistency

51
Q

What is construct validity?

A

Is the construct we are trying to measure valid?

Does the construct itself exist?

52
Q

How is the validity of a construct supported?

A

Supported by cumulative research evidence collected over time

53
Q

Construct validity be assessed in terms of…? List 2 ways

A

1) Convergence validity
2) Discriminant validity

54
Q

What is convergence validity?

A

Assesses whether the construct we are measuring correlates with tests of related constructs

55
Q

What is discriminant validity?

A

Assess whether the construct we are measuring does not correlate with tests of different constructs

56
Q

Assess whether the construct we are measuring does not correlate with tests of different constructs

This is known as…?

A

Discriminant validity

57
Q

Assesses whether the construct we are measuring correlates with tests of related constructs

This is known as…?

A

Convergent validity

58
Q

What are psychometric tests?

A

Standardised questionnaires/tests designed to measure particular traits or abilities

59
Q

Standardised questionnaires/tests designed to measure particular traits or abilities

This is known as…?

A

Psychometric test

60
Q

Give 3 examples of what psychometric tests might measure.

A

 1) Personality inventories
 2) Cognitive ability tests
 3) Measure of mental health status

61
Q

True or False?

Psychometric tests have norms available allowing for the interpretation of individual
participants data

A

True

62
Q

It should not be compulsory to attend all lectures

1) strongly agree 2) agree 3) neither agree nor disagree 4) disagree 5) strongly disagree

a. What is the problem with this question?

b. What is the response format?

A

a. Double-negative
b. Likert scale

63
Q

Could you be attracted to someone who earns less or has a lower-status job than you?

Yes/No

a. What is the problem with this question?

b. What is the response format being used?

A

a. Double-barrelled
b. Dichotomous

64
Q

The relationship between my effort and my grades at university is otrhogonal (mark your response on the line)

Strongly agree____________________Strongly disagree

a. What is the problem with this question?

b. What is the response format being used?

A

a. Jargon
b. Graphic rating scale

65
Q

What damage do you think is done to children who play violent computer games?

__________________________________________________________________

__________________________________________________________________

a. What is the problem with this question?

b. What is the response format?

A

a. Leading
b. Open response

66
Q

Listening to music makes me feel (mark all that apply)

Energised; Inspired; Relaxed; Focussed

a. What is the problem with this question?

b. What is the response format being used?

A

a. Should be an open question
b. Multichotomous, multiple response