Rating Scales and Other Considerations for Surveys

Question 1

What is the purpose of rating scales in a survey?

Answer 1

To ask people to provide “how much” judgements

Question 2

Rating scales are particularly useful for measuring…?

Answer 2

Attitudes

Question 3

What are the different formats of rating scales? Give 6 examples

Answer 3

1) Dichotomous, multichotomous
2) Likert scale
3) Graphic rating scale
4) Non-verbal scale
5) Ranking scale
6) Semantic differential scale

Question 4

What are dichotomous rating scales?

Answer 4

A two-point scale that presents options that are absolutely opposite to each other

Question 5

A two-point scale that presents options that are absolutely opposite to each other

This is known as…?

Answer 5

Dichotomous rating scales

Question 6

This type of response option does not give the respondent an opportunity to be neutral on his answer to a question

What type of rating scale is this?

Answer 6

Dichotomous rating scales

Question 7

What are multichotomous rating scales?

Answer 7

Presenting a variety of options Ps could respond with and giving them the option to choose as either only one response or as many responses that apply to them

Question 8

Presenting a variety of options Ps could respond with and giving them the option to choose as many that apply to them

This is known as…?

Answer 8

Multichotomous rating scales

Question 9

What are Likert scales?

Answer 9

A rating scale used to measure opinions, attitudes, or behaviour, ranging from strongly disagree/agree, somewhat disagree/agree and neither disagree/agree

Question 10

A rating scale used to measure opinions, attitudes, or behaviour, ranging from strongly disagree/agree, somewhat disagree/agree and neither disagree/agree

This is known as…?

Answer 10

Likert scale

Question 11

What are graphic rating scales?

Answer 11

Respondents can choose a particular option on a line or scale to show how they feel about something, ranging from a scale of 1-3, 1-5 or 1-10

Question 12

Respondents can choose a particular option on a line or scale to show how they feel about something, ranging from a scale of 1-3, 1-5 or 1-10

This is known as…?

Answer 12

Graphic rating scale

Question 13

What are ranking scales?

Answer 13

Scales which force respondents to rank a list of items with only one selection in each rank

Question 14

Scales which force respondents to rank a list of items with only one selection in each rank

This is known as…?

Answer 14

Ranking scales

Question 15

What are semantic differential scales?

Answer 15

A scale that uses two bipolar adjectives, one negative adjective on the left of the scale, and one positive adjective on the right of the scale.

Participants indicate where they feel a product or experience lies on a 7-point scale

Question 16

A scale that uses two bipolar adjectives, one negative adjective on the left of the scale, and one positive adjective on the right of the scale.

Participants indicate where they feel a product or experience lies on a 7-point scale

This is known as…?

Answer 16

Semantic differential scales

Question 17

What type of rating scale is this?

Should there be a referendum for Welsh
independence?

Yes No

Answer 17

Dichotomous

Question 18

What type of rating scale is this?

• Two response options
• The simplest type of quantification

Answer 18

Dichotomous

Question 19

What type of rating scale is this?

How many hours did you spend revising last week?

• Less than 5 hours
• 5 to 10 hours
• 10 to 20 hours
• More than 20 hours

Answer 19

Multichotomous

Question 20

What type of rating scale is this?

Which study activities did you engage in?

• watching podcasts
• making notes
• reading textbooks
• reading papers

Answer 20

Multichotomous

Question 21

What type of rating scale is this?

It gives multiple options for only one response or gives multiple options for multiple responses

Answer 21

Multichotomous

Question 22

What type of rating scale is this?

How attractive is your partner?

• Not at all attractive
• Somewhat attractive
• Reasonably attractive
• Very attractive

Answer 22

Likert scales

Question 23

What type of rating scale is this?

• Consists of multi-point responses
• Aim to ensure equal spacing of response options

Answer 23

Likert scales

Question 24

What should we keep in mind when using Likert scales? List 4 things

Answer 24

• Response acquiescence
• Potential introduction of double negatives
• Verbal responses for all, or only for anchors?
• Inclusion of neutral response?

Question 25

What type of rating scale is this? A scale that uses (happy - neutral - sad) emoticons and non-verbal response options

Answer 25

Non-verbal rating scale

Question 26

What is a non-verbal rating scale?

Answer 26

A scale that uses (happy - neutral - sad) emoticons and non-verbal response options

Question 27

What type of scale involves pointing to the face that shows your answer?

Answer 27

Non-verbal rating scale

Question 28

What type of rating scale is this? Measures the relative importance of several items

Answer 28

Ranking scale

Question 29

What type of rating scale is this? Rank the anxiety you experience in the following group situations (from 1 most anxious, to 4 least anxious)

Answer 29

Ranking scale

Question 30

What type of rating scale is this? Ps asked to mark along a continuous line which is anchored at each end

Answer 30

Graphic rating scale

Question 31

What type of rating scale is this? How would you rate the music lessons you received in school? Not very enjoyable --------------- Very enjoyable

Answer 31

Graphic rating scale

Question 32

What type of rating scale is this? Ps marked along a line and a score is recorded by measuring where the line was marked

Answer 32

Graphic rating scale

Question 33

What type of rating scale is this? More indirect measurement of attitude

Answer 33

Semantic differential scales

Question 34

What type of rating scale is this? Respondents indicate thoughts and feelings by marking a response on scales between bipolar opposite adjectives

Answer 34

Semantic differential scales

Question 35

What type of rating scale is this? Music lessons in school were: Valuable : _ : _ : _ : _ : _ : Wasteful Irrelevant : _ : _ : _ : _ : _ : Worthwhile

Answer 35

Semantic differential scales

Question 36

What are survey response rates?

Answer 36

The percentage of questionnaires completed and returned from those distributed

Question 37

The percentage of questionnaires completed and returned from those distributed This is known as...?

Answer 37

Survey response rates

Question 38

What are the 5 ways we can maximise survey response rates?

Answer 38

1) Keeping questionnaires short 2) Keeping questionnaires simple and clear 3) Including a pre-paid envelope with postal surveys 4) Sending a reminder (after one or two weeks) 5) Offering an incentive

Question 39

What 4 things make a good questionnaire construction?

Answer 39

1) Questionnaires can measure one or more variables 2) Typically multiple items to a measure single variable 3) Variable score is calculated 4) Better measurements with more items

Question 40

Why should we include multiple questionnaire items to measure a single variable?

Answer 40

To minimise the impact of response errors

Question 41

What happens when there are too few response options in a questionnaire?

Answer 41

Results in low sensitivity

Question 42

What happens when there are too many response options in a questionnaire?

Answer 42

Results in low reliability

Question 43

What are psychometrics?

Answer 43

The science of measuring psychological constructs

Question 44

The science of measuring psychological constructs This is known as...?

Answer 44

Psychometrics

Question 45

What 5 things do psychometrics measure?

Answer 45

1) Personality 2) Cognitive ability 3) Attitudes 4) Knowledge 5) Educational attainment

Question 46

How is the quality of questionnaires assessed? List 2 criteria

Answer 46

1) Temporal consistency 2) Internal consistency

Question 47

What is temporal consistency?

Answer 47

The extent to which our tool would provide the same results under the same conditions

Question 48

The extent to which our tool would provide the same results under the same conditions This is known as...?

Answer 48

Temporal consistency

Question 49

What is internal consistency?

Answer 49

The extent to which our tool is measuring the construct we are interested in

Question 50

The extent to which our tool is measuring the construct we are interested in This is known as...?

Answer 50

Internal consistency

Question 51

What is construct validity?

Answer 51

Is the construct we are trying to measure valid? Does the construct itself exist?

Question 52

How is the validity of a construct supported?

Answer 52

Supported by cumulative research evidence collected over time

Question 53

Construct validity be assessed in terms of...? List 2 ways

Answer 53

1) Convergence validity 2) Discriminant validity

Question 54

What is convergence validity?

Answer 54

Assesses whether the construct we are measuring correlates with tests of related constructs

Question 55

What is discriminant validity?

Answer 55

Assess whether the construct we are measuring does not correlate with tests of different constructs

Question 56

Assess whether the construct we are measuring does not correlate with tests of different constructs This is known as...?

Answer 56

Discriminant validity

Question 57

Assesses whether the construct we are measuring correlates with tests of related constructs This is known as...?

Answer 57

Convergent validity

Question 58

What are psychometric tests?

Answer 58

Standardised questionnaires/tests designed to measure particular traits or abilities

Question 59

Standardised questionnaires/tests designed to measure particular traits or abilities This is known as...?

Answer 59

Psychometric test

Question 60

Give 3 examples of what psychometric tests might measure.

Answer 60

 1) Personality inventories  2) Cognitive ability tests  3) Measure of mental health status

Question 61

True or False? Psychometric tests have norms available allowing for the interpretation of individual participants data

Answer 61

True

Question 62

It should not be compulsory to attend all lectures 1) strongly agree 2) agree 3) neither agree nor disagree 4) disagree 5) strongly disagree a. What is the problem with this question? b. What is the response format?

Answer 62

a. Double-negative b. Likert scale

Question 63

Could you be attracted to someone who earns less or has a lower-status job than you? Yes/No a. What is the problem with this question? b. What is the response format being used?

Answer 63

a. Double-barrelled b. Dichotomous

Question 64

The relationship between my effort and my grades at university is otrhogonal (mark your response on the line) Strongly agree____________________Strongly disagree a. What is the problem with this question? b. What is the response format being used?

Answer 64

a. Jargon b. Graphic rating scale

Question 65

What damage do you think is done to children who play violent computer games? __________________________________________________________________ __________________________________________________________________ a. What is the problem with this question? b. What is the response format?

Answer 65

a. Leading b. Open response

Question 66

Listening to music makes me feel (mark all that apply) Energised; Inspired; Relaxed; Focussed a. What is the problem with this question? b. What is the response format being used?

Answer 66

a. Should be an open question b. Multichotomous, multiple response