Midterm 2 - Chpt. 7 Flashcards

1
Q

You might need to ask your Ps some questions - why? (4)

A
  • to analyze & understand trends
  • for correlational research
  • as the DV in an experiment
  • as a manipulation check in an experiment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What kind of information might you need to find out from Ps? (3)

A

□ ₋ Attitudes and beliefs
□ ₋ Facts and demographics
□ ₋ Behavioral frequencies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Simplicity (Question wording considerations)

A

avoid jargon, abbreviations, complexity!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Double-barreled questions (Question wording considerations)

A

EX: Do you support free tuition and reduced healthcare?

  • Do you feel anxious and depressed when thinking about exams?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Loaded Questions (Question wording considerations)

A

Are you in favor of having your terrific instructor Mark Lam teach another term of fun-filled 217?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Negative Wording (Question wording considerations)

A

Do you agree that the City of Vancouver should not allow the homeless to camp on the streets?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Creating Q’s - Question validity:

A

Does the question assess what you want it to assess? (more later in the term)

EX: A researcher want to measure the number of close friendships a person has, and asks:

How many friend requests do you have on FaceBook?

Is this a valid measure of close friendship?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How to validate/test question validity?

A

Pre-testing:
– Have others answer the questions
– Ask for feedback
– Revise questions that are unclear or misunderstood
- OR use an existing & validated questionnaire!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Response Sets (Additional Considerations for Surveys)

A

A tendency to respond to all questions from a particular perspective or in a particular way rather than to provide answers to the questions themselves.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Social Desirability (Additional Considerations for Surveys)

A

(aka “faking good”)

Tendency for a participant to respond in the most socially acceptable way, or as “most people” would. - more likely with sensitive topics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Additional Considerations for Surveys

A
  • Response sets
  • Extraversion
  • Social desireability
  • Open-ended vs. closed-ended
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Pros of open ended Q’s:

A
  • Can get rich, creative, unexpected, and/or complex answers
  • Identify common themes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Cons of open ended Q’s:

A
  • Reponses may be ambiguous
  • P’s may interpret questions in different ways
  • Time consuming to code
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

READINGS

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Survey research uses questionnaires and interviews to ask people to provide information about themselves

A

○ Attitudes
○ Beliefs
○ Demographics
○ Past behaviours
○ Intended future actions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

4 reasons to conduct surveys:

A
  • Method to ask people to tell us about themselves (self-report)
  • Society demands data about issues, rather than just intuition and anecdotes
  • Survey data, if collected in a responsible fashion, can more useful information than individual anecdotes (□ For example, collecting student opinions to create effective curriculums)
  • When using basic research, you can easily study many important variables using questionnaires or interviews
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How can surveys be used? (3)

A
  • To provide snapshots of how particular groups think and behave
  • To gather data for studying relationships among variables
  • Closed ended questions, with only certain numerical responses allowed, provide quantitative data that can be tracked over time, or to compare scores for one institution with similar institutions
  • Open ended questions can be content analyzed for additional insight into what undergraduates think would enrich their education
18
Q

Panel Study (How can surveys be used?)

A

when the same people are tracked & surveyed at two or more points in time, the design is sometimes called a panel study, or a longitudinal design

  • Each period is known as a wave - a two wave study involves surveying people at two points in time
  • Allow for research questions about the relationship between one variable (at time one) and another variable (at time two)
19
Q

Response bias in survey research:

A
  • If a minority of people provide inaccurate information, the data as a whole may remain valuable and informative
  • Only when there’s an excess of inaccurate information that overshadows or masks the true variance in scores do have serious problems
20
Q

Response Bias

A

a tendency to respond to all questions from a particular perspective, or in a particular way, rather than provide answers directly related to the questions themselves

21
Q

Most common type of response bias?

A

social desirability: leads an individual to answer in the most socially acceptable way - the way the person thinks “most people” would respond, or the way that would present the person in the most positive light

  • Occur during questions on sensitive topics
22
Q

How can we prevent response bias?

A
  • To ask sensitive questions in a way that hides their main intent
  • Ensure privacy when completing the survey, by stressing confidentiality and anonymity, and increasing motivation to respond accurately
23
Q

Defining the research objectives

A

Potentially unethical to ask q’s with no real use for information - more q’s asked, greater of a burden placed on the participant with little benefit

24
Q

Attitudes & Beliefs (Defining the research objectives)

A
  • Q’s focus on the ways people evaluate, feel, and think about issues
  • Tap into important aspects of how people see the world and the value that different things hold for them
25
Q

Facts & Demographics - Defining the research

A

Factual q’s ask people to indicate things they know to be true about themselves and their situation

◊ Can be necessary to describe your sample so that researchers can consider the population from which it was drawn

◊ Questions about ethnicity, income, marital status, employment status, etc.

Other factual info will depend on the topic of your research

26
Q

Behaviours - Defining the research objectives

A

Focus on behaviours; either things people have done in the past or intend to do in the future

27
Q

What 5 issues arise from question wording?

A
  • Unfamiliar technical terms
  • Vague or imprecise terms
  • Grammatical errors
  • Awkward phrasing that taxes working memory
  • Embedding the question with misleading information
28
Q

Unnecessary Complexity (Question Wording)

A

Survey q’s should be as simple as possible

Avoid jargon and technical terms

Write in a way that those without advanced degrees or familiarity with the language can understand

29
Q

Double-Barelled Questions (Question Wording)

A

Q’s that ask two things at once

If you need to ask about more than one issue, ask using more than one question

30
Q

Loaded Questions (Question Wording)

A

Written in a way to try and bias people’s responses toward a particular answer

To detect, watch out for emotionally charged words - meant to create an emotional reaction

31
Q

Negative Wording (Question Wording)

A

Avoid framing questions in the negative, which can confuse respondents as to how to correctly indicate their preference

Can reduce scale reliability and validity

32
Q

“Yeah-saying” and “Nay-saying” (Question Wording)

A

“Yea-saying” and “Nay-saying” response sets: when you ask several questions about a topic, a respondent may either agree or disagree with all of the questions

Agreeing with all q’s is AKA acquiescence bias: bias towards accepting the statement

A form of inattentive responding: people providing answers without even really thinking about them
Responding carelessly for times sake

33
Q

How to detect “Yeah-saying” and “Nay-saying” (Question Wording)

A
  • Word q’s so that true agreement with most items is unlikely
  • Include q’s that request a particular response
    AKA conscientious responders scale
34
Q

Closed ended questions (Responses to Questions)

A

Closed-ended: a limited number of response alternative are given, like with a multiple choice question

  • Easier to code (categorizing), by converting the response options to numerical data that can be easily analyzed
  • More likely. Used when the variables under the study are well-known and well-defined
  • Favoured by quantitative approaches
35
Q

Open ended questions (Responses to Questions)

A

Open-ended questions: respondents are free to answer in any way they like

Harder to code, using content analysis or other qualitative methods - ex: a participant’s answer doesn’t make much sense, requires more time to analyze

However, a much richer source of information because of the wide variety of responses possible

Avoid missing out on possibly useful info

Good for when you don’t know enough to make educated assumptions about what sorts of answers people might provide

Can be used by both, but favoured by qualitative

36
Q

Rating scales for close-ended questions (Responses to Questions)

A

Rating scale: asks people to provide judgements of “how much” for a dimension - amount of ___

Easiest/most direct presents people with five or seven response alternatives

37
Q

What type of labelled scale is most efficient?

A

Fully labelled scales are more reliable than are partially labelled scales

More clear definitions and reduce measurement error that comes from relying on people’s interpretations

38
Q

What is the ideal quantity of a scale? What other feature should be added?

A

In basic research, it’s preferrable to have more alternatives to allow people greater opportunity to express themselves

5-7 point scales, with a middle “neutral” option
However, participants tend to use this middle point when they don’t know how to respond, which can cause issues for reliability and validity

Often preferred to have an “I don’t know” option

39
Q

High/Low Frequency scales

A

Labelling alternatives can be tricky when asking a q about the frequency of some behaviour

  • High frequency scales: most of the options measure a behaviour done very frequently
  • Low-frequency scales: behaviour in question doesn’t happen very frequently
40
Q

Graphic Rating Scale

A

asks respondents to make a mark along a continuous 100mm line, anchored with descriptions at each end

Researcher measures where the mark was made, converting to a score from 0-100

41
Q

Semantic Differential Scale

A

a way to measure the meaning that people ascribe to concepts

Respondents rate concepts based on a continuum spanning two adjectives, using multi-point scales (Wearing shorts in the winter: “good”, “strong”, “smart”

Concepts using this scale are rated among 3 dimensions:

Evaluation: how something is valued using adjectives such as good-bad, wise-foolish

Activity: active-passive, slow-fast
Potency: weak-strong, hard-soft