Observations, interviews, questionnaires Flashcards

1
Q

What are the three things involved with observations?

A
  1. Going into “the field”
    (restaurant, hospital, street)
  2. Studying behaviour
    (watching what worker, bystanders and consumers do)
  3. Describing, analysing, and interpreting what you have seen
    (People can be observed in their natural work environment or in the lab setting, and their activities and behaviours or other items of interest can be noted, recorded, analysed, and interpreted.)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the advantages of observation?

A
  1. It allows the researcher to gather behavioural data without asking questions
  2. The data obtained through observations of events as they normally occur are generally more reliable and free from respondent bias
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the disadvantages of observation?

A
  1. Only actions and behaviour can be observed, opinions and attitudes remain hidden
  2. Observer bias: (also called experimenter bias or research bias) is the tendency to see what we expect to see, or what we want to see. When a researcher studies a certain group, they usually come to an experiment with prior knowledge and subjective feeling about the group being studied
  3. Ethics: do you need consent to watch people’s behaviour? In what places and circumstances? Think of camera’s, private activities, in buildings versus outside, etc.
  4. Time consuming
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What different types of observation do we distinguish?

A

• Controlled vs Uncontrolled:
this refers to whether the surrounding in which the observation takes place is altered for the sake of the observation

Ex: Uncontrolled (= observing the natural setting)

• Participant vs Non-participant:
this refers to whether the observer interacts in the observation

Ex: Participant (= researcher is involved)

• Structured vs Unstructured:
this refers to whether the criteria that are noted in the observation are predetermined

Ex: Structured (= predetermined criteria, e.g. by means of a questionnaire)

Ex: Concealed (= hidden, e.g. by camera’s)

• Concealed vs Unconcealed:
this refers to whether the participant know they are being studied

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The questions with observations always remains: “To what extent should you as a researcher participate?”

It depends on factors such as?

A
  • research question
  • ethical consideration
  • methodological aspects
  • preference of the researcher
  • people to be studied
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What different types of participation are there?

A

• Complete participation:
the researcher lives/works with the subjects under study and may conceal that he/she is an observer

• Moderate participation:
the researcher observes the scene under study, maintaining a certain distance from it and never intervening + the role is one of a passive witness or bystander

(Ex. shadowing)

• Active participation:
the researcher does not conceal that he/she is an observer but explains the fact that he/she is an observer to the social group under study right from the start; he/she engages in the activities under study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When you conduct an observation you have to/need?

A

• Obtain permission.
Getting into the location of whatever aspect of the human experience you wish to study. This means going to where the action is – people’s communities, homes, workplaces, recreational sites, places of commercial interaction, sacred sites, and the like.

• Find ‘sponsor’.
You are responsible for securing a sponsor that will allow you to observe/show with them.

• Establish rapport.
The point of participation is that you wish to observe and learn about the things people do in the normal course of their lives. That means they have to accept you, to some extent, as someone they can “be themselves” in front of.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Structured observation uses ..?

A

Coding schemes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are codings schemes?
When is it used?
What are the advantages?
What does a standard coding scheme include?

A

Structured observation uses a coding method for data collection. Coding is using previously determined specific behaviours or actions that qualify as manifestations of the behaviour of interest.
Ex: hospitable behaviour

Advantages:
• Coding allows for observations to be quantitive 
• bring focus
• objective
• easy to use

Standard coding schemes include:
• simple checklist
• sequence record
• sequence record on time scale

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the three different interview structures that we distinguish?

A

• Unstructured interviews:
- The interviewer does not enter the interview setting with a planned sequence of questions to be asked of the respondent.

• Structured interviews
- Conducted when it is known at the outset what information is needed

  • The interviewer has a list of predetermined questions to be asked of the respondents either personally, through the telephone, or via the computer.

• Semi-structured interviews
- While a structured interview has a rigorous set of questions, which does not allow one to divert, a semi-structured interview is open, allowing new ideas to be brought up during the interview as a result of what the interviewee says. The interviewer in a semi-structured interview generally has a framework of themes to be explored.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Because of what does bias frequently occur in interviews?

A
  1. The researcher phrases the question in a particular way
  2. The researcher inflects the voice in a particular manner
  3. The respondent provides an answer that he/she believes is what the researcher would like to hear, even though it is not factual
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How can bias be reduced in an interview?

A
  1. Choosing the appropriate environment in which the interview is conducted
  2. Establishing trust with the respondent
  3. Phrasing questions so that they do no lead the interviewee to respond in a particular manner
  4. Clarifying issues when the respondent seems confused
  5. Not coming across as evaluative or judgmental
    Not placing special emphasis on specific words
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is bias in an interview?

A

Bias is an error that creeps into information gathered.
It occurs whenever incorrect information is provided to the researcher by whoever offers the information.

PRE-CONCEIVED JUDGEMENT about an interviewee, conscious or unconscious.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What types of interviews are there?

A
  1. Personal (face-to-face) interview
  2. Telephone interview
  3. Self-administered interview
  4. Group interview [focus group, expert panel]
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are the advantages and disadvantages of personal (face-to-face) interviews?

A

Advantages

  • Can clarify doubts about questionnaire
  • Can pick up non-verbal cues
  • Relatively high response/cooperation
  • Special visual aids and scoring devises can be used

Disadvantages

  • High costs and time sensitive
  • Geographical limitations
  • Response bias/ Confidentiality difficult to be assured
  • Some respondent are unwilling to talk to strangers
  • Trained interviewers
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the advantages and disadvantages of telephone interviews?

A

Advantages

  • Discomfort of face to face is avoided
  • Faster / Number of calls per day could be high
  • Lower cost

Disadvantages

  • Interview length must be limited
  • Low response rate
  • No facial expressions / body language
17
Q

What are the advantages and disadvantages of Self-administered interviews?

A

Advantages

  • Low cost option
  • Expanded geographical coverage
  • Requires minimal staff
  • Perceives as more anonymous

Disadvantages

  • Low response rate in some modes
  • No interviewer intervention possible for clarification
  • Cannot be too long or complex
  • Incomplete surveys
18
Q

What are the advantages and disadvantages of group interviews [both focus group and expert panel]?

A

Advantages

  • Time & cost efficient (can interview many people at once)
  • Different opinions can stimulate a deeper discussion on the research topic
  • Creativity of the group can be used to generate new ideas

Disadvantages
- More experiences moderator needed to lead the discussion
- Peer/group pressure can provoke socially expected answers
- Dominant respondents can influence the opinion of the group, and thus overshadow individual opinions

19
Q

What is a questionnaire/ survey?

A

A questionnaire is a pre-formulates, written set of question to which the respondent records his or her answers.

20
Q

What are the advantages and disadvantages of a questionnaire (over an interview)?

A

Advantages
o Relatively cheap
o Results can be gathered quickly
o Less skill is required from the questioner
o Standardized answers that make it simple to gather data

Disadvantages
o Not always sure the respondent understood the question
o The information gathered is limited to the answer possibilities
o Often low response rates, often leading to non-response bias: those that answer may be different with regards to the content of your questionnaire than those who don’t answer
o Sampling techniques are crucial in order to avoid sample bias

21
Q

What is non-response bias?

What is sample bias?

A

-

22
Q

What types of ways to administer questionnaires are there?

A

Personally administered questionnaire
- Where an interviewer presents the items orally and notes the answers

Mail questionnaires
- where the items are presented on paper and the respondents notes the answer

Electronic questionnaire
- where the items are presented on the computer and answered by means of the computer

23
Q

What types of questions are there?

A

An open-ended question asks the respondent to formulate his own answer, whereas a closed-ended question has the respondent pick an answer from a given number of options.

• open-ended questions
The answer to open-ended questions are often coded into a response scale afterwards (this requires judgement from the researcher) or presented as word clouds or other ways to give an impression of the answers given by the respondents.

• close-ended questions
The response options for a closed-ended question should be exhaustive and mutually exclusive. The response options define the measurement level of the variable the question is measuring.

24
Q

Examples of open-ended questions are..?

A

What is the first word that pops up in your head when thinking of beer with pasta?

How much (in euro’s) are you willing to pay for a night out with friends?

25
Q

Examples of close-ended questions are..?

A
-	What is your age?
o	Younger than 30 years
o	Between 31 and 60 years
o	Older than 60 years
o	I don’t want to answer
  • In what phase of the study program are you?
    o First phase
    o Second phase
    o Third phase
  • On a scale of 1-10 would you recommend studying at HTH to friends and family (1 means: not at all, and 10 means: absolutely)?
    1 2 3 4 5 6 7 8 9 10
26
Q

What is the order of questions?

A
  1. Start with questions that filter the right respondents: if you only want respondents younger that own their house, ask a question about this at the start
  2. Ask easier, less sensitive questions in the beginning: take care the respondent is interested in the topic and willing to cooperate
  3. Ask the more sensitive questions (about opinions, attitudes, salient behaviours etc.) towards the end
  4. Demographic questions should be placed at the end because at this moment respondents are less likely to quit when asked these personal questions
  5. Avoid open questions that require thinking, as this may respondents decide to quit. If necessary, pose these at the end when respondents feel more committed to answering.
  6. Of course, the questionnaire should be introduced with a short explanation and at the end the respondent is thanked for their cooperation.
27
Q

Do’s and don’ts for creating a questionnaire? (11)

A
  • Shirt and simple (to increase the response rate)
  • Use ordinary words
  • Use statements that are interpreted similarly by your respondents
  • Use correct spelling, grammar and punctuation
  • Avoid ambiguous questions and words
  • Avoid double-barrelled questions (asking two things in one question)
  • Avoid leading or biasing questions
  • Be aware of social desirability
  • Avoid recall depended questions
  • Avoid double negatives
  • Limit the length of the questions (less than 20 words)
  • In order to measure opinions, use positive and negative statements
  • Do not make assumptions about the respondent
  • If possible, promise anonymity
28
Q

Advantages & disadvantages of Personally administered questionnaires?

A

Advantages
• Can establish rapport and motivate respondent
• Doubts can be clarified
• Less expensive when administered to groups of respondents
• Almost 100% response rate ensured
• Anonymity of respondent is high

Disadvantages
• Explanations may introduce a bias
• Take time and effort

29
Q

Advantages & disadvantages of Mail questionnaires?

A

Advantages
•Anonymity is high
• Wide geographic regions can be reached
• Token gifts can be enclosed to seek compliance
• Old-fashioned and obsolete
• Respondent can take more time to respond at convenience. Can be administered electronically, if desired.

Disadvantages
• Response rate is almost always low. A 30 % rate is quite acceptable.
• Cannot clarify questions
•Follow-up procedures for non-responses are necessary

30
Q

Advantages & disadvantages of Electronics questionnaires?

A
Advantages
• Easy to administer 
• Can reach globally
•Easy to access specific target groups
• Very inexpensive 
• Fast delivery
• Respondents can answer at their convenience like the mail questionnaire
•Automatic processing of answers

Disadvantages
• Computer literacy is a must
• Sampling issues
• High non-response
• Not always possible to generalize findings
• Respondent must be willing to complete the survey
• People find invitations via email rude and offensive; mails are deleted or people complain