Ch. 6 - Interviewing Flashcards
The Survey Interview
- research conducted by the Vovici Company in 2010 (through a survey, of course) revealed that American adults are asked to take part in surveys 7 billion times each year and that the 80% who claim to complete the surveys they start provide 2.6 billion responses
- some of these are conducted F2F at home, malls, businesses, sporting events, hospitals, but a growing number are being conducted over the phone and via the Internet
- as the number of surveys has continued to escalate, so has the unwillingness to participate
- potential interviewees are concerned about confidentiality, privacy, telemarketers, survey accuracy, biases of survey organizations, and benefits to themselves and society
- overall there has been a markedly negative shift in attitudes toward public opinion researchers and polls across several dimensions between the mid 1990s and the first decade of the 2000s
- survey interviews: reliability (assurance that the same types of information are collected in repeated interviews) and replicability (the duplication of interviews from respondent to respondent) are essential characteristics and interviewers operate from meticulously planned and highly structured interviews during which they may ask only preplanned probing questions
- surveys reach out and touch everyone
- survey interviews are neither flexible nor adaptable
Purpose and Research
- survey interviews have multiple purposes
- before you start thinking about questions or ppl you may interview, determine precisely the purpose of your survey. the types of information you NEED to discover and HOW you will USE this information determine whether you will conduct a qualitative or quantitative survey.
- you will use a qualitative approach if you want to explore ideas and feelings, dig deeply into an issue, discover motivations, understand different perspectives, and understand behaviors
- your findings are presented in narrative from in which words are critical
- you will use a quantitative approach if you want to determine frequencies of behavior, degree of feelings, consensus of opinions, causes and effects, preferences,, averages and make predictions or strategic decisions.
- your findings are presented in quantitative form in which numbers are critical.
- your needs and q’s may be tempered by the optimum length of your interviews.
- they may be as brief as three to five mins or as long as 15-20 mins.
- longer timed interviews cover more areas of interest - essential for qualitative surveys, and are more reliable, but they may be unnecessary or detrimental in quantitative surveys designed to determine a few attitudes or intentions.
Purpose and Research
- longitudinal studies reveal trends and changes over time
- don’t assume adequate knowledge of a topic
- don’t waste time learning what you already know
- one additional factor-time-will shape your purpose.
- you may have to complete a survey almost overnight to determine reactions to an event such as a political debate or a court decision, and this limits your purpose to a few questions probably conducted over the telephone
- other topics or issues may require weeks or months and allow you to develop longer and more complex interviews that delve thoroughly rather than superficially.
- time also determines the type of survey you need to conduct
- a cross-sectional survey takes a slice of what is felt, thought or known during a narrow time span and is used when you need to determine how interviewees are reacting at present.
- a longitudinal survey determines trends in feelings, thought or knowledge over time.
Purpose and Research
- as soon as you have a clearly define purpose, investigate all aspects of the topic.
- explore past, present and future as well as proposed and attempted solutions
- check resources such as organizational files and archives, correspondence and interviews with knowledgable people, government documents, professional journals, books, previous surveys on this topic, the internet, news magazine and news papers
- research reveals info already available in other sources that need not be gathered in your survey
- become and expert on the topic, particularly unique terminology and technical concepts
- you must determine the precise and understandable meaning of keys terms so they are clear to interviewees and acceptable to those who may read or use your results to form opinions or take actions.
- research will reveal past attitudes and opinions and speculations about current attitudes and opinions.
- thorough knowledge of the topic provides insights into areas you need to explore, the complexities of an issue, and potential intentional and unintentional inaccuracies in answers during interviews.
Structuring the Interview:
Interview Guide and Schedule
- when you have a precise purpose and conducted necessary research, develop a highly structured interview
- an interview guide is essential for survey interviews bc it dictates the topics and subtopics you will cover and primary and probing questions to be asked.
- begin your interview guide by listing major areas. for ex., if you are planning to survey Illinois educators on ways to reform the public schools in their state, major topics might include state-supported, all day kindergarten, parental involvement in the education process, etc
- if you are conducting a qualitative survey, you may develop a highly scheduled interview that includes open-ended questions, planned probes, and the possibility of unplanned probes that depend on the interviewee’s responses.
- there is a degree of flexibility in questioning bc you are more concerned about depth of information than with statistical compilation of data
- the traditional interview guide (who, what, when, where, how and why) may be adaptable to qualitative surveys, but surveys often require a more detailed guide and schedule that ensures complete coverage of a topic or issue and the manner of organizing, reporting and interpreting answers
- if you are conducting a quantitative survey, you must elicit answers that are easy to record, tabulate and analyze. the flexibility and adaptability of the qualitative survey may lead to difficulties in coding and tabulation of results, so you will rely one a highly scheduled, standardized format that ensures replicability of interviews and accurate compilations of findings
- a detailed guide is easily transformed into a scheduled format
- standardization is essential for surveys
The Opening
- although each interview is unique, like a small work of art with its own ebb and flow, a mini-drama that invovles real lives in real time, each respondent must go through as identical an interview as possible.
- compose an opening that typically includes a greeting, name of the interviewer, the organization conducting the survey, subject matter of the interview, purpose, amount of time the survey will take, and assurance of confidentiality.
- encourage interviewers to give this opening verbatim without reading it our sounding stilted
- to make the opening sound more natural, you may allow skilled interviewers to create their own openings as long as each opening includes all of the elements you have stipulated
- there are no icebreaker questions or small talk in surveys
- identify the interviewer and org, state the general purpose and length of interview. the survey schedule can provide instructions for the interviewer to follow and precode the question for ease of tabulating results when survey is completed
The Opening
- the opening may not identify the group that is paying for it (political president, a pharmaceutical company, special interest groups) or the specific purpose (to determine which strategies to employ during a political, advertising, or lobbying campaign) bc such information might influence how the interviewee responds
- when a newspaper such as The New York Times or the Washington Post, a cable or TV network such as CBS or CNN or a well known polling group conducts a survey, the orgs name is used to enhance the prestige of the poll and the interviewer, to reduce suspicion that a candidate or corporation is behind the survey, and to motivate ppl to cooperate
- interviewers may have to show identification badges or letters that introduce them and establish legitimacy as survey takers
- bc of the increase of refusals to take part in surveys, particularly those online, and the fact that the quality of survey results depends on response rates, creators of surveys have increasingly focused on incentives ranging from simple assurances to prepaid monetary offers as high as $40 per interview
The Opening:
- incentives tend to come during the opening minutes of the interview when the interviewer must motivate a contact to take part in a survey
- although some research indicates the obvious, that the higher the financial incentive the greater the likelihood of participation, even token incentives may improve response rates
- on study showed that a simple prepaid ballpoint pen incentive made during the opening increased response rates and result in greater completeness in answers during the early portion of a survey interview
- non-monetary incentives included the civic obligation to help others and to be active citizens, establishing credibility of the org conducting or sponsoring survey, and stress the brevity of the survey for those with little available time.
- some survey researchers are concerned that emphasis on incentives may persuade some persons to take part to their detriment.
The Closing
- the closing is brief and expresses appreciation for the time and effort expended to aid the survey. for example: that’s all the questions I have. Thank you very much for your help
- if the survey organizer wants a respondent’s telephone number to verify that a valid interview took place, the closing might be: that’s all the questions I have. May I have your telephone number so that my supervisor can check to see if this interview was conducted in the prescribed manner? (gets the number) thank you very much
- if you can provide respondents with results of a survey, a common practice in research interviews, the closing might be: that’s all the questions I have. Thanks for the help, if you’ll give me your address I’ll be sure that you receive a copy of the results of this study. (gets the address) Thank you very much
- some interviewees are reluctant to give their telephone numbers or email addresses to strangers. be prepared to back off from either request if the person appears anxious, suspicious or very reluctant.
- do not sacrifice the rapport and good will you created during the interview
- interviewees tend to prefer anonymity
The Closing
- when one of the authors was conducting polls for a political party, he discovered many ppl did not want to give their phone numbers for fear they’d be deluged with calls from candidates during the campaign.
- with permission from the party, he stopped asking for phone numbers and the closing went much smoother
- ppl may be curious about as survey or interested in the topic and want to discuss it. this can be a good relationship builder and motivator for taking part in future surveys, but do so only if time permits, the interviewee will have no opportunity to talk to future interviewees, and the survey organization has no objections.
Survey Questions:
- create each question carefully bc you cannot rephrase, explain or expand on questions during interviews without risking your ability to replicate interviews, an essential element in surveys
- in quantitative surveys, all q phrasing and strategic decisions are made in the planning stage; not on the spot.
- in qualitative interviews, all primary questions and most probing questions are planned ahead of time
- interviewers cannot make on-the-spot adjustments
Survey Questions:
Phrasing Questions
- every word in every questions may influence results
- all interviewees must hear the same q’s asking in the same phrasing and manner
- a slight change in wording, vocal emphasis on a word, or facial expressions can generate different answers.
- “it is okay to smoke while praying”: 90% said no
- “is it okay to pray while smoking”: 90% said yes
- although the q’s sound the same, ppl interpreted them differently
- the first sounded sacrilegious, lighting up while praying. the second sounded like a good idea, maybe even necessary.
- emphasis may change the focus and meaning of simple questions and this is critical in surveys in which you are striving for replicability
- a single word might alter significantly how ppl respond to a question, thereby altering the results of a survey.
- ex. where ppl viewed the word forbid as a stronger and more dangerous action than “not allow” - perhaps un-American, even though the effects of the governmental policy would have been the same.
Survey Questions:
Phrasing Questions
- study discovered that validity was higher when using direct questions that presented response options and that ambiguously phrased questions took longer to ask and answer.
- make each q clear, relevant, appropriate to the respondent’s level of knowledge, neither too complex or too simple, neutral, and socially and psychologically acceptable
- this is not a simple task when ppl may be of both genders, and differ widely in culture, age, income level, education, intelligence, occupation, geographical area, and experiences
Survey Questions:
Phrasing Questions
- the increasing diversity of the American population may result in your target population representing widely diverse continents, cultures and nations
- be careful of using formal names or acronyms for persons or organizations with which your interviewees may not be familiar
- ppl of different cultures may be fluent in English but be confounded with abbreviations, colloquialisms, aphorisms, jargon, euphemisms and slang.
- avoid ambiguous words and phrases such as a lot, often, much, large school, or recently discovered ones that have many and vague meanings
- researchers warn against phrasing q’s negatively bc they can be misleading and confusing
- a negative answer to a negative worded statement may not be equivalent to the positive answer to a positively worded statement
- even the explanation sounds confusing. they give this example: disagreeing with the statement ‘my work is not meaningful’ does not necessarily mean that the same individual would have agreed with the statement ‘my work is meaningful’
- forcing a respondent to disagree with a negative statement can be confusing. think of the difficulties you have had with negatively phrases multiple choice questions on exams.
- many ppl will fail to hear the word “not” in a question during an interview so those in factor of a statement such as ‘the US should not establish diplomatic relations with Iran’ might disagree with the statement. and those who actually disagree may answer the same way. Edwards and Thomas warn, “you may never know which is which”
Survey Questions:
Sample Question Development
- q’s evolve as you develop a schedule, particularly for a quantitative survey. here is how a q about texting while driving might evolve during preparation: How do you feel about the state-imposed law against texting and driving?
- take a closer look at this seemingly neutral q. “state imposed” may bias results bc it may sound tyrannical and unconstitutional to some respondents. the openness of the question and the ambiguity of the word “feel” may result in a wide range of answers, some positive and some negative. others may give long answers for and against the law that will create recording and coding nightmares.
- try a second version that closes up the question and eliminates the word “state-imposed”
- are you for, against, or have no feelings about the state’s law against texting while driving?
- this version eliminates the potential bias of the first, resolves recording issues, but it may be too closed for qualitative and quantitative purposes.
- develop a third version: do you strongly agree, agree, disagree, or strongly disagree with the state law against texting while driving
- this option assess intensity of feelings, is easy to record and code, leaves undecided as an unstated option, provides instructions for interviewers and includes built in secondary “why” questions to discover reasons for strong approval or disapproval.
- build in secondary q’s for reasons, knowledge, level and qualifiers
- work with each question until it satisfies phrasing criteria and is designed to obtain the info needed. careful phrasing avoids confusion and inaccurate results
Survey Questions:
Probing Questions
- less frequent and usually planned in survey interviews. for instance, if a respondents gives an unclear answer, you might ask “what do you mean by that” “how do you mean that?” “what I hear you saying is…”
- if a respondent gives a very brief answer or appears reluctant to elaborate, use a silent probe a nudging probe, or an informational probe such as “tell me more about that”
- if you are unsure a respondent has told you everything of relevance to the question, use a clearinghouse probe such as “anything else?”
- remember to record probing questions and answers carefully, clearly, accurately for later tabulation and analysis.
- your goal is to perform nearly identical survey interviews over and over. one the spot probing may result in interviewer bias if you or other interviewers phrase q’s verbally or nonverbally in ways that suggest the answers you prefer or lead different ppl to provide different answers
- if some interviewers ask probing questions and others don’t, the amount and type of info attained will differ from one another and result in unreliable data or data that is impossible to tabulate and analyze with a degree of confidence.
Survey Questions:
Question Strategies
- there are five question strategies that enable interviewers to asses knowledge level, honesty and consistency; reduce undecided answers; prevent order bias; and incorporate probing questions
- Filter Strategy
- Repeat Strategy
- Leaning Question Strategy
- Shuffle Strategy
- Chain or Contingency Strategy
Question Strategies:
- The Filter Strategy
- the filter strategy enables you to determine interviewee knowledge of a topic.
- are you familiar with the water company’s proposed rate increase for next year?
- yes I am
- What is the water company proposing?
- if an interviewee says no, go on to the next question. if the interviewee says yes, you ask the person to reveal the extent and accuracy of knowledge.
- this follow-up question may discover that the person is confused or misinformed.
- many interviewees will say yes to bipolar questions even when they have no clue what the interviewer is talking about, to avoid appearing uninformed.
Question Strategies:
- Repeat Strategy
- enables you to determine if an interviewee is consistent in responses on a topic, particularly a controversial one.
- you may ask the same question several minutes apart and compare answers for consistency.
- a variation of this strategy is to disguise the question by rephrasing it.
- do you supervise your children’s use of computers at home?
- do your children have free access to computers at home?
- another example of repeat strategy is to go from a moderately closed to a highly closed question such as: how often during a week do you drink alcoholic beverages?
- I am going to read a list of how frequently you drink alcoholic beverages each weak. stop me when I read the frequency that best describes your drinking
- do not make the repetition too obvious or close to the initial question and be sure the rewording does not change the intent of the initial question
- repeated questions must be essentially the same to determine consistency in answers
Question Strategies:
- Leaning Question Strategy
- respondents may be reluctant to take stands or make decisions, often bc they do not want to reveal their feelings or intentions.
- employ a leaning question, not to be confused with a leading question, to reduce the number of “undecided and “don’t know” answers
- the following isa typical leaning question strategy:
9a. do you plan to vote for or against the school referendum in the fall election (if undecided, ask Q. 9b)
- for
- against
9b. which way are you leaning today?
- for
- against
- undecided
- the “undecided” option remains in question 9b bc an interviewee may be truly undecided at the moment. a variation of the leaning question is “well if you had to vote today, how would you vote?”
- clearly stated “undecided” and “don’t know” options may invited large percentages of these answers, particularly when a q asks for criticism of people, organizations or products.
- however, some sources recommend that you always include “don’t know” or “not applicable” answer options in all questions, unless all interviewees will have a definite answer, to reduce interviewee frustration and provide the most honest and accurate answers.
- leaning questions urge respondents to take a stand or make a decision
Question Strategies:
- Shuffle Strategy
- the order of answer options in questions may affect interviewee responses
- research indicates that last choices in questions tend to get negative or superficial evaluations bc interviewees get tired or bored but that interviewees also tend to select an option bc it is the first mentioned or the last heard.
- the shuffle strategy varies the order of answer options from one interview to the next or prevent order bias
- the method or rotation is carefully explained when training interviewers
- order bias is both fact and myth
- potential order bias has resulted in strange events in political, persuasive, and advertising surveys
- a political candidate in Indiana changed his name legally so it would begin with A. this placed him at the top of the ballot on election day, the belief being that voters select the top names in lists of candidates.
- he lost, but his and similar actions have led states to shuffle names on ballots.
Question Strategies:
- Chain or Contingency Strategy
- highly standardized and highly scheduled formats allow allow for preplanned questions that enable you to probe into answers.
- the chain of contingency strategy is illustrated in the following series from a market survey.
- notice the build in instructions and precoding for ease of recording answers and tabulating data
1a. During the past month, have you received any free samples of breakfast cereal?
yes - Ask Q.1b
no - Ask Q.2a
1b. Which breakfast cereal did you receive? cheerios frosted flakes special k great grains shredded wheat
1c. (ask only if great grains is not mentioned in question 1b, otherwise, skip to 1d)
Did you receive a free sample of Great Grains?
yes - ask question 1d
no - ask question 2a
- all probing questions i surveys are included in the schedule
- replicability means to reproduce interviews
- the chain or contingency strategy enables you to probe into answers while maintaining control of the process and ensuring that each interview is as identical as possible
Question Scales:
Interval Scales
- evaluative interval scales (likert scales)
- frequency interval scales
- numerical interview scales
- a variety of scale questions allow you to delve more deeply into topics and feelings than bipolar questions and to record and tabulate data more easily.
- interval scales provide distances between measures.
- for ex., evaluative interval scales (often called Likert scales) ask respondents to make judgements about persons, places, things, or ideas. the scale may range from 5-9 answer options (five is most common) with opposite poles such as “strongly like….strongly dislike” “strongly agree….strongly disagree” or “very important…..not important at all”
- you may provide respondents with cards (color-coded to tell them apart) for complex questions or ones with many choices or options.
- a card eliminates the faulty-recall problem that respondents experience.
- they can study the answers or objets they are evaluating, rating or tanking without trying to remember all of the options given orally.
- example of card use: please use the phrases on this card to tell me about how the recent TV ads for the new water park has affected your interest in visiting the park
5 increases my interest a lot
4 increases my interest a lot
3 will not affect my interest
2 decreases my interest a little
1 decreases my interest a lot - cards or color-coded cards provide aid for interviewee recall of answer options
Question Scales:
```
Interval Scales
continued
~~~
- frequency interval scales ask respondents to select a number that most accurately reflects how often they do something or use something.
- how frequently do you eat pork?
__ more than once a week
__ once each week
__ every other week
__ once or twice a month
__ less than once a month
__ rarely - frequency scales deal with number of times.
- numerical interval scales ask respondents to select a range or level that accurately reflects their age, income, educational level, or rank in an organization
- I am going to read you several age groupings. please stop when when I read the one that applies to you:
__ 18-24
__ 25-34
__ 35-49
__ 50-64
__ 65 and over