04 Research Design - Data collection

Question 1

Questions on: Panke, Diana (2018): “Making Choices between Methods of Data Collection”.
(1) What, according to the author, is a good starting point “to find possible indicators that capture the phenomenon of interest”?

Answer 1

• find indicators for each dependent and independent variable
• identify possible empirical indicators
• identify the best-suited option for the operationalisation thereof
• therefore it is necessary to research relevant literature in order to find existing work with similar hypotheses or/and variables
• however variables and their operationalization may vary, depending on the phenomenon of interest, the author used “power” as an example (e.g. political power, economic power, military power)

Question 2

(2) What are good indicators?

Answer 2

• the level of precision of an indicator is usually lower in quantitative projects than in qualitative ones - however, to find suitable indicators one has to see if the indicators are …
• … valid (does it capture the concept that you seek to operationalise?)
• … reliable (does it measure what you seek to capture in a consistent manner?). It is if other people would achieve the same result.
• … practical (data needs to be available, if not it needs to be collected)

Question 3

“Overview of Data Sources and Methods of Data Collection”
Databases and Compendiums
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 3

• Databases are the collections of empirical data represented in quantities.
• Compendiums and yearbooks are quantifiable data represented in systemic descriptions.
• Advantage: covers large numbers of cases and provides empirical information on dependent and independent variables without the researchers having to collected data themselves
• Disadvantage: in qualitative research, researches are likely to engage in original data collection themselves -> validity is lower, if the data is collected by others as it may be less fitting and if fewer cases are studied, the less adequate is the reliance on databases and compendiums as data sources
• When used: Compliance research and when great number of observations and hypotheses are needed

Question 4

Primary sources: documents
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 4

• Primary documents such as texts (online, newspapers etc.) from institutions, politicians, parties etc. are used to e.g. compare differences between aforementioned subjects. To collect data it is important to standardise the interpretation of empirical parameters.
• Advantage: - preferable to existing databases if operationalisational precision is present from the database thus primary sources can be used for fine-grained operationalisations of variables
• Disadvantage: primary sources are often not value-neutral (e.g. party manifesto, newspapers etc.) and are biased with a certain purpose aimed at party members or readers; reliability is achieved if the indicator used to measure a variable does so in a consistent fashion, so when you use documents as primary sources a lot of data has to be interpreted, leading to possibly different results

Question 5

Interviews
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 5

• An interview is held in order to acquire new or existing information from the interviewee. There are different types such as fully structured (precise and standard questions and specified answers to select e.g. survey), semi-structured (standardised questions with open answers) and unstructured (flexible questions with open answers) interviews. Usually semi-structured interviews are preferred which are either held in person (allows verbal communication) or via phone.
• Advantages and disadvantages:
• Semi-structured: identical questions allow for comparisons although open answers reduce reliability due to interpretation
• Unstructured: adds different perspectives due to high interactivity and flexibility but reduces systematic data gathering commonalities
• Fully structured: very good comparability due to selection of answers, but less flexibility
• When to use: if you want to capture actor perceptions, ideas, positions and recollections of events in a fine-grained manner (the more current the event is, the more accurate the answers will be)

Question 6

Surveys and Questionnaires
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 6

• Instrument to gather novel data for medium-N and quantitative research projects, most commonly fully structured, non-verbal interview, with specific questions and specific answers to select.
• Advantage: allows for original data to be obtained, and one survey can be created and sent to a large size of people; “one size fits all” - standardised questions and standardised answers, fine-grained operationalisation
• Disadvantage: large number of people are needed for representative results as response rates for surveys can be quite low
• When to use: more efficient for snapshot data (here and now, instead of based on a historical event e.g.), it is good if a large number of respondents are needed (based on quantitative research compared to interviews that are rather based on qualitative research)

Question 7

Focus Groups
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 7

• Focus groups are interactive settings in which the facilitator asks questions and steers discussions and interactions among the participants. Structured, interactive discussions with and among several participants at a time that allows the researcher to witness a social interaction and gather information on role and gender dynamics as well as challenges, identity roles, the use of norms, social practices, beliefs, attitudes and values within the process. The data gathered is comparable to unstructured or semi-structured group interviews with the difference that the
  interaction is taking between the people in which the researcher’s role is the role of a facilitator.
• Advantage: the facilitator can record the entire session in order to examine it. It allows for standardised questions
• Disadvantage: It is important to “force” an interaction by selecting people with different backgrounds, values etc., so the people have to be identified beforehand by their differences. Furthermore, the results are subject to the facilitator’s interpretation.
• When to use: in order to generate snaphots of individual and collective ideas, norms, values, identities etc. to observe social constructions in practice, mainly used in sociology and ethnology

Question 8

Participant Observation
(3.1) Explain the method in two sentences.
(3.2) What are the advantages and disadvantages of the method?
(3.3) When should the method be used as a method of data collection?

Answer 8

• It is used to observe social group in action (family, school class, employees, etc.) to observe information on social practices, norms, rules and identities. Compared to focus groups, there is no active role of the researcher, but a passive one which at best is free of any influence towards the participant. It also can occur without the knowledge of the participants.
• Advantage: compared to focus groups, it can reduce self-reporting and appropriateness biases, especially if the observation is occurring covertly. Covert observation can also occur without the knowledge of the participants.
• Disadvantage: can lead to overgeneralisation based on the findings of only one group; ethically problematic if observations are done without permission;
• When to use: to gather information related to social practices, norms, rules and identities without steering the observed group.

Question 9

What is “triangulation”, why is it important and when should it be used?

Answer 9

• Triangulation means that more than one method of data collection is used in order to complement and cross-check the obtained data
• Good indicators are valid, reliable and use available and trustworthy sources
• Thus if one of these criteria is not fulfilled, triangulation can be used to limit or reduce possible biases
• e.g. there is an election poll posted on a newspaper that does not include all parties, so another newspaper is selected that includes all parties and adds up to 100% of the poll

Question 10

Which are Quantitative methods of data collection

Answer 10

Databases and compendiums
Documents (e.g., speeches; parliamentary debates)
Surveys

Question 11

Which are Qualitative methods of data collection

Answer 11

Documents
Interviews
Focus groups
Participant observations