Introduction to Research Design

Question 1

What are the Objectives of Political Research?

Answer 1

• Aims to address big and smaller questions
• To generate answers with external validity
• To create strong designs that yield accurate, unbiased and relevant answers

Question 2

What does MIDA stand for?

Answer 2

Model, Inquiry, Data strategy and Answer strategy

Question 3

What are the theoretical elements of MIDA research design?

Answer 3

Model and Inquiry

Question 4

What are the empirical aspects of MIDA research design?

Answer 4

Data strategy and Answer Strategy

Question 5

What is the Model?

Answer 5

Represents our understanding of how the world works.
- Speculations about causal relationships, correlations and sequences of events.
- It defines units of study, conditions and outcomes.

Question 6

What is an Inquiry?

Answer 6

Inquiry formulates research questions within the context of our model. Can be causal or descriptive.

Question 7

What is an Estimand?

Answer 7

Part of the Inquiry: The estimand represents the theoretical answer to the Inquiry (research question derived from our model)

Question 8

What is Data Strategy?

Answer 8

Data strategy focuses on measuring and operationalizing elements of our model and inquiry.
- Involves selecting units (sample vs population)
- Conditions (observational vs experimental)
- Measuring outcomes

Question 9

What is Answer Strategy?

Answer 9

Statistical or qualitative methods to summarise and interpret data (cleaning, transforming, estimating data.)

Question 10

How do researchers implement the MIDA framework?

Answer 10

1. Researchers use the MIDA framework to select research designs
2. Researchers can assess the dependencies across design elements by declaring each element (M,I,D,A)
3. Researchers are encouraged to consider real world implications of their design and adjust their strategies accordingly

Question 11

What is a Declaration?

Answer 11

Declaring a design involves identifying which components belong in M, I, D, and A of the MIDA framework.

Question 12

What are the challenges of a Declarations?

Answer 12

Mapping ideas into MIDA isn’t always straightforward but is rewarding.

Question 13

How can you declare a design?

Answer 13

Designs can be declared in words or code, with statistical programming languages like R with the ‘DeclareDesign’ software.

Question 14

Why is it important to declare a design?

Answer 14

Expressing a design in terms of MIDA allows for a deeper understanding of its properties

Question 15

What is a Diagnosis?

Answer 15

Diagnosis involves simulating a research design to understand potential outcomes and properties.

Question 16

Why is it important to do a Diagnosis?

Answer 16

Simulation helps assess features like statistical power, biases, and error rates.

Question 17

What are Diagnostic Statistics?

Answer 17

Summary statistics from a single run of a design, e.g., error or significance.

Question 18

What are Diagnosands?

Answer 18

Summaries of diagnostic statistics across multiple simulations, e.g., bias or power.

Question 19

What is a ‘Success criteria’ in relation to Diagnosis?

Answer 19

Articulating what constitutes success and evaluating the likelihood of achieving it through simulation.

Question 20

What are some concerns regarding Diagnosis?

Answer 20

Risks include incorrect diagnoses and reliance on a narrow set of diagnosands.

Question 21

What is meant by the term ‘Redesign’?

Answer 21

Redesigning involves fine-tuning data and answer strategies to improve diagnosands.

Question 22

What is meant by the term ‘Optimisation’?

Answer 22

Adjusting sample size, data collection methods, or analysis strategies to enhance design properties.

Question 23

What are some constraints to Redesign?

Answer 23

Redesign considers ethical, logistical, and financial limitations.

Question 24

What are the six principles of Research Design?

Answer 24

1. Design holistically
2. Design agnostically
3. Design for purpose
4. Design early
5. Design often
6. Design to share

Question 25

What is meant by ‘Design Holisitically’?

Answer 25

Design with all parts in mind; diagnose the full design, not just the individual parts

Question 26

What is meant by ‘Design Agnostically’?

Answer 26

The design should work across different scenarios