Chapter 2 Review - Critically Assessing Quantitative Data

Question 1

R-Squared

Answer 1

The percentage of the response variable variation that is explained by a linear model.

Question 2

When reading multivariate analysis, ask yourself three things, and you will answer them with three things.

Answer 2

Which variables in the model are statistically significant? Answered them with p-values.
What is the nature of the relationship between the DVs and IVs when controlling all other variables? Regression coefficients for individual IVs.
What percentage of variation is explained by the model as a whole? R-squared.

Question 3

Dummy Variables

Answer 3

A measure in which a quality is dichotomous and is represented by the presence and the absence of the quality, usually using the values of 0 and 1. (Ex.: female = 1, non-female = 0)

Question 4

Three Arguments in Political Science Research, Questions to Ask Thereof, and How to Assess Them

Answer 4

1. Descriptive claims
2. Claims of difference between groups
3. Claims of a relationship between two variables
4. Is the sample representative?
5. How large are the differences? Are they due to chance?
6. How strong is the relationship? Is it due to chance? Is it a causal relationship?
7. Sampling
8. Look at magnitude of difference to determine substantive significance. Determine statistical significance.
9. Look at measures of association. Look at statistical significance. Look at relationship after controls. Consider all causal criteria.

Question 5

4 Aspects of Trustworthiness

Answer 5

Authenticity
Precision
Portability
Impartiality

Question 6

Authenticity:

Definition, Prerequisite, and Examples of how to achieve it

Answer 6

Definition: To what extent is the recorded data a true reflection of reality?
Prerequisite: measurement validity (aka the extent to which the way concepts are measured is a genuine reflection of the concepts)
Achieved by: unambiguous and exhaustive conceptual definition, and full presentation of measures

Question 7

Two Sub-types of Measurement Validity

Answer 7

Face and construct

Question 8

Ways to determine measurement validity

Answer 8

are concepts clearly defined?
do measures match the conceptual definition?
are measures clearly stated?
are strengths and limitations discussed?

Question 9

Precision:

Definition and Prerequisite

Answer 9

Definition: results offer an accurate account of reality
Prerequisite: replicability

Question 10

How to look for replicability

Answer 10

Clear discussions of methods used
Published/accessible data
Discussion and linkage to past research

Question 11

Portability: Definition and Prerequisite

Answer 11

Definition: Results applicable in some way to another environment
Prerequisite: External validity

Question 12

How to look for external validity

Answer 12

Detailed discussion on population and sample selection

Discussions of limitations and sampling

Question 13

Impartiality: Definition and Prerequisite

Answer 13

Definition: the extent to which a study offers findings based on observations and evidence, not on opinion or conjecture
Prequisite: objectivity

Question 14

What to look for: objectivity

Answer 14

Reporting funding

Reporting conflicts of interest

Question 15

Three Challenges for Consumers of Social Science Research

Answer 15

Assessing:
Quality
Relevance
Objectivity

Question 16

Argument

Answer 16

Series of logical statements that lead to a conclusion, with reasons offered to support that conclusion.

Question 17

Three Reasons Research Design Matters

Answer 17

Sample differ in generalizability
Studies differ in the appropriateness of their measures
Limitations due to feasibility are still limitations