Research Methods

Question 1

Independent variable

Answer 1

A variable that is hypothesized to cause or lead to variation in another variable

Question 2

Dependent variable

Answer 2

A variable that is hypothesized to vary depending on or under the influence of another variable

Question 3

Validity

Answer 3

that state that exists when inferences about empirical reality are correct

Question 4

Measurement validity

Answer 4

When a measurement measures what we think it is measuring

Question 5

Causal validity

Answer 5

When the conclusion that A lead to or causes B is correct

Question 6

Ordinal measurement

Answer 6

A measurement of a variable in which the numbers indicating a variable’s value specify only the order of the cases permitting greater than and less than distinctions (1st, 2nd, 3rd place)

Question 7

Interval measurement

Answer 7

Measurement of a variable in which the numbers represent fixed measurement units but there is not absolute zero (time of day)

Question 8

Ratio measurement

Answer 8

Measurement of a variable in which the numbers represent fixed measurement units and there IS an absolute zero (inches on a ruler)

Question 9

Reliability

Answer 9

A measurement procedure yields consistent scores when the phenomenon being measured is not changing

Question 10

How to assess reliability

Answer 10

Test-retest, Cronbach’s Alpha for inter-item reliability, inter-observer reliability

Question 11

How to improve reliability

Answer 11

Use an existing tool, pre-test the tool, do a cognitive interview for a survey/interview, establish inter-rater reliability for observtions

Question 12

Three features of a true experiment

Answer 12

two (or more) groups–one that is an experimental group and one that is a control group. Random assignment to the two groups, variation in the independent variable before assessing the change in the independent variable

Question 13

External validity

Answer 13

Does the treatment hold for subgroups across populations, settings etc?

Question 14

Elements of Quantitative Methods

Answer 14

Emphasis on scientific method, testing a hypothesis, objectivity, need to quantify. Pro: allows the study of large populations and results using stats and probability

Question 15

Elements of Qualitative Methods

Answer 15

Appreciates subjectivities, multiple perspectives, values depth over breadth and search for more holistic meaning, usually means natural settings. Pro: more intimate understanding of people, places, cultures

Question 16

Mixed methods

Answer 16

Can permit capitalizing on best of the quantitative and qualitative traditions. Allows for inductive (bottom up) and deductive (top down) reasoning. Allows for triangulation of data sources.

Question 17

Type 1 Error

Answer 17

Incorrect rejection of the null hypothesis (false positive)

Question 18

Type 2 Error

Answer 18

Incorrect acceptance of the null hypothesis (false negative)

Question 19

Internal Validity

Answer 19

Did the experimental treatment make a significant difference in this specific instance?

Question 20

Threats to internal validity

Answer 20

Selection, history, maturation, testing

Question 21

Construct validity

Answer 21

Is the study measuring the construct that it is intended to measure?

Question 22

Threats to construct validity

Answer 22

Experimenter expectancies, novelty/disruption effects, Reactivity to experimental situation

Question 23

Logic Model

Answer 23

A graphic depiction of rationale and expectations for the program: resources, activities, outputs, outcomes (short and long term)

Question 24

Dusenbury et al. (2003)

Answer 24

Fidelity of implementation: adherence, dosage, quality of delivery, participant responsiveness and program differentiation.

Question 25

Effect size

Answer 25

The difference in means between the treatment and control groups divided by the pooled standard deviation of the two groups. Important for revealing if a difference between groups is meaningful.

Question 26

Lipsey et al. (2012)

Answer 26

Common benchmarks of effect size are not appropriate for education research where an effect of .30 is considered quite large.

Question 27

Power

Answer 27

A measure of the likelihood of a researcher finding statistical significance in a sample if the effect exists. Power is a function of sample size, effect size and significance level