Chapter 11: Complex Experimental Designs & Inferential Stats* Flashcards

1
Q

Curvilinear relationship

A

requires at least 3 levels of the independent variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Complex (factorial) design

A

research with 2 or more independent variable (i.e. factor) and with each IV also having more than one level; Number of levels of first IV x Number of levels of second IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Factor

A

any outcome that you expect to be related to some outcome variable e.g. IV that affects DV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What 2 distinct kinds of information do factorial designs yield?

A

main effect and interaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Main effect

A

the direct effect of an IV on a DV, ignoring any interaction with other IVs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Interaction

A

When the effect of one IV on the DV depends on the level of another IV; parallel=no interaction; not parallel=interaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Marginal mean

A

average score of all participants in one condition of one independent variable, collapsing across the levels of the other IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Moderator variable

A

third variable that influences the relationship between an IV and DV; effect is revealed as interactions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Simple main effect

A

effect of one IV on the DV at one particular level of another IV; mean difference at each level of one IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

IV x PV design

A

factorial design that includes both an experimental IV and a non-experimental participant/person variable; allows researchers to investigate how different types of people respond to the same manipulated variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Mixed factorial design

A

a factorial experimental design that includes both between-subjects and within-subjects variables (IV x PV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Inferential statistics

A

statistics that estimate whether the results observed based on sample data are generalizable to the population from which that sample was drawn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Statistically significant

A

observing that an outcome has a low probability of occurrence (p-value < .05), assuming that H0 is correct; difference between groups reflects a real difference in population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Significance or alpha level

A

0.05; how willing you are to be wrong if you conclude there is an effect in the population; threshold probability which a test statistic is deemed to be unlikely to have come from sampling distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Steps in null hypothesis significance testing (NHST)

A

(1) Formulate the null hypothesis and assume H0 (2) Collect data (3) Calculate p-value of getting such data or even more extreme data (4) Decide whether to reject or retain H0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Null “dull” hypothesis

A

baseline conservative assumption that IV does not affect DV; No relationship between 2 variables

17
Q

Research hypothesis

A

IV does affect DV; there is a relationship between 2 variables (correlational) or there is a difference in means between experimental groups

18
Q

What are the 2 characteristics of null and research hypothesis?

A

mutually exclusive (cannot have both be true at the same time) and exhaustive (must account for all possible outcomes)

19
Q

High p-value

A

> 0.05; fairly likely that outcome was gotten from chance alone; retain H0

20
Q

Low p-value

A

< 0.05; not likely that outcome was gotten from chance alone; reject H0

21
Q

Sampling distribution

A

frequency distribution of values obtained if a study was repeated an infinite number of times, using the exact same parameters; done to evaluate likelihood of given result based on chance alone

22
Q

t-test

A

NHST statistic used to compare two means; t= group difference (difference between obtained means)/within-group variability

23
Q

F-test

A

NHST test for whether 2 or more means differ in the population

24
Q

True state of affairs

A

truth about the null hypothesis if you could sample the whole population

25
Type I error
false positive; falsely reject the null hypothesis when it is actually true; error rate= alpha
26
Type II error
false negative; retaining the null hypothesis when it is actually false; error rate= beta
27
Power
probability of correctly rejecting the null hypothesis using a particular statistical test; directly related to type II error
28
What 3 factors do power and type II error rate depend on?
sample size, magnitude of effect (effect size), and alpha level
29
Sample size and power
greater sample size, greater power, less error in data to detect effect
30
Effect size and power
larger the difference is in population, easier to detect, thus greater power
31
Alpha level and power
larger alpha level, easier it is to find data consistent with research hypothesis (to reject null), thus greater power
32
P-hacking
a set of ethically questionable practices researcher uses to get statistically significant results
33
Obtained value
in a significance test, a statistic that captures the effect observed in your study; t=difference between means of conditions/(square root of sum of variances/sample sizes)
34
How do you reduce noise to get larger t-values?
consider poorly worded questions, effect of uncontrolled variables, small sample sizes, between vs. within subjects designs
35
Universe of possible values of t
sampling distribution of t or t distribution
36
Relationship between p-values and t-obt; alpha levels and critical values
p-value is the amount of area in the t-distribution that corresponds to a particular value of t-obt; alpha levels correspond to critical values
37
When do your reject or retain H0 in terms of t-obt and t-crit?
Reject H0: t-obt > t-crit; Retain H0: t-obt < t-crit