psych 218 - F Flashcards

1
Q

t-test

A
  • used when population sample (μ) is specified, but population standard deviation (σ) is unknown
  • when using it:
    • set a hypothetical population mean, assuming null is true (difference between pre and post will be 0)
    • estimate population standard deviation (σ) from the sample (s) because it is our best guess
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

z-test v t-test

A
  • t-test uses standard deviation of the sample (s), while z-test uses it from the null population (σ)
  • difference in formulas:
    • t-obt: divide by standard error of the sample (σ x̄) instead of standard error of the mean (s x̄)
    • standard error: use s instead of σ
  • need to consider sample size when using t-test (unlike z-distribution that is always normal) at N ≥ 30
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

t-test and impact of using standard deviation (s)

A
  • as we’re assuming that s = σ, we will be systematically underestimating σ
    • will think there is less variability than there actually is
  • correct for this using degrees of freedom
    • degree of freedom: # of scores that are free to vary in calculating that statistic
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

t-distribution

A
  • becomes closer to the normal distribution as degrees of freedom increases
    • peak gets higher and higher
  • gets closer to normal distribution because sample size increases (estimate of s = σ gets closer)
  • t-distribution will have more extreme values than z-distribution (because there is more variability in t due to estimate of s = σ)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

reporting conclusions

A
  • specific statistical language:
    Ho: x̄ = μ, H1: x̄ ≠ μ
  • t-test:
    Students at UBC check their phones reliably less than the population, t(23) = -6.86, p < 0.001, d = -1.40
  • bivariate correlation:
    there is a small, positive and reliable correlation between current salary and number of months of hire, r(472) = 0.08, p(1-tail) = 0.30
  • confidence intervals:
    Our lightbulbs had a long life, Cl-95% [213.52, 216.48]
  • ANOVA
    a one-way ANOVA revealed a reliable difference in memory SPAN between the 3 stimulus types, F(2, 14) = 15.86, p < 0.001, η2 = 0.537
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

cohen’s d effect sizes

A
  • captures magnitude of the effect (part of descriptive stats)
  • expressed in original units of measurement (only useful of original units are meaningful)
  • allows us to compare across different studies (put on the same scale by dividing by s in the formula)
  • d = 1 means sample mean is 1 above the population mean
  • how to get a larger effect size?
    • decrease SD by conducting a more controlled experiment
    • increase strength of manipulation (to have bigger difference between x̄ and μ)
    • choose what groups to investigate (to have bigger difference between x̄ and μ)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

types of t-test

A
  • single sample t-test
    • compares difference between x̄-obt - μ
    • use Cohen’s d^
  • paired samples t-test
    • compares difference between x̄-pre - x̄-post
    • use Cohen’s d-z
    • potentially more powerful because it maximizes possibility of a high correlation between the scores
  • independent samples t-test
    • compares difference between x̄1 - x̄2
    • use Cohen’s d-s
    • use weighted standard deviation when n1 ≠ n2
    • has a more efficient use of df (higher df = lower t-crit)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

results of a t-test

A
  • larger t-obt value = higher likelihood that null would be rejected = a more powerful test
  • how to increase t-obt?
    • increase real effect of IV (will increase numerator)
    • increase sample size (will decrease denominator)
    • decrease variability through controlled experiments (will decrease denominator)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

assumptions of the independent t-test

A
  • sampling distribution is normally distributed
  • homogeneity of variance (if σ1 ≠ σ2, the 2 samples are probably not from random samples)
  • t-test is robust, and thus insensitive to violations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

confidence intervals

A
  • range of values that probably contains the population value (how confident are you that the range of values capture the true value)
    • center of interval will be the mean of the data
  • very sensitive to sample size
  • shows how much the regression line can be tweaked based on the variability of the sample and sample size
    • if p < 0.05, confidence interval will not allow the slope to be negative (X and Y will have positive relationship no matter what)
  • we can choose our confidence levels
    • larger cl = less practically useful because it will include a wider range of values to expect
    • 95% confidence interval: check for t-0.025 (divide 5% by 2)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

SD v CL

A
  • sd: describes variability of observations around a statistical model
    • how much do observations differ from sample mean / regression line?
    • i.e. variability of x around x̄
  • cl: describes variability of statistical model itself
    • how different might sample mean / regression line be if we collected a new sample?
    • i.e. variability of x̄ around μx̄
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

F-test (ANOVA)

A
  • use for any experiment when comparing more than 2+ groups of IV
  • one-way ANOVA: one IV with 3 different levels
    • can make 1 overall comparison to find significant difference between means of the 3 groups
    • 500 mg pill, 1000 mg pill, placebo pill
  • factorial ANOVA: experiment with multiple IVs
    • must be fully factorial (= have all the conditions)
    • dose (500mg, 1000mg, placebo) and schedule (x1, x2)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

ANOVA assumptions

A
  • sampled populations are normally distributed
  • DV is interval or ratio
  • homogeneity of variance
    *but ANOVA is generally robust to these assumptions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

limitations of ANOVA

A
  • cannot say any of these means are higher from the other means
    • can only say:
      • [1] all means differ from each other
      • [2] there is a difference from at least 2 means that is different
  • conclusions are also non-directional (not satisfying)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

why ANOVA instead of several t-tests

A
  • would need to do 3 tests (A & B, B & C, A & C)
    • as # of test increases, α increases
    • added probability of making type I error would increase
  • doing α/3 will be too conservative (> will lose statistical power)
    • beta will increase greatly > won’t detect real effect when there is one
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

ANOVA formula

A
  • numerator: sum of squares for difference between each group mean and the grand mean
    • known as MS-betw: mean squares of the squared deviations
    • degree to which each mean is different to the grand mean
    • effect, systematic: quantifies how much DV varies as function of IV
  • denominator: sum of squares within each group
    • known as MS-within: mean squares error
    • average corrected scores around respective sample means
    • how dispersed individual data is from the sample mean (how variable are the observations around the sample mean)
    • error, residual: quantifies how much DV varies as a function of individual differences
      • error: individuals are different from one another
      • residual: the residue leftover after we understand the effect of the IV
  • ideal case:
    • large MS-between = IV has a strong effect (= when sample means are different from one another)
    • small MS-within = no participant differences
  • ratio of MS-between / MS-within can be reinterpreted as
    • (variance + IV effect) / variance
    • (effect variance + error variance) / error variance
  • what ratio means
    • if F > 1: IV has an effect
    • if F < 1: IV has no effect
17
Q

degrees of freedom for ANOVA

A
  • numerator df corrects SS between groups
    • calculates one s^2 of k groups around grand mean
    • df = k - 1
  • denominator df corrects SS within each group
    • calculates k number of s^2, one for each group
    • df = N - k
  • k = number of levels in the IV
18
Q

size of effect in ANOVA

A
  • measured using omega-squared (ω2) or eta-squared (η2)
    • similar to r2: provides estimate of proportion of the total variability of Y accounted for by X
    • ω2 is relatively unbiased
    • η2 is more biased (larger than true size of the effect)