Ch 8 - Statistical Inference (Vogt, 2007) Flashcards
Vogt, W.P. (2007). Quantitative research methods for professionals. Boston, MA: Pearson.
Statistical inference
make inferences from samples to populations (there are 2 ways: CI & hypothesis testing /stat significance)
statistical significance
- the degree to which the data
contradict the null hypothesis; e.g., .05, or 5% - that is If a result is likely to be due to chance less than 5% of the time—the familiar p < .05 OR prob that you are wrong
alpha level
cutoff point
hypothesis testing
cutoff approach
exact p-value
- e.g.,
The p-value is .342, which is bigger than .05. This means that the difference between males
and females on Exam 1 is not significant at the .05
level; you could expect a difference of this size in a
sample of this size 34.2% of the time.
confidence intervals
–e.g. How confident am I that I am right? (prob that you are wrong is stat significance);
gives you all the information
the p-value gives you—plus more
- “we can be
95% confident that the true value in the population is
between . . .”—is not technically correct
- instead, one should prob state
“if we were to take an infinite number of random samples
of this size, in 95% of them the mean would be between.
. . .”
- But be forewarned, if you use the first, occasionally you will encounter fastidious scholars, advocates of the second, who will be disappointed in you
confidence levels
?
effect size (ES)
always report with stat significance;
t-tests
- Would you get a mean difference this big if there were no difference in the populations
from which this sample was drawn? - how do samples differ
- measures stat sign
- are differences big enough that they are unlikely to be a coincidence?
2-direction t-test
- e.g., tests the hypothesis that there is a difference between females and males, but it does not specify which one is bigger
- aka: non-directional t-test
- aka: 2-tailed
- better approach, more conservative
- harder test to pass
- mean difference has to be twice as big for a two-direction test to pass muster as statistically
significant.
statistical power
?
false positive
?
false negative
?
standard error (SE)
- a kind of standard deviation;
it provides an estimate of how much sampling error one is likely to get in a sample of a particular size - Remember that the sampling error is the difference between the population value and the sample value
- so the SE answers the question: By how much is the sample value likely to miss the population value?
- The standard error gives you an estimate of the sampling error; it tells you how much error you
are likely to have if you use the sample to estimate the
population
sampling distribution
?