L8 - hypothesis testing Flashcards
hypothesis testing steps
- Formulate hypothesis
- Collect data
- Construct statistic (t,F,x2..)
- Calculate value
- Check distribution table
- Make conclusion:
Result is significant / there is a relationship / hypo is supported
Pr(H0|data) != Pr(data|H0)
conditional probability
result does not tell us about the truth of the null hypothesis, given the data…
What it tells us is the probability of the data, given the truth of the null hypothesis
Questionnaire question types
- Dichotomous (male/female)
- Nominal (action/adventure/thriller/comedy)
- Cumulative =guttman scale (chech the statement you agree with)
- Interval =5/7 point likert
Reverse coding
Avoid response style bias = yea/nay saying
Common method bias:
Problem + solution
Problem: fact that your X and Y are measured with the same method or from the same source may drive your results.
Especially when X + Y are perceptual instead of factual from same respondent.
Solution:
1. X + Y from different sources 2. If 1 is not possible, measure X + Y in different time/space (like separate study) 3. Control social desirarability, especially when studying perception /behavior
Retrospective bias
Respondents reconstruct the past to make it consistent with subsequent performance results, conventional story lines, or current beliefs
Self-serving bias
Individuals’ tendency to refer to internal attribution for their success and external attribution for their failure
(failure=bad luck, success=ability OR 85% rate other drivers bad, itself excellent)
Non-response bias
Problem + solution
Problem: Systematic differences between respondents and non-respondents may drive your results
Solution:
- Show there are no significant differences between respondents and non-respondents on a number of demographic variables
- Do the same for early and late respondents (e.g. before and after you send a reminder)
Back Translation
process of translating a document that has already been translated into a foreign language back to the original language, preferably by an independent translator
(translate english into dutch + dutch into english to compare)
Sampling
Probability sampling = random
• Simple random sampling (n out of N)
• Stratified/proportional/quota random sampling (strata)
• Systematic random sampling (every kth)
Nonprobability sampling
• Accidental/Convenience sampling
Purposive sampling: snowball sampling / quota sampling
Statistical power
Type 1 = a
Falsely concluding h1 = false positive
Type 2 = b
Falsely concluding h0 = false negative
OLS
= Ordinary least squares = smallest quadrating method > Simple Linear Regression .
H0
The null hypothesis is not always a zero coefficient