Statistical Conclusion Validity Flashcards
Statistical Conclusion Validity
whether or not they are drawing the appropriate conclusions from the stats that have been run and that you ran the right stats
2 Considerations of Statistical Conclusion Validity
- Proper Treatment of Data
2. Soundness of Researcher’s conclusions
Proper Treatment of Data
- assumptions (big enough N, normal distribution etc)
- debate over robustness of inferential statistical tests
Soundness of Researcher’s conclusions
type 1 errors
type 2 errors: normally happen because you don’t have enough statistical power
Internal Validity
refers to the idea that we are confident because of how we set up our research that exposure to the independent variable and not any other factor has caused the difference in our dependent variable
External Validity
the generalization of variables across
- populations
- settings
- species
Ecological Validity
participants experience is going to correspond with what they would encounter in daily life
mundane realism
everything in the lab maps on perfectly to what you would see in the real world
trade offs
- difficult to satisfy all four validities in same study
- financial and or time considerations can cause researchers to sacrifice construct validity
- the methods themselves involve tradeoffs between internal and external validity
best solution to these trade offs
collect converging evidence using multiple methods