4. Recent methodological controversies

Question 1

What is post-hoc storytelling and P-value fishing?

Answer 1

Post-Hoc storytelling: publishing paper with a hypothesis for a significant value you found for something other than what you were originally looking at

P-value fishing: using SPSS techniques to make values significant

Question 2

What proportion of replications were successful in Open Science Collaboration?

Answer 2

39 of 100

Question 3

What are two definitions of probability outlined by Grayson?

Answer 3

Frequentist: probability is about relative frequency of events

Bayesian: probability is about the chance of a theory being correct

Question 4

3. A single standard psychology experiment cannot prove the truth or falsity of an experimental
   hypothesis because:
   a. As Popper argued, the falsity of an experimental hypothesis can never be conclusively
   determined
   b. From a Bayesian perspective, a single experiment only changes the likelihood of an
   experimental hypothesis being true
   c. From a frequentist perspective, the frequency of events in an experiment only correlates with the
   experimental manipulations, it doesn’t provide concrete proof of truth or falsity
   d. A & C
   e. B & C

Answer 4

e. B & C

or mabye b

???

Question 5

What is Bayesian statistics?

Answer 5

have prior estimate of likelihood and gather data to alter that. This estimate is loaded with your previous beliefs.
(good that you are directly testing a hyps likelihood)

Question 6

What is a Frequentist view of testing hypotheses?

Answer 6

no test based on the theory of probability can by itself provide any valuable evidence of the truth or falsehood of that hypothesis

Question 7

What is Fisher’s view on null hypotheses, why may this be an issue today?

Answer 7

Fisher, null hypotheses are meant to be true until proved otherwise, but they seem fictional in a world of publication bias