Fallacies in statistical inference

Question 1

P values equal the probability that the Null is true

Answer 1

Not true, it represents the probability of finding the data given the null, the objective conditional probability.

Question 2

Alpha equals the probability of making
an error

Answer 2

It’s a set chosen level of probability that the null is reject although it is true

Question 3

Failing to reject H0 is evidence for H0

Answer 3

No, absence of evidence is not evidence of absence

Question 4

Power is irrelevant when results are
significant

Answer 4

Significant results don’t include the base-rate, this can effect the power so it’s very important