Inferential Statistics Flashcards

1
Q

What form can inferential statistics take?

A

Estimation

Hypothesis Testing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Types for estimation

A

Point estimation

Interval estimation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is estimation?

A

Using sample data we estimate the distribution of a parameter in the population from which the sample was drawn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is point estimation?

A

Estimate a singe value for a parameter that will be close t true value of the parameter - effect size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is interval estimation

A

Find an interval that has a given probability of including the true value of the parameter within its specified range

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the interval in interval estimation?

A

Confidence interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the probability in interval estimation?

A

Confidence coefficient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is hypothesis testing?

A

We test the null hypothesis that a specified parameter of the population has a specified value by looking at the samples value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are hypotheses?

A

Conjectural statements that provisionally link two variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are theories?

A

Sets of definite propositions or facts that are more or less verified already

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How does one examine the relationship between two variables?

A

Probability theory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is Poppers logic re hypothesis testing?

A

To prove something is very difficult.
To disprove something is relatively easy.
Hence science does not use the method of verification but methods of falsifiability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the null hypothesis also known as?

A

H0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What do statistical methods try to do with respect to H0?

A

Try to refute this statement using statistical inference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is another name for the alternate hypothesis?

A

H1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How can one state a hypothesis?

A

One-tailed

Two-tailed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a one tailed hypothesis?

A

Refers to the statement that differences between groups occurs in one direction only e.g. A->B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What would the alternative hypothesis be in a one-tailed hypothesis?

A

A is not -> B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a two-tailed hypothesis?

A

Refers to the statement that differences exist between two groups but the direction of the difference is not specified i.e. may be A->B or B->A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What would alternative hypothesis be in a two-tailed hypothesis?

A

A=B

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What happens to significance levels in a two tailed hypothesis?

A

They are halved

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Which type of hypothesis needs a larger difference to reject the null hypothesis?

A

Two tailed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Why do two tailed hypothesis need a larger difference to reject the null hypothesis?

A

Significance levels are halved

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Which type of hypothesis are considered more rigorous?

A

Two-tailed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Why are two-tailed hypotheses considered more rigorous?
Significance level is halved so larger differences are needed to reject the null hypothesis
26
How is the null hypothesis tested?
By gathering data relevant to the hypothesis and determining how well it fits H0
27
What is used when we test how our data fits with H0?
Significant level, p
28
What is the significance level, p?
The probability of rejecting H0 when H0 is true
29
What does a higher significance level, p mean?
The higher the p, the better the fit between the data and H0
30
What does a low p value suggest?
Casts doubt upon the validity of H0
31
What can we assume if the value of p is very low?
We can reject H0
32
What are random errors?
Fluctuations in direction in measured data due to precision limitations of measurement devide
33
What are random errors often a result of?
Researchers inability to take measurement in the same way to get the same result
34
What are systematic errors?
Reproducible errors that are consistently in the same direction
35
What errors can occur during hypothesis testing?
Type 1 | Type 2
36
What happens in Type 1 errors?
Incorrect rejection of the null hypothesis - false positive claim in favour of research hypothesis
37
What is the likelihood os a Type 1 error?
alpha
38
At what alpha level can we mainly avoid Type 1 errors?
<0.05
39
What is another name for alpha?
Level of statistical significance i.e. p
40
What can lead to Type 1 errors?
Repeated testing of hypothesis using same data Multiple subset analysis Secondary analysis
41
Why does multiple testing of same data lead to type 1 error?
At least one test will be positive in 20 if p is set at 0.05
42
What is a Type 2 error?
Incorrect acceptance of the null hypothesis - false negative rejection of research hypothesis
43
What is the name of the likelihood of a type 2 error?
Beta
44
What can lead to Type 2 error?
Small sample size | Large variance
45
What refers to the power of the study?
1 - beta
46
What is the traditional level of beta?
20%
47
What is the traditional level of power?
80%
48
What happens as we try to lower Type 1 error?
Risk of Type 2 error increases
49
Define power
Ability of a study to detect a difference between two groups if such a difference truly exists
50
What does power depend on
Sample size Mean effect difference (effect size) Variability of observations Acceptable level of p
51
What variability increases power?
Lower variability
52
What should be run to find the variance?
Small pilots | Or from previously published works in similar clinical examples
53
What is the formula for standardised difference?
Target difference in means / SD of observations
54
What is standardised difference an expression of?
Effect size
55
Who created the nomogram used to calculate sample size?
Altman
56
What is used in a nomogram to calculate sample size?
Standardised difference and power values
57
Which error is increased as p increased?
Type 1
58
Methods to increase power
``` Larger p value Larger sample size Larger effect size Reduce variability One-sided test Most powerful test that appropriate assumptions will allow ```
59
What does it mean to use a larger effect size?
Consider only larger deviations from null hypothesis to be significant
60
When might larger effect size not be desirable? e
If a small difference can have a huge clinical impact
61
How can one reduce variability?
Making more precise measurements | Matching subjects
62
What must one check before choosing to use a one sided test?
Check if it is possible to make strong (supported) assumptions
63
Which tests are more powerful?
Parametric
64
Which type of hypothesis is more powerful?
One tailed
65
Purpose of CI
To see how close the approximation of a measure in a sample is to the population
66
What does a smaller CI mean?
The better the representativeness of the sample to the population
67
What does one need to look out for when interpreting the CI?
Degree of confidence Width of the interval Upper and lower limit Capturing the value of no difference
68
What is the common degree of confidence used?
95%
69
How does one derive the degree of confidence?
From the complement of conventional p value which is 5%
70
What will happen to CI if there is a higher degree of confidence?
Wider interval will be seen
71
What does a wide interval at a fixed degree of confidence indicate?
That the estimate is not precise
72
What does a narrow interval of CI suggest?
Very precise estimate
73
What does width of the CI depend on?
Size of the standard error i.e. variability, which will depend on sample size
74
Which type of studies give wide CI?
Small studies
75
What does capturing the value of no difference suggest?
If the 95% CI crosses the 0 point for the difference between means then the result is not statistically significant. Similar if it crosses 1 for ratio measures or infinity for inverse ratios (NNT)
76
What is the value of no difference referring to?
The value at which the results are not statistically significant
77
Value of no difference for means?
0
78
Value of no difference for ratios?
1
79
Value of no difference for NNTs?
Infinity
80
How can one reduce the width of the CI?
Smaller degree of confidence level e.g. 90% instead of 95% Reduce standard deviation Take larger sample sizes
81
Value or no difference for absolute risk reduction
0
82
Value of no difference for relative risk reduction
0
83
Value of no difference for relative risk
1
84
What do CI inform us about?
Degree of confidence in the sample Precision of a result Clinical significance Statistical significance
85
Formula of effect size
Difference in outcomes between intervention and controls divided by SD
86
What is effect size a measure of?
Difference in point estimates
87
What does effect size refer to?
Group of indices (independent of sample size) differing in the mode of measurement of magnitude of treatment effect
88
Importance of ES in meta-analyses
ES measures are the common currency of meta-analyses that summarise the findings from a specific area of research
89
Why are ES helpful in meta-analyses?
As individual studies often report outcome using different scales so using ES helps consolidate findings
90
What can be used to measure ES?
Cohens d
91
What is Cohens D?
Standardised difference between two means
92
Calculation of Cohens d
Difference mean mean M1 and M2 divided by SD of either group
93
Grading of ES based on Cohens d
0. 2 = small 0. 5 = medium 0. 8 = large
94
How can ES be interpreted?
assuming control and experiment group values are normally distributed with equal SDs, effect size can be interpretted just like Z scores of standard normal distribution
95
What does ES of 1 mean?
That the score of the average person in the experimental group is 1 standard deviation above average person in control
96
What does ES 0 mean
50% of controls would be below average person in experimental group
97
What does ES 0.1 mean
54% of controls would be below average person in experimental group
98
What does ES 0.5 mean?
69% of controls would be below average person in experimental group
99
What does ES 1 mean?
85% of controls would be below average person in experimental group
100
What does ES 2 mean?
98% of controls would be below average person in experimental group
101
What does ES of 3 mean?
99.9% of controls would be below average person in experimental group
102
Who suggested the common language effect size (CLES)
McGraw and Wong (1992)
103
What is CLES?
Probability that a score sampled at random from experimental group will be greater than score sampled from controls
104
If p value is 0.05, how many times does one need to calculate data to get a positive result by chance
20
105
What is Bonferroni correction?
To correct for multiple testing leading to false positive
106
Disadvantage of Bonferroni correction?
Can lead to false negatives
107
Formula for Bonferroni correction?
Significance level for multiple tested data is altered as (normal significance level / number of statistical analyses carried out)
108
What does Bonferroni correction do to the outcome?
Treats each outcome as an individual event
109
What is a family wise error?
Probability that any one of a set of comparisons or significance tests is a Type 1 error
110
What is a false discovery rate?
Instead of controlling chance of any false positives (like Bonferroni), this controls expected proportion of false positives
111
What tests can be used to avoid false positives when using multiple tests?
``` Bonferronis correction False discovery rate Scheffe test Tukeys honestly significant difference test Dunnet test ```