Choosing an analysis method Flashcards

1
Q

Why is it important to know how to choose an analysis method?

A

When looking at research papers you should consider if the right method was used or not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Which (2) factors should be considered when choosing an analysis method?

A
  1. Purpose of analysis (e.g. comparing groups, assessing agreement between variables OR assessing association between variables)
  2. Types of variables (continuous, categorical, discrete)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

If there are only two groups of data what can they be:

A

Paired

Unpaired

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is an unpaired comaprison?

A

Looks at group as whole

e.g. compare salivary buffering capacity between males and females

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a paired comparison?

A

Looks at changes in the same person -> can only be done if have 2 sets of measurements linked in some way

e.g. compare salivary buffering capacity before and after recieving a dietry advice leaflet

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Is measurement of salivary buffering capacity in twins paired or unpaired?

A

Paired = 2 measurements from same person of drom different people who are related in some way (e.g. twins or siblings)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

If there are more than two groups what can the data/comparison be?

A

Matched

Unmatched

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is an unmatched comparison?

A

Comparison of 2+ groups

Each person in sample gets 1 of 3 treatments e.g. salivary fluoride levels after application of fluoride varnish, fuoride rinse or placebo (no treatment)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a matched comparison?

A

Comparison of 2 + groups

3 measurements give to same person at different times

e.g. repeated oral quality of life assessment at different ages (childhood, adolescence and adulthood)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What do we use to chose the appropriate analysis method?

A

Table

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What do parametric methods assume?

A

Underlying distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does ANOVA for testing multiple groups avoid?

A

Problems of multiple testing (i.e. t test for each group) = more likely to find an association by chance because smaller groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When Anova is used for only two groups does it produce the same result as a t-test?

A

Yes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the difference between a paired and unpaired t test?

A

Unpaired -> based on the differences in the mean

Paired -> mean values of the diferences between groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the advanatge of unpaired t test?

A

Both groups are not required to be equal (can have either the same no of M & F or can have different numbers of M & F)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What do both t-tests an ANOVA’s assume?

A

Equal varience assumption across the groups (must be checked to ensure the results are valid)

n.b. if the no in each group is similar t tests and ANOVAs still robust but if very different the test needs to be modified

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Which tests are carried out on continuous normal outcomes/ parametric data?

A

Unpaired & paired t tests

one way & repeated measures ANOVA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What does ANOVA analyse?

A

Varience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Which tests can be carried out on continuous non normal (cannot be transformed to approximate normality)/ non parametric outcomes?

A

Mann-Whitney U / Wilcoxon two sample test

Sign test / Wilcoxon signed rank test

Kruskal-Wallis test

Friedman test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Which tests are preferrable parametric or non parametric for continuous data?

A

Parametric = more powerful

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How do non parametric tests work?

A

Based on ranking observations in order of magnitude

Test rankings

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Which types of tests can be used for non parametric categorical outcomes?

A

Chi squared

Fishers exact test

McNemars test

Ordinal Chi squared test

Cochrane Q test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

When should a fishers exact test be used?

A

If cells in 2x2 table only have small numbers in them (i.e. observed or expected is 5 or less)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

When should a chi squared test be used?

A

Nominal or unordered variable

25
Q

When should an ordinal chi squared test be used?

A

if outcome is an ordinal categorical variable

26
Q

To test the null hypothesis that there is no difference in salivatry fluoride levels between maes and females, which of the following is the most appropriate test and why?

Paired t test

Unpaired t test

ANOVA
Chi squared test

A

Unpaired t test -> tests 2 independent mean values (assuming the salivayr fluoride levels are or can be transformed to aproximate normality)

NOT:

paired t test-> testing 2 non-independent means

ANOVA-> for testing more than 2 independent means

Chi-squared test-> for testing 2 independent proportions

27
Q

How do we assess agreement between variables?

A

Compare measurements mde by 2 or more examiners (i.e. dentist)

Aim is to obtain the same value from the 2 sets of measurememts

n.b. it is possible for 2 sets of measurements to be stronly associated but have low agreement (i.e. 1 examiner may consistently score higher than the other)

= can be extended to compare each of any number of examiners with gold standard

28
Q

Which tests do we use to assess measures of agreement?

A

Normal continuous data:

Limits of agreement

Categorical data:

Kappa (unordered data)

weighted kappa (ordered data)

Sensitivity/Specifity

29
Q

What is a gold standard?

A

Where method is widely accepted as being best availiable

30
Q

What is a bland altman plot?

A

Continuous data

Calculate the difference between two sets of measurements for each subjects and plot against the mean of two measurements

31
Q

What are limits of agreement?

A

Limits of agreement =

Mean difference +/- 2 SD of the difference

this can be added to the bland altman plot

n.b. if differences and means are related (e.g. proportional) transform the data before analysis

32
Q

What are limits of agreement used to judge?

A

Whether differneces are clinically important

(can obtain confidence intervals)

33
Q

What is the analysis of agreement in categorical data based on?

A

Comparing observed proportion of agreement with proportion of agreement that would be expected by chance

Value of Kappa decreases as no. of categories increases (more opportunities for misclassification)

34
Q

What does the weighted kappa allow for?

A

Includes partial misclassification into adjacent categories = less of a concern than missclassification into non-adjacent categories!

35
Q

What does a Kappa score of 1 mean?

A

Perfect agreement

36
Q

What does a Kappa score of 0 mean?

A

No agreement

37
Q

What are the criteria for assessing magnitude of Kappa?

A

>0.75 excellent agreement

0.4-0.75 fair to good agreement

<0.4 poor agreement

38
Q

Why are p values not very useful for expressing Kappa?

What is used instead?

A

A null hypothesis between agreement and not is unreasonable

Standard errors & confidence intervals

39
Q

What is sensitivity?

A

proportion with outcome who are correctly classified by test as a proportion of those who realy do have outcome as determined by the gold standard= indication of accuracy of test in detecting those with outcomes

40
Q

What is specifity?

A

Proportion without outcome who are correctly classified by test (indication of accuracy of test in detecting those without outcomes)

41
Q

When is sensitivity and specifity use to measure categorical data?

A

In the special cases where there s both a gold standard and diagnostic test which determines if an individual has or has not got the outcome

42
Q

What does sensitivity and specificity determine?

A

Assess the accuracy of a dignostic test

43
Q

How do we measure association betweem variables?

A

Correlation

OR

Regression

44
Q

How do we measure correlation?

A

Pearsons (parametric)

Spearman (non-parametric)

45
Q

When is pearsons suitable for use?

A

when you have 2 continuous variables with a normal distribution and of equal importance

46
Q

When do we measure regression?

A

When variables are not of equal importance

Parametric & non-parametric (rarely used)

47
Q

The choice of statistical analysis method depends on which of the following?

  1. The purpose of the analysis
  2. The types of variables
  3. Both of these
A

Both

48
Q

Which of the following is the odd one out?

  1. Discrete data
  2. Ordinal data
  3. Binary data
  4. Nominal data
A
  1. discreet data -> it is the only one that is not categorical
49
Q

Height measurements on males and females are which of the following?

  1. Paired data
  2. Unpaired data
A

Unpaired

50
Q

A paired t test is based on which of the following?

  1. Mean difference
  2. Difference in means
A

Mean difference

51
Q

Non-parametric tests should always be used in reference to parametric tests… True or False?

A

False

Parametric tests are based on actual values = more statistical power

52
Q

The Chi-squared test is based on which of the following?

  1. Observed values
  2. Observed and expected values
  3. Expected values
A
  1. Observed and expected values

It is used to see if there is an association between 2 factors e.g. gender and group

53
Q

Is correlation an appropriate method for assessing agreement?

A

No

Need bland-altman plot to determine agreement

Can be correlated but not agreed

54
Q

Limits of agreement can be used to assess whether the differences between two sets of continuous measurements are:

  1. Clinically acceptable
  2. Statistically significant
A
  1. Clinically acceptable (do they disagree to the extent it is a problem?
55
Q

What is the maximum value possible for a kappa statistic?

A

1

56
Q

Regression is an appropriate analysis method in which of the following situations…?

  1. Two variables of equal importance
  2. One variable can be identified as an exposure and one as an outcome (of differing importance)
A

2.

57
Q

Which is the first data check that should be carried out before deciding whether a parametric or non-parametric method should be used?

A

Normal distribution

58
Q

What do the standard errors of Kappa statistics indicate?

A

Precision of the estimates