Cohen's Kappa

Question 1

Does it use continuous data or categorical data

Answer 1

Categorical data

Question 2

Does categorical data use hypothesis testing framework to establish agreement

Answer 2

No like continuous data it DOESN’T USE hypothesis testing framework to establish agreement between measurements

Question 3

What do you use to establish agreement between categorical data

Answer 3

Cohen’s Kappa

Question 4

What is the assumption of Cohen’s Kappa

Answer 4

Measurements should be IDENTICAL barring random variations (comparing different instruments, different observers, repeatability)

Question 5

What is the calculation for Cohen’s Kappa

Answer 5

Po= Observed agreement
Pe= chance agreement

Question 6

What is Cohen’s Kappa appropriate for?

Answer 6

Paired Measurements

Question 7

What is the theoretical maximum value for Cohen’s Kappa?

Answer 7

Maximum theoretical value is 1 bit CONTEXT DEPENDENT in practice, making comparisons difficult

Question 8

What value reflects a strong agreement

Answer 8

> 0.6

Question 9

What value reflects no agreeement

Answer 9

≤0