Reliability Flashcards

1
Q

What is ICC 1 measuring?

A

test-retest reliability (reliability of data)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What test do we use to analyze ICC 1

A

one way anova

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is ICC 2 measuring?

A

INTER rater reliability (reliability of a clinical tool)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What test do we use to analyze ICC 2?

A

two way ANOVA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is ICC 3 measuring?

A

INTRA rater reliability (reliability of raters between trials)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What test do we use to analyze ICC 3?

A

mixed model ANOVA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what can influence reliability

A

restrictions in range, interaction between raters and subjects, response stability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What criteria needs to be met for weighted Kappa stats?

A

ordinal data, and a large sample size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is standard error of measurement?

A

the variability of an individuals tests scores due to random measurement error. Think of it as SD for an individual

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what are the 4 factors affecting power?

A

significant level (alpha), variance in data (inclusion criteria), effect size (dosage of exercise), sample size (n)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

can we influence the factors that affect power?

A

yes, all 4

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

as type 1 error decreases, type 2 error _________

A

increases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

when must you determine sample size?

A

a priori (before experiment)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

how do we determine effect size if it is not known?

A

guess, estimate from the literature, pilot studies, determine what would be a clinically meaningful difference and base numbers on that

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is considered a large effect size with a t test?

A

above .8

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is considered a large effect size with an ANOVA?

A

above .4

17
Q

what is effect size?

A

the magnitude of effect, a measure of the degree to which the null hypothesis is false