Lecture 3 Flashcards

1
Q

What type of research design is this:

“participants are randomly assigned to at least 2 comparison groups”?

A

Experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What type of research design is this:

“no random assignment & typically involves the use of cohort groups”?

A

Quasi-experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is key to true experimental design?

A

Randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Repeated measures design is when ___________.

What is the flaw with repeated measures?

A

Participants serve as their own controls

Flaw: Participants will learn and adapt over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which research design is this?

Compares 1 group over 2+ time periods

A

One-way repeated measures

  • intervention can be given at any point or over a few time periods
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Which research design is this?

A

One-way repeated measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Which research design is this?

A

Posttest-only randomized group

Note: can be more than 2 groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Which research design is this?

A

Posttest-only non-randomized group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Which research design is this?

2+ IVs, with or without randomization into groups, AND the patients never cross into other groups

A

Factorial - fully independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which research design is this?

A

Factorial - fully independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which research design is this?

2+ IVs, the subjects participate in every cell

A

Factorial - fully repeated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Which research design is this?

A

Factorial - fully repeated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Which research design is this?

2+ IVs, with or without randomization, groups of subjects move through the repeated conditions

A

Factorial - mixed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Which research design is this?

A

Factorial - mixed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Which research design is this?

A

Crossover with or without randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is measurement theory also known as?

A

Psychometrics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What does measurement theory provide?

A

the foundation for evaluating tests, their uses and interpretations

e.g. reliability, validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is a methodological study?

A

Any study that investigates the reliability and/or validity of clinical and research measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is MDC?

A

Minimally detectable change
* amount of change in an instrument that is beyond error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is MCID?

A

Minimal Clinically Important Difference
* amount of change in an instrument that results in a clinically relevant change in the patient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is this an example of?

TUG: change in performance of >2 seconds is true change, not measurement error

A

MDC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is this an example of?

TUG: a decrease in time of >5 seconds is important change to the pt diagnosed with MS

A

MCID

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is reliability?

A

Consistency or degree of association between 2 variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is validity?

A

Accuracy or degree of correspondence between the concept being measured and variable used to represent the concept

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
reliable or valid?
reliable
26
reliable or valid?
valid, not reliable
27
an instrument can be ______ without being _____, but can't be ______ without being ________
an instrument can be **reliable** without being **valid**, but can't be **Valid** without being **reliable**
28
Different raters getting the same score is what kind of relaibility?
Inter-tester reliability
29
The same rater getting the same score is what kind of reliability?
Intra-tester reliability
30
Can successive measurements by an instrument be consistent? - is what kind of reliability?
Test-retest reliability
31
Can successive measurements by a patient be consistent? - is what kind of reliability?
Test-retest reliability
32
Parallel forms reliability
AKA equivalent forms reliability * questions are divided into 2 equivalent forms e.g. SAT: create assessments that have similarly difficult items using this method
33
Split-half reliability
* questions are split into 2 sets, and both sets are given to one group of individuals e.g. Depression questionnaire with 100 items, someone with minimal depression would score low on both sets of questions
34
What type of validity is this? Does an instrument measure what it is supposed to measure based on **simple observation**?
Face validity
35
What is content validity?
systematic examination of an instrument to determine whether it **covers the entire domain to be measured**
36
What type of validity is this? e.g. Does an IQ questionnaire have **items covering all areas of intelligence** discussed in the scientific literature?
Content validity
37
What is criterion-based validity?
The degree to which the outcomes of one test correlate with outcomes on a **gold standard test**
38
T test vs ANOVA
T test compares 2 sets of data ANOVA compares many
39
What is the problem with running repeated T tests for a data set with more than 2 groups?
Inflated alpha level = more chance of type 1 error
40
What is concurrent validity?
The degree to which the outcomes of 1 test correlate with outcomes on another test, when both are given at **relatively the same time**
41
Which has greater/stronger validity? Face validity or concurrent validity
Concurrent validity
42
What is predictive validity?
Can an instrument be used to **predict** some future performance/outcome
43
What is construct validity?
The degree to which a theoretical construct is measured by an instrument
44
What type of validity is this an example of: Berg Balance Scale: score of <45 indicates individuals may be at greater risk of falling?
Predictive Validity
45
What is responsiveness to change?
the extent to which significant changes are reflected in the observed values
46
What 2 things limit responsiveness to change?
Ceiling & Floor Effect
47
If a person **has** a disease or condition, _________ tells you how often the test will be **positive**
Sensitivity
48
If a person **does not have** a disease or condition, ________ tells you how often the test will be **negative**
Specificty
49
If Monica tests POSITIVE for the COVID test, she is very likely sick. But if Ben tests negative, he is HIGHLY UNLIKELY to be sick. This test has high ______
Sensitivity
50
If Judy tests NEGATIVE for an allergy test, she is most likely NOT ALLERGIC. But if she tests POSITIVE, she is HIGHLY LIKELY to have an allergy. This test has high _____
Specificity
51
What is the sensitivity equation?
(True Positive) / (True Positive + False Negative)
52
What is the specificity equation?
(True Negative) / (True Negative + False Positive)
53
What is prevalence?
In this population, how common is this disease/injury?
54
What is the Positive Predictive Value (+PV) equation?
(True Positive) / (True Positive + False Positive)
55
What is the Negative Predictive Value (-PV) equation?
(True Negative) / (True Negative + False Negative)
56
What does +PV mean?
What is the probability that a person with + clinical test **truly has the condition**?
57
What does -PV mean?
What is the probability that a person with a - clinical test **Truly doesn't have the disease**?
58
When do we need to adjust the predictive values for prevalence?
When your sample **doesn't** represent the true prevalence of the condition in your population
59
+PV increases as the prevalence of a disease in a population _______
Increases
60
-PV decreases as the prevalence of a disease in a population ________
Decreases
61
What is the +LR equation?
Sensitivity / (100 - specificity)
62
What is the -LR equation?
(100 - sensitivity) / Specificity
63
+ Likelihood Ratio Best ____ OK ____ Poor ___ Useless ___
Best = 10 OK = 5 Poor = 2 Useless = 1
64
(-) Likelihood Ratio Useless ___ Poor ___ OK ___ Best ___
Useless = 1 Poor = 0.5 OK = 0.2 Best = 0.1
65
For a ROC curve, what is on the x- axis? y-axis?
X-axis is (1-specificity) Y-axis is Sensitivity
66
What does an increased area under the line of the ROC curve mean?
High sensitivity and specificity