Lecture 3 Flashcards

1
Q

What type of research design is this:

“participants are randomly assigned to at least 2 comparison groups”?

A

Experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What type of research design is this:

“no random assignment & typically involves the use of cohort groups”?

A

Quasi-experimental

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is key to true experimental design?

A

Randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Repeated measures design is when ___________.

What is the flaw with repeated measures?

A

Participants serve as their own controls

Flaw: Participants will learn and adapt over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which research design is this?

Compares 1 group over 2+ time periods

A

One-way repeated measures

  • intervention can be given at any point or over a few time periods
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Which research design is this?

A

One-way repeated measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Which research design is this?

A

Posttest-only randomized group

Note: can be more than 2 groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Which research design is this?

A

Posttest-only non-randomized group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Which research design is this?

2+ IVs, with or without randomization into groups, AND the patients never cross into other groups

A

Factorial - fully independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which research design is this?

A

Factorial - fully independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which research design is this?

2+ IVs, the subjects participate in every cell

A

Factorial - fully repeated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Which research design is this?

A

Factorial - fully repeated

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Which research design is this?

2+ IVs, with or without randomization, groups of subjects move through the repeated conditions

A

Factorial - mixed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Which research design is this?

A

Factorial - mixed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Which research design is this?

A

Crossover with or without randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is measurement theory also known as?

A

Psychometrics

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What does measurement theory provide?

A

the foundation for evaluating tests, their uses and interpretations

e.g. reliability, validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is a methodological study?

A

Any study that investigates the reliability and/or validity of clinical and research measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is MDC?

A

Minimally detectable change
* amount of change in an instrument that is beyond error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is MCID?

A

Minimal Clinically Important Difference
* amount of change in an instrument that results in a clinically relevant change in the patient

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is this an example of?

TUG: change in performance of >2 seconds is true change, not measurement error

A

MDC

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is this an example of?

TUG: a decrease in time of >5 seconds is important change to the pt diagnosed with MS

A

MCID

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is reliability?

A

Consistency or degree of association between 2 variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is validity?

A

Accuracy or degree of correspondence between the concept being measured and variable used to represent the concept

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

reliable or valid?

A

reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

reliable or valid?

A

valid, not reliable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

an instrument can be ______ without being _____, but can’t be ______ without being ________

A

an instrument can be reliable without being valid, but can’t be Valid without being reliable

28
Q

Different raters getting the same score is what kind of relaibility?

A

Inter-tester reliability

29
Q

The same rater getting the same score is what kind of reliability?

A

Intra-tester reliability

30
Q

Can successive measurements by an instrument be consistent? - is what kind of reliability?

A

Test-retest reliability

31
Q

Can successive measurements by a patient be consistent? - is what kind of reliability?

A

Test-retest reliability

32
Q

Parallel forms reliability

A

AKA equivalent forms reliability
* questions are divided into 2 equivalent forms

e.g. SAT: create assessments that have similarly difficult items using this method

33
Q

Split-half reliability

A
  • questions are split into 2 sets, and both sets are given to one group of individuals

e.g. Depression questionnaire with 100 items, someone with minimal depression would score low on both sets of questions

34
Q

What type of validity is this?

Does an instrument measure what it is supposed to measure based on simple observation?

A

Face validity

35
Q

What is content validity?

A

systematic examination of an instrument to determine whether it covers the entire domain to be measured

36
Q

What type of validity is this?

e.g.
Does an IQ questionnaire have items covering all areas of intelligence discussed in the scientific literature?

A

Content validity

37
Q

What is criterion-based validity?

A

The degree to which the outcomes of one test correlate with outcomes on a gold standard test

38
Q

T test vs ANOVA

A

T test compares 2 sets of data

ANOVA compares many

39
Q

What is the problem with running repeated T tests for a data set with more than 2 groups?

A

Inflated alpha level = more chance of type 1 error

40
Q

What is concurrent validity?

A

The degree to which the outcomes of 1 test correlate with outcomes on another test, when both are given at relatively the same time

41
Q

Which has greater/stronger validity?

Face validity or concurrent validity

A

Concurrent validity

42
Q

What is predictive validity?

A

Can an instrument be used to predict some future performance/outcome

43
Q

What is construct validity?

A

The degree to which a theoretical construct is measured by an instrument

44
Q

What type of validity is this an example of: Berg Balance Scale: score of <45 indicates individuals may be at greater risk of falling?

A

Predictive Validity

45
Q

What is responsiveness to change?

A

the extent to which significant changes are reflected in the observed values

46
Q

What 2 things limit responsiveness to change?

A

Ceiling & Floor Effect

47
Q

If a person has a disease or condition, _________ tells you how often the test will be positive

A

Sensitivity

48
Q

If a person does not have a disease or condition, ________ tells you how often the test will be negative

A

Specificty

49
Q

If Monica tests POSITIVE for the COVID test, she is very likely sick. But if Ben tests negative, he is HIGHLY UNLIKELY to be sick.

This test has high ______

A

Sensitivity

50
Q

If Judy tests NEGATIVE for an allergy test, she is most likely NOT ALLERGIC. But if she tests POSITIVE, she is HIGHLY LIKELY to have an allergy.

This test has high _____

A

Specificity

51
Q

What is the sensitivity equation?

A

(True Positive) / (True Positive + False Negative)

52
Q

What is the specificity equation?

A

(True Negative) / (True Negative + False Positive)

53
Q

What is prevalence?

A

In this population, how common is this disease/injury?

54
Q

What is the Positive Predictive Value (+PV) equation?

A

(True Positive) / (True Positive + False Positive)

55
Q

What is the Negative Predictive Value (-PV) equation?

A

(True Negative) / (True Negative + False Negative)

56
Q

What does +PV mean?

A

What is the probability that a person with + clinical test truly has the condition?

57
Q

What does -PV mean?

A

What is the probability that a person with a - clinical test Truly doesn’t have the disease?

58
Q

When do we need to adjust the predictive values for prevalence?

A

When your sample doesn’t represent the true prevalence of the condition in your population

59
Q

+PV increases as the prevalence of a disease in a population _______

A

Increases

60
Q

-PV decreases as the prevalence of a disease in a population ________

A

Decreases

61
Q

What is the +LR equation?

A

Sensitivity / (100 - specificity)

62
Q

What is the -LR equation?

A

(100 - sensitivity) / Specificity

63
Q

+ Likelihood Ratio
Best ____
OK ____
Poor ___
Useless ___

A

Best = 10
OK = 5
Poor = 2
Useless = 1

64
Q

(-) Likelihood Ratio
Useless ___
Poor ___
OK ___
Best ___

A

Useless = 1
Poor = 0.5
OK = 0.2
Best = 0.1

65
Q

For a ROC curve, what is on the x- axis? y-axis?

A

X-axis is (1-specificity)
Y-axis is Sensitivity

66
Q

What does an increased area under the line of the ROC curve mean?

A

High sensitivity and specificity