Research Design PowerPoint Lecture, Dr. Wofford Flashcards

1
Q

Predictive Correlational Study

A

Predictive correlational study: Predict a behavior or response based on the observed relationship between that behavior and other variables

  • Helps to validate diagnostic/prognostic info (validation of new measurement tool)
  • Useful in developing models that can serve as a basis for clinical decision making and to understand factors that impact success with an intervention
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Two types of Single Factor Designs for Independant Groups

A
  1. Pretest-Postest control group design
  2. Posttest-only control group design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

1 Group Designs: One-way repeated measures design over time (1)

(Quasi-experimental design)

A

Used with research questions which examine effects of a treatment on physiological or psychological variables and how these effects develop over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Retrospective vs Prospective research

A

•Prospective research: measure variables through direct recording in the present.

  • •Researcher follows subjects as they progress through the intervention
  • •Able to identify factors that influence outcomes
  • •More reliable than retrospective studies

Retrospective research: examination of data that have been collected in the past

  • •Medical records, surveys, secondary data sets/databases
  • •Must question the accuracy of the data since researcher has no control over how the data was collected or variables operationalized
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

difference between single factor and multifactor designs

A

Single Factor: 1 IV with any number of levels

Multi-Factor: >1 IV

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Single Factor Design for Independed Groups: Pretest-posttest control group design

A

Pretest-posttest control group design

  1. •2+ groups that are formed by random assignment
  2. •One group is the control and the other receives an intervention
  3. •Could be >1 experimental group
  4. •Both groups are measured on a DV before and after the intervention
  5. •Only one IV (group)- debatable (Wofford thought it was a repeated measures design, not really a single factor design because of the type of stats that would have to be used. She disagrees with book, but put it here as book classified.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Multi-Factor Design for Independent Group: Factorial Design:

A
  1. 2+ IVs-subjects are randomly assigned to the two variables (2 different types of groups)
  2. Factors=variables (2-way factor design has two IVs)
  3. Each factor has levels (3 x 3)- multiply the numbers to know how many groups (ie: 9 groups). very common to our profession.

in 3x3 example, the first 3 is the amount of factors, second 3 is the number of levels per factor

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

One Group Designs: Time series design (2)

(Quasi-experimental design)

A
  1. Often used when studying community interventions or policy changes
  2. Multiple measurements before and after treatment to document patterns or trends of behavior

NOT VERY COMMON IN OUR PROFESSION

more common in policy change researcher or public health.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Prospective Research

A

Prospective research: measure variables through direct recording in the present.

  1. Researcher follows subjects as they progress through the intervention
  2. Able to identify factors that influence outcomes
  3. More reliable than retrospective studies
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Correlation vs Prediction

A

Correlational study: Purpose: describe nature of existing relationships among variables

  • Correlation: measure of the degree of association among variables
  • Provides rationale for clinical decisions or generation of hypotheses (often used to create hypothesese to drive additional studies)

•Predictive correlational study: Predict a behavior or response based on the observed relationship between that behavior and other variables

  • •Helps to validate diagnostic/prognostic info (validation of new measurement tool)
  • •Useful in developing models that can serve as a basis for clinical decision making and to understand factors that impact success with an intervention
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Positive Likelihood Ratio

A
  • Positive likelihood ratio (LR+)= true (+) rate/false (+) rate or sensitivity/1-specificity= indicates how many more times likely a (+) test will be seen in those with the target condition than those without the condition
    • LR+>5 represent relatively important effects
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Repeated Measures Designs: Multi-factor design

A
  • Two-way design with two repeated measures
    • >1 IV (usually time + group)

VERY COMMON

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Two Types of Quasi-Experimental Designs

A
  • One-Group Designs
  • Multigroup Designs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what design is considered the scientific standard in clinical research for establishing a cause and effect relationship?

A

Pretest-Posttest Control Group Design

IV has two levels

(it can be configured in different ways)

it is the basic structiore of of an RCT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Posttest Probability

A
  • •Posttest probability: Likelihood that a patient has the target condition after formal testing is conducted
    • •A good test should have high posttest probability confirming the diagnosis or low posttest probability causing us to abandon the target condition
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Longitudinal Research

A

Longitudinal study: researcher follows a cohort of subjects over time

  • Perform repeated measures at different time intervals
  • Able to describe patterns of change
  • ie: Framingham heart study
  • Threats to internal validity include testing effects (because of repeated measures), attrition, development of confounding variables

Example: Framingham Heart Study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Questionnaires

A

Questionnaire: structured self-administered surveys using pen & paper or e-formats

  • Generally more efficient than interviews
  • Provide anonymity
  • Primary disadvantage is that there is a potential for misunderstanding questions or response choices
  • Low response rate (34% normal)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Predictive Value Estimates

A
  • •A clinical instrument must demonstrate that it is an efficient use of time and resources and that it yields a sufficient number of accurate responses to be clinically meaningful
    • •Can be
      • Positive Predictive Value or
      • Negative Predictive Value
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Interviews vs Questionnaires

A

Interview: researcher asks subjects specific Qs & records answers for later analysis

  • Face-face or via telephone
  • Major disadvantage is that they are costly and time intensive

•Questionnaire: structured self-administered surveys using pen & paper or e-formats

  • Generally more efficient than interviews
  • Provide anonymity
  • Primary disadvantage is that there is a potential for misunderstanding questions or response choices
  • Low response rate (34% normal)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Longitudinal vs Cross-sectional Research

A

Longitudinal study: researcher follows a cohort of subjects over time

  • •Perform repeated measures at different time intervals
  • •Able to describe patterns of change
  • •ie: Framingham heart study
  • •Threats to internal validity include testing effects (because of repeated measures), attrition, development of confounding variables

•Cross-sectional study: researcher studies a cohort of subjects at one point in time and draws conclusions about a population

  • •More efficient than longitudinal
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Pretest Probabability

A

Pretest probability: Likelihood that a patient has the target condition before any formal testing is conducted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Three types of EXPERIMENTAL Designs

A
  1. •Single factor design for independent groups
  2. •Multi-factor design for independent groups
  3. •Repeated measures designs
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Multi-Factor Design for Independent Groups: Nested Design (2)

A
  1. Commonly used in educational studies
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

One Group Designs: One-Group pretest-postest design (2)

(Quasi-experimental design)

A
  1. One group of subjects receive an intervention and one set of repeated measures is taken before and after treatment
  2. IV is time with 2 levels (pre and post)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Repeated Measures Designs: 2 types of Single factor designs

A
  1. One-way repeated measures design
  2. Crossover design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Sensitivity vs Specificity

A
  • Sensitivity: ability to obtain positive test when the target condition is really present
    • True positive rate
    • Increased sensitivity= fewer people with the disorder are missed
    • 1-sensitivity= false negative rate
    • Snout
  • Specificity: ability to obtain negative test when target condition is really absent
    • True negative rate
    • Increased specificity= fewer people will have false positives
    • 1-specificity= false positive rate
    • Spin
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Three types of One Group Designs (Quasi-Experimental Designs)

A
  1. One-group pretest-posttest design
  2. One-way repeated measures design over time
  3. Time series design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Case Control Study

A

Case control study: Groups of individuals are selected on the basis of whether or not they have the disorder/pathology of interest.

  • Cases: Have the disorder
  • Controls: Don’t have the disorder and serve as a comparsion group
  • Advantageous because the samples are relatively easy to obtain and are useful for studying rare disorders
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Descriptive Surveys (3 things)

A
  1. •Surveys are commonly used to collect information about a specific group
  2. •Generally focused on a group’s behaviors or attitudes
  3. •Overall purpose of the descriptive surveys are to provide an overall picture of the group’s characteristics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Systematic Review vs Meta-Analysis

A

Systematic review: rigorous process of searching, appraising, and summarizing existing information on a selected topic.

  • Most commonly focused on the effectiveness of interventions

Meta-analysis: process which combines studies using a quantitative index to develop a single overall estimate of the intervention effect.

  • Provide important results when several smaller studies are not sufficient to demonstrate meaningful outcomes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

what article should we review to understand these concepts?

A

the Prone Lochman’s review article

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Sensitivity And specificty (2x2 prediction table)

A

2x2 prediction table

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Systematic Review

A

Systematic review: rigorous process of searching, appraising, and summarizing existing information on a selected topic.

  • Most commonly focused on the effectiveness of interventions
26
Q

Sensitivity

A

Sensitivity: ability to obtain positive test when the target condition is really present

  1. True positive rate
  2. Increased sensitivity= fewer people with the disorder are missed
  3. 1-sensitivity= false negative rate
  4. Snout
26
Q

Liklihood Ratios (4 things)

A
  1. Likelihood ratio: How much more likely is it that a person has the diagnosis after the test has been performed
  2. Advantageous over sensitivity, specificity and predictive values because it is independent of disease prevalence and can be applied to multiple settings and patients
  3. Helps us to determine the posttest probability
  4. Can be Positive or Negative
27
Q
A
29
Q

Meta-Analysis

A

Meta-analysis: process which combines studies using a quantitative index to develop a single overall estimate of the intervention effect.

  • Provide important results when several smaller studies are not sufficient to demonstrate meaningful outcomes
30
Q

A single factor design is also called ____________.

A

one-way design

(and it is for investigations of one IV)

(it may include one or more DVs)

31
Q

Developmental Research (2)

A
  1. •Developmental research involves description of developmental change and sequencing of behaviors in people over time.
  2. •Can be longitudinal or cross-sectional
33
Q

Multi-factor Designs have _______ IVs

A

multiple (usually 2-3 IV)

35
Q

Qualitative Research: Two methods of data collection

A

  • Observation
  • Interviews
36
Q

DV

A

Dependant Variable

37
Q

Five Typs of Descriptive Research

A
  1. •Developmental research
  2. •Normative research
  3. •Qualitative research
  4. •Descriptive surveys
  5. •Case study
38
Q

Cross-Sectional Research

A

Cross-sectional study: researcher studies a cohort of subjects at one point in time and draws conclusions about a population

  • More efficient than longitudinal
40
Q

Repeated Measures Designs: Single factor design; One way repeated measures design

A
  1. •One group of subjects is exposed to all levels of one IV (a group of subjects is exposed to three types of interventions or conditions)
  2. •Order effects- randomize order of intervention/condition in order to decrease potential bias of testing all subjects in the same order (fatigue, learning or carryover effects)
41
Q

RETROSPECTIVE RESEARCH

A

•Retrospective research: examination of data that have been collected in the past

  1. •Medical records, surveys, secondary data sets/databases
  2. •Must question the accuracy of the data since researcher has no control over how the data was collected or variables operationalized
42
Q

Repeated Measures Designs: Single factor design; Cross-over design (3)

A
  1. Used when only 2 levels of an IV are repeated
  2. ½ subjects receive Treatment A followed by Treatment B and the other ½ receive Treatment B followed by Treatment A
  3. Washout period (big thing!)

Good for when you don’t have lots of subjects. Same people act as their own control group.

42
Q

Case Studies

A
  • •Case study/report: in-depth description of individual’s condition/treatment response
  • •Case series: expansion ofcase study involving observ of several similar cases
  • •Advantageous because it provides an understanding of the totality of an individual’s condition and care
  • •Purpose:
    • •Understanding unusual patient conditions
    • •Provide example of innovative therapies
    • •Generating and testing theory
    • •Provide information for future research projects
43
Q

Multi-Factor Design for Independent Groups: Randomized Block Design (2)

A
  1. •Is used when an extraneous variable is present which may influence differences between groups (ie: Gender). It is called a blocking variable. Gender doesn’t always influence differences between groups, but you can use this when id does.
  2. •The extraneous variable (blocking variable) becomes another IV

ONLY USED SOMETIMES IN OUR PROFESSION

43
Q

Pretest vs Posttest Probability

A
  • •Pretest probability: Likelihood that a patient has the target condition before any formal testing is conducted
  • •Posttest probability: Likelihood that a patient has the target condition after formal testing is conducted
    • •A good test should have high posttest probability confirming the diagnosis or low posttest probability causing us to abandon the target condition

READ THIS PART IN BOOK

44
Q

do we want confidence interval to be narrow or wide?

A

the narrower the better

45
Q

Two types of Multi Group designs

(quasi-experimental)

A
  • •Nonequivalent pretest-posttest control group design
    • •Similar to pretest-posttest experimental design, except subjects are not allocated randomly to groups
  • •Nonequivalent posttest-only control group design
    • •Similar to posttest-only experimental design, except subjects are not allocated randomly to groups
46
Q

Cohort Studies

A
  1. Cohort: group of individuals who are followed together over time
  2. Cohort study: researcher selects a group of subjects who do not have the outcome of interest and study them to see if they develop the disorder
  3. May be purely descriptive or analytic (identifying risk associated with exposures)
  4. Advantageous over a case-control study because of its ability to determine the onset of the condition
  5. Cannot be used with rare disorders because too many subjects would have to be followed to document sufficient number of cases for analysis

Examples: Framingham study & Nurses study

47
Q

IV

A

Independent Variable

49
Q

Specificity

A

Specificity: ability to obtain negative test when target condition is really absent

  1. True negative rate
  2. Increased specificity= fewer people will have false positives
  3. 1-specificity= false positive rate
  4. Spin (acronym)
51
Q

CV

A

covariate

52
Q

Do we want Negative Likelihood ratio to be really high or really low (and what is considered acceptable and really really good)?

A

We want it low and

LR- < 0.2 is considered really really good

She didn’t say what was acceptable

54
Q

Do we want Positive Likelihood ratio to be really high or really low (and what is considered sufficient and really really good)?

A

We want it to be high

LR+ > 5 represents sufficient

LR+ > 10 is considered really really good

55
Q

,

Single Factor Design for Independent Groups: Posttest-only control group design

A

Posttest-only control group design (main difference is that there is not pre-test)

  1. •2+ groups that are formed by random assignment
  2. •One group is the control and the other receives an intervention
  3. •DV is only measured after the intervention; no pretest
  4. •ie: assessing hospital cost and length of stay- DV can only be assessed after intervention
  5. •Only one IV (group) (truly a single factor design), Def not a repeated measures design
56
Q

Independant groups

A

Different subjects in each group

57
Q

Confidence Interval: How narrow is narrow?

A

It’s a bit of a judgement call

59
Q

Three Multi-Factor Factor Designs for Independent Groups

A
  1. Factoral Design (we use A LOT in our profession)
  2. Randomized Block design (used some in our profession)
  3. Nested Design (almost never used in our profession, don’t worry too much about)
60
Q

Exploratory Research: Five types of Observational Designs

A
  1. •Retrospective and prospective research
  2. •Longitudinal and cross-sectional research
  3. •Correlational and prediction research
  4. •Case-control studies
  5. •Cohort studies

(these have some overlap)

61
Q

Single-Subject Designs

A
  1. Involves systematic collection of repeated measures of a behavioral response over time. Aim is to observe trends & patterns & to evaluate variability of behav response over time. Looking more for trends in the graph more than stats
  2. Typically plotted on line graphs to observe trends in the data
  3. A= baseline time period; B= intervention time period
  4. Designs:
    • •A-B design= one baseline time period and one intervention time period
    • •A-B-A design= replicates one baseline time period following intervention
    • •A-B-A-B design= begins with initial baseline data and ends with an intervention phase (strongest of the three)
  • •Strongest design as it provides (2) opportunities to evaluate effect of an intervention
62
Q

Seven Research Design Types

A
  1. Experimental
  2. Quasi-experimental
  3. Single-subject
  4. Observational
  5. Descriptive
  6. Interviews and Questionnaires
  7. Systematic reviews and Meta-analysis
63
Q

Negative Liklihood Ratio

A
  • Negative likelihood ratio (LR-)= false (-) rate/true (-) rate or 1-sensitivity/specificity= indicates how many more times more likely a (-) test will be seen in those with the target disorder than those without the disorder
    • LR-
    • We want negative liklihood ratio to be low
64
Q

Acronym for Sensitivity

A

SnOut

Sn (sensitivity)

Out (rule out)

high sensitivity means it can be ruled out if not positive

66
Q

Correlational Study

A

Correlational study: Purpose: describe nature of existing relationships among variables

  • Correlation: measure of the degree of association among variables
  • Provides rationale for clinical decisions or generation of hypotheses (often used to create hypothesese to drive additional studies)
68
Q

Two Types of Repeated Measures Designs

A
  1. Single Factor Design
  2. Multi-Factor Design
70
Q

Six questions to ask that will help determine what type of experimental design is appropriate (assuming you already know that experimental is appropriate)

A
  1. How many IVs are being tested?
  2. How many levels does each IV have, and are these levels experimental or control conditions?
  3. How many groups of subjects are being tests?
  4. How will subjects be assigned to groups?
  5. How often will observations of responses be made?
  6. what is the temoral sequence of interventions and measruements?
71
Q

Qualitative Research

A
  • •Qualitative research seeks to describe the complex nature of humans and how people perceive their own experiences within a specific social context
  • •Uses subjects’ own words and narrative summaries as data versus numerical data
  • •Methods of data collection:
    • •Observation
    • •Interviews
72
Q

Positive Predictive Value

A

•Positive predictive value (PV+): estimates the likelihood that a person who tests positive actually has the disease

  • •a/a+b
  • •High PV+= strong estimate of the actual number of patients who have the target condition
73
Q

Negative Predictive Value

A

•Negative predictive value (PV-): estimates the likelihood that a person who tests negative actually does not have the disease

  • •d/c+d
  • •High PV-= strong estimate of the actual number of patients who do not have the target condition
74
Q

Interviews

A

Interview: researcher asks subjects specific Qs & records answers for later analysis

  • Face-face or via telephone
  • Major disadvantage is that they are costly and time intensive
75
Q

Dependent groups

A

Same subject in each group

76
Q

resulting in a sensitivity of confidence intervals

0.70 (95% CI: 0.49, 0.84)

A

95% sure that the sensitivity for this population falls between this range (0,49, 0.84)

I THINK

77
Q

NORMATIVE STUDIES

A
  1. •Purpose of normative research is to describe typical values for characteristics of a given population
  2. •Norms are generally expressed as an average within a range of acceptable values
78
Q
A
79
Q

What is the most common design that Dr. Davies does and our Dept does?

A

Repeated Measures Design, Multi-Factor Design

80
Q

Acronym for Specificity

A

SpIn (acronym)

Sp (specificity)

In (ruled in)

High specificity means it is ruled in