Surveys/Quest and Systematic review/meta-analysis (2) Flashcards

1
Q

What is one of the most popular methods for collecting descriptive or subjective data and composed of a series of questions that are posed to a group of subjects?

A

surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Survey data can be used in what type of studies?

A

ALL THREE

experimental, exploratory or descriptive studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Surveys can be conducted as what two things?

A
  1. Oral interview

2. Written/electronic questionnaire

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a questionaire?

A

Structured surveys
self-administered
using pen / paper or electronic formats

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Advantages of using a questionnaire: (4)

A
  1. More efficient - respondents complete on their own time
  2. Data gathered from large sample in a wide geo distribution in a short time
  3. standardized written forms are used - it reduces potential bias from interactions with an interviewer
  4. useful as a research method for assessing attitudes and values
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Disadvantages of using questionnaire: (3)

A
  1. not as useful for studying behavior that require objective observation
  2. potential for misinterpreting questions or response choices
  3. accuracy or motivation of the respondent unknown
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Common methods of distributing questionnaires: (3)

A
  1. Through the mail
  2. In-person distribution
  3. Electronic distribution (most common, economical)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Major concerns in regard to surveys and questionnaires: (2)

A
  1. Return rate low - 30-60% for most studies and lowered further by incomplete, incorrect, or missing data (survey samples large to obtain sufficient usable responses)
  2. Self-report - always potential for bias or inaccuracy in self-reports
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

recall bias -

A

when respondents are asked to remember past events

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Self-report is generally valid for variables such as: (4)

A
  1. injury
  2. mobility function
  3. hypertension
  4. smoking habits
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Self-report is only direct way to obtain info for: (4)

A
  1. perceptions
  2. fears
  3. motivations
  4. attitudes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Design of surveys (7 steps):

A
  1. Identify questions
  2. formulate hypothesis
  3. develop questionnaire outline
  4. Review existing instruments
  5. Design instrument
  6. Preliminary drafts
  7. Pilot testing and revision
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

When pilot testing/revising survey, who test it on and serves to do what?

A
  1. small rep sample of 5-10 subjects from target population

2. serve to check the validity (face validity and content validity)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How do respondents answer open-ended survey questions?

A

respondents to answer in their own words

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is open-ended survey questions useful to find?

A

useful for feelings and opinions without biases/limits imposed by the researcher

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

open-ended survey questions are often used in what part of the study?

A

pilot study to determine a range of responses, then converted to a multiple choice item

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

T/F open-ended survey questions are difficult to code and analyze

A

True, difficult to code and analyze because so many different responses can be obtained

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Closed-ended survey questions -

A

provide multiple response choices

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

T/F Closed-ended survey questions are easily coded

A

True, great uniformity across responses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Closed-ended survey questions should be exhaustive, what does that mean?

A

they should include all possible responses that can be expected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Closed-ended survey questions should be mutually exclusive, what does that mean?

A

each choice should clearly represent a unique answer (not 2/4/6 but rather 1-2/3-4/5-6)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is a scale?

A

ordered system for a series of questions that provide an overall rating

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What were scales devloped to measure

A
  1. attitudes
  2. function
  3. health and quality of life
  4. pain
  5. exertion
  6. other physical, physiological and psychological variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Categorical scales -

A

used with categorical variables such as gender; race; diagnosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Continuous scales -

A

used with continuous variables such as age; blood pressure; years of experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Ordinal scales -

A

used with ordinal variables such as:

  1. pain measured by minimal; moderate; severe
  2. function by independent; minimal assist; moderate assist; maximal assist; dependent
27
Q

What are the steps to analyzing survey data?

A
  1. Enter collected responses into a computer program
  2. Code responses appropriately
  3. Analyze the data using appropriate statistical methods (descriptive stats to describe data and inferential stats to make decision about population group)
28
Q

What type of stats for continuous variables?

A

mean and standard deviation

29
Q

What type of stats for categorical variables?

A

frequency and percent

30
Q

What is a research design that uses explicit methods to identify, select, appraise and synthesize results from similar but separate studies?

A

systematic review

31
Q

T/F systematic review does not focus on a specific question

A

FALSE it does!

32
Q

What is considered to be be the strongest level of evidence (gold standard)?

A

Systematic Review of RCTs

33
Q

T/F not all review articles are systematic reviews

A

True

34
Q

What would be a good source of information on the background of a specific topic?

A

Traditional narrative review

35
Q

What is missing from a Traditional narrative review?

A

it doesn’t include a detailed description of the methods/criteria used to select and evaluate articles that are includes

36
Q

What are Four steps that differentiate a systematic review from a narrative review?

A
  1. identify ALL evidence on the topic
  2. select them
  3. appraise the quality of these evidence
  4. summarize them
37
Q

What is a statistical method of combining a large collection of results from individual studies called?

A

Meta-analysis

38
Q

Meta-analysis develops what?

A

uses quantitative methods to develop a single overall estimate of the intervention effect

39
Q

Why is a meta-analysis useful?

A

useful to provide important results when several smaller studies are not sufficient to demonstrate meaningful outcomes

40
Q

T/F All systematic reviews use meta-analysis (explain)

A

False, some do
- it can be very powerful tool for synthesizing information across multiple studies
- it can also be misleading if the studies are not appropriately combined
some don’t
- systematic review may have to be sufficient to qualitatively synthesize the information when measurements are inconsistent or comparisons do not make sense

41
Q

What are the subjects of a systematic review?

A

The studies themselves

42
Q

What types of requirements do selection criteria specify?

A

Inclusion and exclusion requirements for studies to be used for the review

43
Q

What are selection criteria based on?

A

Based on the types of:

  1. studies
  2. participants
  3. interventions
  4. outcomes
44
Q

What type of studies are considered gold standard and that authors restrict systematic reviews of interventions to?

A

RCTs

45
Q

Put in order from highest level of evidence (1) to lowest:

Case-control/RCT/Case/Cohort studies

A
  1. RCTs
  2. Cohort studies
  3. Case-control studies
  4. Case series
46
Q

T/F Systematic reviews have to set reasonable ranges for subject characteristics

A

True, because study populations can be so variable

47
Q

Selection criteria based on types of interventions must do what?

A

indicate definitions of interventions and comparison treatment (if relevant) because studies are rarely consistent in the application of interventions

48
Q

Selection criteria based on types of outcome measures must do what?

A

must indicate the choice of outcome measures because included studies will often have a variety of outcomes

49
Q

Mean difference as type of outcome measure -

A

effect measures for randomized controlled trials

50
Q

Odds ratio (OR) / Relative Risk (RR) as type of outcome measure -

A

measures of association for observational studies

51
Q

Standardized Effect Size (SES) as type of outcome measure -

A

– it evaluates how big or small an effect is when the units of measurement aren’t intuitive
– it compares the results across studies

52
Q

What is the goal when searching for studies?

A

The goal is to find a comprehensive list of relevant documents that should be considered (must indicate in report which databases were used and specific search terms entered)

53
Q

Issues of publication bias with available literature: (@)

A

Issues are:

  1. researchers may fail to submit the results of studies where the results are not statistically significant
  2. editors may decline to publish such studies
    - > bias against negative or inconclusive results
54
Q

Why must Evidence of no effect must be part of the picture?

A

because the value of systematic review is to broaden the evidence for or against a proposed outcome

55
Q

What are 4 possible bias in conducting a systematic review?

A
  1. Selection bias
  2. Performance bias
  3. Attrition bias
  4. Detection bias
56
Q

Include studies that adhere to the _____ for clinical trials or the ______ for observational studies

A

consort statement for clinical trials

strobe statement for observational trials

57
Q

What rating scales can be used to assess the quality of a study? How many reviewers?

A

JADAD scale / PEDro scale / QUADAS scale

-> at least 2 primary reviewers will independently assess and rate

58
Q

T/F When synthesizing the data, you must determine the degree of heterogeneity or homogeneity in the included studies

A

True, [Heterogeneity – dissimilarity in specific aspects of the studies]

59
Q

What is inclused in the discussion and conclusions section?

A
  1. overall conclusions based on the quality of evidence that was obtained
  2. Integrate the findings to clarify the state of knowledge in a clinical context
60
Q

Meta-analysis results are presented in what type of plot? Helps to do what?

A

Forest plot - Helps combine the results quantitatively and obtain a single summary result

61
Q

Forest plot can answer questions of:

A
  1. what is the direction of effect
  2. what is the size of effect
  3. whether the effects are consistent across studies
62
Q

T/F Forest plot is only as good as the studies in it

A

True

63
Q

Where can you find find independent, high quality evidence of systematic review

A

Cochrane Library

  • with topics including movement disorders, wounds, stroke, neuromuscular disease, back problems, developmental and learning problems, bone and joint trauma, and HIV/AIDS
  • with rigorous standards developed to ensure these reviews provide accurate and thorough appraisals of the literature