Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

2020 Research Methods > L7 - Meta Analysis > Flashcards

L7 - Meta Analysis Flashcards

1
Q

What are the 4 types of review types?

A

Literature Review

Scoping Review

Systematic Review

Meta-analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the features of a literature review?

A

Can be “narrative” or “qualitative”

Not expected to be systematic or overly descriptive in methods

Often Published by ‘experts’ in the field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are some of the flaws in literature reviews?

A

Researchers may put emphasis on studies that other researchers see as ‘less important’. Meaning different researchers can reach different conclusions based on the literature.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the key features of a scoping review?

A

Covers key concepts

Sources and types of evidence are available

Explores complex areas or areas not previously reviewed comprehensively or rigorously

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What review would you use for the following research questions?

  1. In what way has the concept of resilience been used in the literature concerning the transition to parenthood?
  2. To what extent are researchers using theory to underpin their work?
A

Scoping Review

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the key features of a systematic review?

A
  1. Review that has been conducted in a systematic manner
  2. Is set-out like other studies: intro, methods, results, discussion, qualatative study of the results of empirical / original research
  3. Differs from a narrative review: it is comprehensive/exhaustive, rates methodological quality of studies, can include effect sizes.
    * Important in evidence based practice, very rigorous and documented methodology. Aim is for the research to be reproduced and updated by other researchers.*
    * e.g. looking at the effectiveness of a intervention.*
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What review would we use for the following research questions?

How has motivation interviewing been used for adults with multiple sclerosis?

What is the potential impact of delivery format an/or modality on intervention effects?

A

Systematic Review

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the key features of a meta analysis

A
  1. Statistical analysis of data obtained from empirical studies
  2. Quantitative data from multiplke studies are combined and analysed
  3. Main statistic is effect size
  4. There are different effect sizes - it all depends on the study design/data you need to extract
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the main goal of a meta-analysis?

A

To discover how big an effect size actually is,

and what factors might moderate and influence that effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What type of review would we use for the following research questions.

How do mean burnout levels reported by postgraduate trainees compare to norms?

Are there differences in burnout patterns, based on training level (interns, residents, registrars), and speciality (e.g. surgical vs. non-surgical)

A

Meta-analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the 10 steps of a meta-analysis?

A
  1. State Research Question
  2. Do a literature search
  3. Decide on objective criteria
  4. Screen studies
  5. Extract information
  6. Assess study quality
  7. Calculate the effect sizes
  8. Do the meta-analysis
  9. Write it up
  10. Publish
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the reporting standards set by the APA for meta-analysis called?

A

MARS

“Meta-analysis Reporting Standards”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

The first step to undertaking a meta analysis is to state the research question

What is the criteria we use for stating the research question?

A

PICO

Population

Intervention (or exposure)

Comparator

Outcome

e.g.

P: adults, both sexes, all ethnicity

I: Mindfulness intervention

C: Psychotherapy

O: Anxiety symptoms or generalized anxiety

Example question: For adults, does mindfulness meditation compared to other psychotherapies reduce anxiety?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the most important thing to do when using the PICO criteria when stating the research question

A

Each step of PICO needs to be defined

If possible, justify the definitions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Step 2 in a meta-analysis is “do a literature search”

How should you go about doing this?

A

Being a thorough as you can be.

  • Search electronic databases that have addressed the same research questions*
  • Search conference proceedings, dissertations, Google Scholar etc.*
  • Consult experts in the field*
  • Search the reference lists of articles you have found*
  • Search the reference lists of relevent reviews*
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

When you are doing your literature review, you will find from 1000 - 10,000 studies.

How do you reduce this into something manageable?

A

Decide on an objective criteria (step 3 in generating a meta-analysis)

Decide on an inclusion criteria for studies, and you need to justify these criteria, be objective and be explicit

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Step 3 in doing a meta analysis is “decide on objective criteria”

What is important to do in deciding on this criteria?

A

The criteria needs to be justified, objective and explicit.

  • example criteria:*
  • how have you defined key variables?*
  • Which participants are eligible (so reader can assess to whom the results apply)*
  • Are specific study designs eligible?*
  • Is ther ea time period in which studies needed to be conducted?*
18
Q

How do you make the process of finding studies easier in a meta-analysis?

A

Screen Studies (Step 4)

19
Q

Step 4 of conducting a meta-analysis is to “screen studies”

What steps can you use to do this?

A

Consider screening tools

How were the studies screened? (i.e. title, abstact, full text)

Number of reviewers involved in search process (if > 1 reviewer, how were disagreements resolved)

Number of studies included

Number of studies excluded (and reasons why)

20
Q

Step 5 of conducting a meta-analysis is “extract information”

What are some examples of the kinds of information should you be extracting in this phase?

A

Author name
 Year of publication
 The population
 The study design (RCT? Observational? etc)
 The intervention and comparison conditions (if relevant)
 The outcomes and how were they measured
 No. of individuals (intervention vs. control? Total N?)
 Effect size data (e.g. means, SDs, N, r….depends on study design)

21
Q

Step 6 when conducting a meta-analysis is “assess study quality”

What does this mean?

A

Critically appraise the information contained within your meta-analysis

22
Q

What is a good way to assess data (step 6) in your meta-analysis?

A

Using tables

23
Q

What is this an example of?

A

Overall quality assessment of the studies involved in a meta-analysis

24
Q

Once you have collected all your studies in your meta-analysis, what is the next step for you to take? (step 7)

A

Calculate the effect sizes

25
Q

The effect size you will use in your meta-analysis is dependent on…

A

Your research question

26
Q

What effect size should you use when examining an association?

A

Correlation r

27
Q

What effect sizes measures should you use when comparing two groups with dichotomous outcomes?

A

risk ratio or odds ratio

28
Q

What effect sizes measures should you use when comparing two groups with continuous outcomes?

A

Cohen’s d or Hedges’ g

29
Q

Step 8 in a meta-analysis is do the meta-analysis

Before you can combine different effect sizes from different studies, you need to look at a number of particular issues.

What are they? (4 in total)

A
  1. How were studies with more than one effect size handled?
  2. Were fixed or random effects models used, and why? (how do you weight the effect sizes across studies)
  3. How was heterogeneity assessed? (how different were effect sizes in terms of magnitude)
  4. How was publication bias assessed?
30
Q

One important aspect of conducting a meta analysis is to ensure data independence

What does this mean?

A

If one study contibuted more than one effect size this means that the same participants provided multiple outcomes for your review.

The measures for the study are not independent, and it would be inappropriate to treat each effect size as independent

31
Q

What might you do if a study has more than one effect size (e.g. not data independent)

A

Average the effect sizes for that study.

32
Q

Some meta-analysis weight the effect sizes, what does this mean?

A

They put more weight on the effect size found, depending on the sample size and variance of the study.

Studies with larger study size are given a bigger weight in the overall effect estimate, as they are considered more precise.

33
Q

When pooling or combining the effect sizes from different studies for a meta-analysis, there are two options you can choose from.

What are they?

important for exam

A

Fixed or Random model

Fixed effect model: assumes that effect sizes are similar across studies

(homogenous in terms of outcomes, population examined etc.)

Random effect model: asssumes that effect sizes vary from study to study

(effect sizes might be higher or lower when participants are older or more educated than other studies)

34
Q

What do the following 4 studies assess?

Q statistic

Tau (equivalent to SD of an effect size)

I2 (expressed as a percentage)

Subgroup analyses (note: recommend at least 4 studies per subgroup) and/or meta-regression.

A

Estimate variablility of effect sizes across studies

i.e Heterogeneity

35
Q

When assessing heterogeneity of effect sizes in your meta-analysis, what might happen if you have a low number of studies (e.g. 10 or less)

A

It will have low power

36
Q

One important issue in a meta-analysis is the assess publication bias, what is it?

important for exam

A

Refers to the fact that significant findings are more likely to be published in journals than nonsignificant findings

37
Q

The file-drawer problem is another name for…

A

publication bias

38
Q

What are two methods you can use to test publication bias?

A

Fail-safe N (Nfs)

Funnel plot analysis

39
Q

What does the fail-safe N (Nfs) tell us?

A

The statistic represents the number of hypothetical studies that woul dbe required to reduce a given r to a small, non-significant effect

(i.e. r = .10)

40
Q

What is a funnel plot analysis?

How does it work?

A

A scatter plot of the effect estimates of individual studies.

These effect estimates are plotted against some measure of each study (e.g. size, or precision, or the standard error of effect estimate)

in the example, each dot represents an effect size from a single study. Studies with larger sample sizes are towards the top and smaller studies at the bottom. In the absence of publication bias, the dots should be relatively symmetrical. When there is publication bias, there are gaps in the funnel (such as the right image).

41
Q

What is the issue with using a funnel plot for looking at publication bias?

A

It is visual (very subjective)

  • However, there are inbuilt tests in meta-analysis that confirm the results of the funnel plot.*
  • If there are not enough studies, the power of the study is small.*
42
Q

Step 9 of doing a meta analysis is “writing it up”.

What are the features within writing it up?

A

Tables and/or forest plots to summarise:
o characteristics of the studies (eg. sample ns, country, study
design etc)
o effect size estimates, including p values and CIs
 Statement of major findings
 Compare/contrast to available research
 Critically evalute findings - Alternative explanation for observed results
 Generalisability of results (was there bias present)
 Limitations of review
 Implications for future research, theory, policy, practice

2020 Research Methods (9 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions