Week 2 Lecture 2: Literature Reviews and Sampling Flashcards

1
Q

Reasons to conduct a literature review

A

Find out:
- what is known
- relevant concepts and theories
- research methods and strategies used
- controversies
- inconsistent findings
- unanswered questions/gaps/lacunae

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Lacunae

A

= gap

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does peer-review ensure?

A
  • worthy of being publishment
  • no glaring errors or context (methodological) or style (typo etc.)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Types of literature review (10)

A
  • narrative
  • systematic
  • living systematic
  • meta-analysis
  • conceptual
  • rapid
  • scoping
  • critical
  • expert
  • state-of-the-art
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Narrative literature review

A

= ‘tells a story’ about findings based on what you think is important to review
(+) good if expert (ignore junk)
(-) bad if not expert (emit important info)
(-) biased

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Systematic literature review

A

= review of the peer-reviewed literature and sometimes ‘grey’ literature (gov docs, etc.)
(+) thorough, (systematic)
(+) less biased than narrative
(-) time-consuming
(-) unmanageable amount of data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Grey Literature

A

= information produced by government agencies, academic institutions, and also the for-profit sector that is not typically made available by commercial publishers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Meta-analysis literature review

A

= comparing statistics of different studies
or
comparing different literature reviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Living systematic review

A

= conducted during an event to add to studies as they come out

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Rapid reviews

A

= fast, not completely systematic, literature reviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Conceptual reviews

A

= looking at theories/concepts

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Scoping reviews

A

= review breadth of info/study types/focii

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Critical reviews

A

= critical analysis of forms of research in a field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Expert reviews

A

= done by an expert

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

State-of-the-art Review (SoTA)

A

= provides a time-based overview of the current state of knowledge about a phenomenon and suggest directions for future research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

SoTA

A

= state-of-the-art review, timeline of knowledge + suggestions of future research directions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Cooper’s Taxonomy of literature reviews

use goodnotes tape on taxonomy diagram (6)

A

Method of classification of literature reviews according to:
1. Focus
2. Goal
3. Organisation
4. Perspective
5. Audience
6. Coverage

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Cooper’s Taxonomy of literature reviews Focus catagories (4)

A

Research outcomes, research methods, theories, applications

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Cooper’s Taxonomy of literature reviews Goal catagories

A

Integration, criticism, central issues

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Cooper’s Taxonomy of literature reviews Organisation catagories

A

Historical, conceptual, methodological

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Cooper’s Taxonomy of literature reviews Perspective catagories

A

Neutral representation, espousal of position

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Cooper’s Taxonomy of literature reviews Audience catagories

A

Specialised scholars, general scholars, practitioners and polititians, general public

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Cooper’s Taxonomy of literature reviews Coverage categories

A

Exhaustive, exhaustive and selective, representative, central/pivotal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Criteria for good literature reviews

8

A
  • justify criteria for inclusion and exclusion
  • distinguish what has been done from what needs to be done
  • place topic/problem in broader scholarly context and in own historical context
  • acquire and enhance subject vocabularly (learn the jargon and add to it) by articulating related variables and phenomena
  • synthesize and develop a new perspective on the literature
  • identify the methodological issues, ideas and techniques related to the topic
  • provide a rationale for the practical and scholarly significance of the study
  • write in coherent manner with clear structure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Exploratory research

A

= conducted to investigate a problem that is not clearly defined

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Explanatory research

A

= seeks to explain why something occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Experimental research

A

= studies conducted with a scientific approach using two sets of variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Quasi-experimental research

A

= estimate the causal impact of an intervention on target population without random assignment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Correlational research

A

= measures the strength and direction of a relationship between variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Interventional studies

A

= tests an intervention on a target population

31
Q

Observational studies

A

= collects information from participants or looks at data that was already collected, independant variable is not controlled by researcher

32
Q

Cross-sectional studies

A

= observational studies that analyze data from a population at a single point in time

33
Q

Longitudinal study

A

= observational study of the same variables in target population over long periods of time

34
Q

Qualitative research

A

= gathers and analyse non-numerical data in order to gain an understanding of individuals’ social reality, including understanding their attitudes, beliefs, and motivation.

35
Q

Quantitative research

A

= collection of measurable data and the application of statistical, mathematical, or computational techniques for analysis

36
Q

Mixed methods research

A

= a mix of qualitative and quantitative research

37
Q

Ontology

A

= what is true or real; the philosophical study of being

38
Q

Epistemology

A

= what can be known and how you can know it; the theory of knowledge

39
Q

Methodology

A

= overall theoretical rationale and the principles that define how a research question, set of methods and data are embedded within a perspective; the theory of methods

40
Q

Methods

A

= the tools and techniques that you use for gathering and/or analysing data

41
Q

Factors that influence choosing a research design (4)

A
  • type of question
  • stage of research of topic
  • analysis of risks to validity and reliability
  • available resources
42
Q

Sampling frame

think of orange and blue bullseye: target population (determined by sampling criteria) –> accessible population (available to researcher) –> sample (selected with sampling method) –> study element (subject or participant)

A

= the list of popuation members (or units) from which the sample is drawn
- should contain a complete list of every element in a target population
- non-randomly chosen
- elements not in sampling frame have 0 probability of selection
- generalisations can be made only to actual population defined by sampling frame

43
Q

Sampling scheme/strategy

A

= method of selecting sampling units from the sampling frame

44
Q

Sampling frame error

A

= when sample elements are not listed or accurately represented in a sampling frame

45
Q

Probability sample

A

= one in which each element of the population has a known non-zero probability of selection

46
Q

Types of probability sampling

A
  • simple random sampling
  • systematic random sampling
  • stratified random sampling
  • cluster random sampling
47
Q

Simple random sampling

A

= each unit in population has an equal and independant chance of selection and each combination of elements has an equal probability of selection
* usually use random number tables to select elements from an ordered list
(+) free from bias
(-) difficult to obtain
(-) can get unexpected results not representative of population, may be difficult to spot –> increasing sample size solves problem

48
Q

Systematic random sampling

(implicit stratification)

A

= dividing sampling frame into intervals, randomly select a starting point and select one element from each interval
* non-equal chance of selection: selection of one member depends on previous
e.g. every 5th unit
(+) more representative sample
(+) eliminate bias
(+) same error rate as simple random sample if list is random
(-) error if periodicity in list matches sampling interval

49
Q

Stratified sampling and pros

A

= population broken down into categories, random sample taken from each category
(+) increases precision of choosing sample
(+) can show tendencies within each category
(+) ensures adequate representation of subgroups of interest

50
Q

Random cluster sampling and pros and cons

A

= population divided into groups/clusters, certain number of clusters randomly sampled using simple, systematic or stratified cluster sampling
* sampling unit is cluster not individual
* better to sample large no. clusters and smaller random no. within clusters
(+) cheaper and faster than random sample
(+) can show regional variation
(-) not a genuine random sample
(-) bias especially if only a few clusters are sampled
(-) high error if clusters are different from each other

51
Q

Pure cluster sampling

A

= whole cluster is sampled

52
Q

Stratified cluster sampling

A

= define clusters, group clusters into strata of clusters (similar clusters in a stratum), randomly pick clusters from each strata of clusters, sample participants within sampled clusters (all participants or simple random sample)

53
Q

Multi-stage cluster sampling

A

= several stages of stratified cluster sampling
e.g. large national probability samples:
1. whole country divided into geographic clusters, metropolitan and rural
2. some cities selected with certainty
3. other areas formed into strata of areas
4. clusters selected randomly from strata
5. clusters defined within this, process is repeated until blocks or telephone exchanges
6. households and individuals selected with ‘random samples’ through calling and seeing who asnwers

54
Q

The problem of non-response

A

destroys generalisability by generalising to people who are willing to respond to surveys
- 90% is good, serious problem with 50% or less but difficult to get above 60%
- multiple call backs to reduce non-response bias

55
Q

Sampling error

A

= the probability that any one sample is not completely representative of the population from which it is drawn (iin probability sampling)
- cannot be eliminated but can be minimised

56
Q

Sampling error effects

A

Internal validity: possibility of rejecting a true hypothesis (type 1 error) or accepting a false hypothesis (type 2 error)
Generalisability/external validity: of results to wider population of interest

57
Q

Type 1 internal validity error

A

Rejecting a true hypothesis

58
Q

Type 2 internal validity error

A

Accepting a false hypothesis

59
Q

Proportional stratified random sampling

A

= taking samples from stratified groups, in proportion to the population
(+) representative of population

60
Q

Disproportionate stratified random sampling

A

= taking equal or minimum numbers from each group, not proportional to occurence in population
(+) ensures adequate numbers in each stratum for meaningful statistical comparisons
(-) not representative of population

61
Q

Non-probability sampling

A

= some elements of population cannot be selected (0 probability) or probabilities of selection are unknown
- not directed at ensuring findings can be statistically generalised to a whole population
- used to examine specific phenomena or specific people’s experiences
- often reach “hard to get at” populations that cannot be found through screeing general populations
- often small samples <30, not large enough for statistical calculations

62
Q

Quota sampling

A

= disproportionate stratified random sampling
- non-quantitative

63
Q

Criterion sampling

A

= all cases that meet a set of criteria are selected

64
Q

Maximum variation sampling

A

= select cases that provide wide variations in the experience or process being examined
e.g. people who recover very quickly vs very slowly –> insights into barriers and enablers of recovery

65
Q

Homogenous sampling

A

= selected to minimise variation and maximise homogeneity to describe an experience or process in as much depth or detail as possible
(+) decrease sense of threat amongst participants (focus groups)
e.g. selecting only women survivors of rape

66
Q

Heterogenous sampling

A

= allows for discussing amongst parties with divergent or similar views from demographically distinct populations
e.g. how ppl from different age groups view climate change

67
Q

Extreme or deviant case sampling

A

= cases selected that are unsual or have distinctive characteristics that illustarte the process being examined
aim is to elicit rich and detailed info that provides a new perspective on more typical cases

68
Q
A
69
Q

Typical case sampling

A

= case is selected because it is not in any way atypical, extreme, deviant or intensely unsual
- often used with large units of analysis to demonstrate general process
- mostly useful if report is read by people unfamiliar with area of research

70
Q

Critical case sampling

A

= cases selected that illustrate processes where processes would be thought least likely

71
Q

Snowball or chain sampling

A

= initial respindents suggest other participants
useful when ppl being studied are:
- well-networked
- difficult to approach directly
- when focus of study is social networks
(-) bias

72
Q

theoretical sampling

A

= the process of data collection to generate theory
- aims to represent concepts not people, construct a theoretical explanation by specifying conditions and processes that give rise to variations
- units of analysis are concepts
- representativeness is of the theoretical complexity of phenomenon
- sample design must be flexible and adjusted continuously
continue sampling until saturation:
* no new or relevant data emerge regarding category, or
* category is well-developed in terms of properties and dimensions
* relationships among categories are well established

73
Q

Sample size determination

A

= the mathematical estimation of the number of subjects/units to be included in a study
optimisation requred:
* to allow appropriate analsyis
* to provide desired level of accuracy
* to allow validity to the significance test