Research Methods- Peer Review Flashcards
Peer review:
When before publication in a journal an author’s scientific paper is assessed by people who are experts in the same scientific area as the author (peers).
Scientific work conducted and written up as a journal article
Stage 1 - Submit a paper to an academic journal, The journal then sends this paper to independent experts “peers”.
CHANGES SUGGESTED
Stage 2 - Peers consider the quality of the paper including research design and the methods used. Considering if there were extraneous variables that were uncontrolled. The data analysis will be also checked as well as deciding if the results actually supports the conclusions drawn by the author.
Stage 3 - Peers decide if they can recommend the paper for publication
Then either decided as
REJECTED = Flawed, no possibility of resubmission
OR
ACCEPTED
= Stage 4 - the journal editor makes the final decision on if the paper will be published
The role of peer review in the scientific process:
Peer review is conducted across the sciences, it is how the quality of scientific work is assessed, and ultimately influences how science is carried out by practising scientists.
Peer review
Evaluation
✅
Self regulation of work
The scientist’s knowledge that their work will be checked and assessed by fellow experts is thought to self-regulate the quality of their work, the scientist is more likely to be honest in their reporting and more careful in their planning, how they conduct their study, how they analyse their data and justify their conclusions.
Peer review
Evaluation
✅
Increases public trust
The media often reports scientific findings, the peer review system aids in science communication, helping journalists and the public decide if scientific claims should be trusted or not. This is important as acceptance of scientific findings that turn out to be flawed can reduce public trust in the scientific process.
Peer review
Evaluation
✅
Research rating
The quality and amount of published peer-reviewed work can help to assess the quality of different academic institutions, this is by giving each institution a research rating. Universities and research labs with a history of producing peer-reviewed articles are likely to be favoured by students and gain government funding for future research,
Peer review
Evaluation
❌
Hard to find who?
Journals may struggle to find suitable peers (with enough knowledge) in new or very specialised areas of scientific research with few experts.
Peer review
Evaluation
❌
Professional rivalry
Professional rivalry exists in academic fields, this can result is peers rejecting papers on non academic grounds, or even so they can publish findings first!
Peer review
Evaluation
❌
Inability
Peers may feel unable to challenge the work of academic leaders in a scientific field. Either assuming the author must be correct, or fearing a negative response.
Single blind peer review
The author does not know who the peers are.
Double blind peer review
The author does not know who the peers are and the peers do not know who the author is.
Blind peer reviews
Evaluation
❌
Problematic
Blinding is problematic, authors can be identified by writing style, and anonymous reviewers can be more likely to steal ideas, and be unnecessarily harsh.
Blind peer reviews
Evaluation
❌
Publication bias
Publication bias towards publishing positive findings results in the file draw problem, important negative findings never being published for scientist to find.