Peer Review Flashcards
Peer review is
a system whereby hypotheses (ideas), experiments (observations) and conclusions (claims) are subjected to critical evaluation and review by one or more experts in the pertinent fields or disciplines.
Peer review is
intellectual quality control.
peer review is always applied to
applications for funds (grants) to support experimental or clinical research.
peer review is routinely applied to
articles submitted for publication in journals.
peer review is sometimes applied to
abstracts for oral presentations at scientific or clinical meetings.
the traditional standards applied to a peer-reviewed journal article serve as a
model for critical thinking and evaluation.
introduction questions
is there a clearly stated rationale or hypothesis?
does the rationale or hypothesis have a logical basis?
has the background been adequately reviewed, summarized and understood?
the most important section of the article is the
methods (how the study wasd done; how information was collected).
methods questions
are the experimental methods appropritate for the stated rationale?
if the study involves measurements or observations, are the subjects’ characteristics appropriate and representative of the larger population which the study is intended to address?
have appropriate statistical considerations been taken into account?
results questions
have the measurements or observations been adequately presented?
are graphs, diagrams or other summary figures and statistics representative o the entire study sample?
do the results present the blemishes along with the positive and confirmatory findings and observations?
discussion
do the authors address their results?
do the authors critically evaluate their work?
are all claims and conclusions supported by the results?
steps typically involved in peer review of a manuscript submitted for publication in a biomedical journal
- submit the original manuscript
- receive comments form the referees, along with the editorial summary and decision.
- revise the manuscript and resubmit
- acceptance
referees are
experts in the field who do not get reimbursed for a review. Their job is to apply critical evaluation to the study being reviewed.
sequence of reviewers
journal staff
scientific editors
members of the editorial board
reviewers
journal staff
oversees receipt of manuscripts, manages communications with authors and reviewers and processes accepted manuscripts for publication.
scientific editors
make the final decision as to whether a specific manuscript will be accepted for publication, returned for revisions or rejected.
members of the editorial board
read and review papers, select reviewers and monitor quality of reviews, and recommend actions to editor.
reviewers
provide reviews of manuscripts, make recommendations concerning publications.
what do the editors look for in reviewers?
expertise objectivity no conflict of interest good judgment able to think clearly and logically able to write a good critique reliable in returning reviews able to do the review in the allotted time frame.
the peer review process is viewed by scientists and the public as
providing a scientific stamp of approval to the paper and its contents.
the reviewer therefore has an ethical obligation to support work of high quality while appropriately challenging flawed papers.
medical publications with peer review
JAMA
New England Journal of Medicine
Journal of Bone and Joint Surgery
Annals of Internal Medicine