Peer review

:This article refers to the scholarly process of screening papers. For the Wikipedia process of improving articles, see .

How it works

Peer review subjects an author's work or ideas to the scrutiny of one or more others who are experts in the field. These referees each return an evaluation of the work, including suggestions for improvement, to an editor or other intermediary (typically, most of the referees' comments are eventually seen by the author as well). Evaluations usually include an explicit recommendation of what to do with the manuscript or proposal, often chosen from a menu provided by the journal or funding agency. Most recommendations are along the lines of the following:

Related Topics:
Idea - Expert

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

• to unconditionally accept the manuscript or proposal,
• to accept it in the event that its authors improve it in certain ways,
• to reject it, but encourage revision and invite resubmission
• to reject it outright.

During this process, the role of the referees is advisory, and the editor is under no formal obligation to accept the opinions of the referees. Furthermore, in scientific publication, the referees do not act as a group, do not communicate with each other, and typically are not aware of each other's identities. There is usually no requirement that the referees achieve consensus. Thus the group dynamics is substantially different from that of a jury. In

Related Topics:
Consensus - Jury

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

situations where the referees disagree about the quality

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

of a work, there

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

are a number of strategies for reaching a decision.

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

Traditionally reviewers would remain anonymous to the authors, but this is slowly changing. In some academic fields most journals now offer the reviewer the option of remaining anonymous or not; papers sometimes contain, in the acknowledgments section, thanks to (anonymous or named) referees who helped improve the paper.

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

At a journal or book publisher, the task of picking reviewers typically falls to an editor. When a manuscript arrives, an editor solicits reviews from scholars or other experts who may or may not have already expressed a willingness to referee for that journal or book division. Granting agencies typically recruit a panel or committee of reviewers in advance of the arrival of applications.

Related Topics:
Editor - Scholar - Journal - Book division - Panel - Committee

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

In some disciplines, such as computer science, there exist refereed venues (such as conferences and workshops). To be admitted to speak, scientists must submit a scientific paper (generally short, often 15 pages or less) in advance. This paper is reviewed by a "program committee" (the equivalent of an editorial board), who generally requests inputs from referees. The hard deadlines set by the conferences tend to limit the options to either accept or reject the paper.

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

Typically referees are not selected from among the authors' close colleagues, relatives, or friends. Referees are supposed to inform the editor of any conflict of interests that might arise.

Related Topics:
Colleague - Conflict of interests

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

Journals or individual editors often invite a manuscript's authors to name people whom they consider qualified to referee their work. Authors are sometimes also invited to name natural candidates who should be disqualified, in which case they may be asked to provide justification (typically expressed in terms of conflict of interest).

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

Editors solicit author input in selecting referees because academic writing typically is very specialized. Editors often oversee many specialties, and may not be experts in any of them, since editors may be full time professionals with no time for scholarship. But after an editor selects referees from the pool of candidates, the editor typically is obliged not to disclose the referees' identities to the authors, and in scientific journals, to each other. Policies on such matters differ between academic disciplines.

Related Topics:
Academic - Scholarship

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

Scientific journals observe this convention universally. The two or three chosen referees report their evaluation of the article and suggestions for improvement to the editor. The editor then relays the bulk of these comments to the author (some comments may be designated as confidential to the editor), meanwhile basing on them his or her decision whether to publish the manuscript. When an editor receives very positive and very negative reviews for the same manuscript, the editor often will solicit one or more additional reviews as a tie-breaker.

Related Topics:
Scientific journal - Evaluation

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

As another strategy in the case of ties, editors may invite authors to reply to a referee's criticisms and permit a compelling rebuttal to break the tie. If an editor does not feel confident to weigh the persuasiveness of a rebuttal, the editor may solicit a response from the referee who made the original criticism. In rare instances, an editor will convey communications back and forth between authors and a referee, in effect allowing them to debate a point. Even in these cases, however, editors do not allow referees to confer with each other, and the goal of the process is explicitly not to reach consensus or to convince anyone to change their opinions. Some medical journals, however, (usually following the open access model) have begun posting on the Internet the pre-publication history of each individual article, from the original submission to reviewers' reports, authors' comments, and revised manuscripts.

Related Topics:
Criticism - Open access

~ ~ ~ ~ ~ ~ ~ ~ ~ ~

After reviewing and resolving any potential ties, there may be one of three possible outcomes for the article. The two simplest are outright rejection and unconditional acceptance. In most cases, the authors may be given a chance to revise, with or without specific recommendations or requirements from the reviewers.

~ ~ ~ ~ ~ ~ ~ ~ ~ ~