Reviewing the reviewers
I’ve written about some alternatives to the current review process, and I believe one of ways in which the current process can be improved is by formal recognition of reviewers’ efforts. While many conferences and journals acknowledge reviewers by publishing their names, this does not reflect the quality of the effort put in by some reviewers. A more lasting and public recognition of quality reviewers may be one way to improve the quality of this volunteer effort.
Interestingly, the APS recently instituted a policy of recognizing referees who review the articles submitted to the various APS journals.
The basis for choosing the honorees was the quality, number, and timeliness of their reports, without regard for membership in the APS, country of origin, or field of research. Individuals with current or very recent direct connections to the journals, such as editors and editorial board members, were excluded.