This clumsy hatchet job from Nature reporter Declan Butler is beneath him, a poor excuse for journalism and an affront to the respect with which many of his colleagues are regarded by the research community.
Let’s start with the title: “PLoS stays afloat with bulk publishing”. Loaded rhetoric, anyone? The clear implications are that PLoS is floundering (Butler’s own numbers show otherwise!), and that “bulk” is somehow inferior (to, one presumes, “boutique” or some such). PLoS is “following an haute couture model of science publishing” sniffs our correspondant, who goes on to clarify: “relying on bulk, cheap publishing of lower quality papers to subsidize its handful of high-quality flagship journals”.
This emphasis on “quality” and the idea that the same somehow equates with scarcity continues throughout: “the company consciously decided to subsidize its top-tier titles by publishing second-tier community journals with high acceptance rates”, “the flood of articles appearing in PLoS One (sic)”, “difficult to judge the overall quality”, “because of this volume, it’s going to be considered a dumping ground”, “introduces a sub-standard journal to their mix”.
The intent is obvious, and the illogic is boggling. Where does Butler think the majority of science is published? Even if you buy into this nebulous idea of “quality” (one knows it when one sees it, does one not old chap? wot wot?) there can be no “great brand” journals without the denim-clad proletarian masses. All the painstaking, unspectacular groundwork for those big flashy headline-grabbing (and, dare I say it, all too often retracted) Nature front-pagers has got to go somewhere.
It gets much worse, though, when we get some measure of what Butler thinks “quality” means:
Papers submitted to PLoS One (sic) are sent to a member of its editorial board of around 500 researchers, who may opt to review it themselves or send it to their choice of referee. But referees only check for serious methodological flaws, and not the importance of the result.
That, along with an earlier remark about “a system of ‘light’ peer review”, is a blatant and serious misrepresentation of PLoS ONE’s review process. Here’s the actual policy:
The peer review of each article concentrates on objective and technical concerns to determine whether the research has been sufficiently well conceived, well executed, and well described to justify inclusion in the scientific record. [...]
Unlike many journals which attempt to use the peer review process to determine whether or not an article reaches the level of ‘importance’ required by a given journal, PLoS ONE uses peer review to determine whether a paper is technically sound and worthy of inclusion in the published scientific record. [...]
To be considered for publication in PLoS ONE, any given manuscript must satisfy the following criteria:
- Content must report on original research (in any scientific discipline).
- Results reported have not been published elsewhere.
- Experiments, statistics, and other analyses are performed to a high technical standard.
- Conclusions are presented in an appropriate fashionand supported by the text.
- Techniques used have been documented in sufficient detail to allow replication.
- Reports are presented in an intelligible fashion and written in standard English.
- Research meets all applicable standards, including the Helsinki Declaration, with regard to the ethics of human and animal experimentation, consent, and research integrity.
- Report adheres to the relevant community standards for research, reporting, and deposition of data. (Standards PLoS promotes across its journals).
Which is to say that PLoS ONE* holds authors to exactly the same scientific standards that every journal should follow. Which is to say that any methodological flaws, not “only… serious” ones, will see a paper revised, or rejected if the flaws can’t be overcome. Which is to say that PLoS ONE uses peer review to do what it was designed to do, not to create an artificial scarcity from which to milk profit with scant regard for the integrity of the scientific record. That’s not “light” peer review, it’s real peer review.
With this scurrilous parroting of anti-OA FUD, Nature makes pretty clear where its interests and its allies are. Well, you know what happens when you lie down with pit bulls…
There’s a lot more, but that was the issue that pushed my buttons the hardest. See Bora for a roundup of responses; here’s a quick outline of some of the key issues:
Jan Velterop, responding to Butler’s last “investigation” of PLoS finances two years ago, pointed out that it’s ridiculous to expect a new journal with a new business model to break even in a few years, when new journals from established publishers take up to a decade to achieve the same goal; DrugMonkey also mentions the “so what” nature of this complaint. Jonathan Eisen remarks that somehow Butler gets from “PLoS ONE is doing well and making money” to “PLoS is a failure”; go read Jonathan to see how twisted your logic has to be to make that particular trip. (Jonathan also provides an important reminder, that we should not confuse Nature Publishing Group as a whole with their many talented and well intentioned employees!) Grrlscientist observes that, while Butler’s piece makes it sound as though PLoS’ reliance on donations were a bad thing, all journals rely on the donation of time and expertise by unpaid reviewers. Drugmonkey, Jonathan and Grrlscientist all make the point that Nature has its own stable of “second tier” journals with “lower barriers to entry” — the same mechanism for which Butler criticizes PLoS. Stevan Harnad is famous for making the point (here, for example) that if the funds currently draining into subscriptions were used to pay OA costs, there would be an immense improvement in the utility of the scientific record even if there were no financial saving.
Finally, pretty much every commenter has pointed out the glaring lack of any “conflict of interest” statement on the Nature piece — having said which, I’d better make one of my own. It’s well known and obvious at a glance at this blog that my favorite drink is the Open Access Kool-Aid. I have personal friends who work for PLoS, and I’ve previously applied to work there myself.
* originally in lowercase — so much for my snotty (sic)s!