Wednesday, June 10th, 2009


Money Back Guarantee
Image by Roby© via Flickr

Would a publisher accept a completely nonsensical manuscript if the authors were willing to pay Open Access publication charges?  After being spammed with invitations to publish in Bentham Science journals earlier this year, I decided to find out.

Using SCIgen, a software that generates grammatically correct, “context-free” (i.e. nonsensical) papers in computer science, I quickly created an article, complete with figures, tables, and references.  It looks pretty professional until you read it. For example:

In this section, we discuss existing research into red-black trees, vacuum tubes, and courseware [10]. On a similar note, recent work by Takahashi suggests a methodology for providing robust modalities, but does not offer an implementation [9].

The manuscript, entitled “Deconstructing Access Points” was submitted on January 29th, 2009, to The Open Information Science Journal (TOISCIJ), a journal that claims to enforce peer-review.

The manuscript was given two co-authors, David Phillips and Andrew Kent.  Any similarity to real or fictitious, living or dead academics is purely coincidental, as was their institutional affiliation: The Center for Research in Applied Phrenology based in Ithaca, New York.  If the acronym didn’t reveal the farce right away, phrenology is the pseudoscience of reading personality traits from the lumps on one’s head.

Bentham confirmed receipt of my submission the very next day (January 30, 2009).  Nearly four months later, I received a response — the article was accepted.  The acceptance letter read:

This is to inform you that your submitted article has been accepted for publication after peer-reviewing process in TOISCIJ. I would be highly grateful to you if you please fill and sign the attached fee form and covering letter and send them back via email as soon as possible to avoid further delay in publication.

The letter was written by a Ms. Sana Mokarram, the Assistant Manager of Publication.  She included a fee schedule and confirmation that I would pay US$800, to be sent to a post office box  in the SAIF Zone, a tax-free complex in the  United Arab Emirates.  The manuscript was subsequently retracted:

Dear Ms. Mokarram,
I’m afraid that we have to retract this article.  We have discovered several errors in the manuscript which question both the validity of the study and the results.

I have yet to receive a response.  What is surprising is that the assistant manager claimed that the article went through peer-review although there is no evidence that it actually did.  Anyone with English proficiency — with or without a degree in computer science — would recognize that this manuscript makes absolutely no sense.  Had it gone through peer review, I should have received reviewer comments.  If you are skeptical that I might be misreading the response of someone whose first language is not English, I clarified the decision in a previous email with the simple question, “Does this mean that our manuscript was accepted for publication?”  Her answer was the above quote.

From this one case, we cannot conclude that Bentham Science journals practice no peer review, only that it is inconsistently applied.  Earlier this year, I reported on a case in which a nonsensical article submitted to another Bentham Science journal was rejected after going through peer review [1].

While one should be careful not to generalize these results to other Open Access journals using similar business models, it does raise the question of whether, at least in some cases, the producer-pays-to-publish model may unduly influence editorial decision-making.  One may also question whether publishers like Bentham see a lucrative opportunity from the OA movement, considering that academic libraries are establishing author publication funds to pay Open Access charges.

Notes:

[1] Adventure in Open Access Publishing (March 12, 2009). The first manuscript, “A Study of Wide-Area Networks” was submitted to the Open Software Engineering Journal.  No other submissions to Bentham journals were made.

Reblog this post [with Zemanta]
Peer Review Monster
Image by Gideon Burton via Flickr

Today’s post by Phil Davis outlines a small experiment to see if an open access publisher with an aggressive author-pays system would provide the kind of vigilant peer-review we ascribe to STM publishers everywhere. Our hope was that this experiment would fail. We hoped that Bentham Science Publishers would prove to be rigorous and uniform in their application of peer-review, and that our suspicion that something might be amiss with a publisher aggressively soliciting manuscripts would prove baseless.

Unfortunately, Bentham wasn’t up to the task. But there’s a larger issue this incident reveals, tangential to the story about Bentham.

While the paper they accepted was laughably nonsensical and there was no evidence of peer-review, the most salient communication we received from them around the paper they accepted was the invoice.

And this invoice begins the real story here.

It’s important that everyone in academic publishing realize there is a feeder issue at play — the swelling pools of author-pays funding, how they’re being managed, and policies around their use.

As Phil Davis has pointed out in other posts on this blog, there is a lack of transparency to how author funds are being spent while the oversight of these funds may not be adequate. In addition to pots of money coming from institutions, other pots of money have also opened up to support author-pays publishing — in early May, Pfizer agreed to cover author fees for any of their employees submitting to BioMed Central.

Institutions should contemplate how their policies and practices supporting author publication fees may encourage the emergence of publishing programs aimed at soliciting and accepting as many papers as possible. With poorly managed sources of funding (i.e., easy money), blaming these publishers is akin to treating a symptom of a more fundamental and deleterious malady.

Trust and independence are the foundations of valid scholarly communication. This story hints that the author-pays model can become a charade within the scholarly publishing community.

But it may not be the author-pays model itself that introduces the fatal flaw.

Instead, it may be the administrators of the funding who have shown an Achilles heel — lax oversight, a lack of transparency, motivations to support the “publish or perish” culture of academia today, and an inability to hold publishers accountable for services rendered.

With more funds going toward author-pays publishing, librarians, administrators, and even companies have to ask if their current practices for managing these funds are adequate to ensure the independence and trust that form the foundation of scholarly communications.

If they are not, then it won’t be only the authors who pay.

Reblog this post [with Zemanta]