Incentives that reward scientists with cash bonuses when they publish in prestigious journals drive up submission rates but have no effect on publication success, a new study reports.
The article, “Changing Incentives to Publish,” by Chaira Franzoni, Giuseppe Scellato, and Paula Stephan, appears in the August 5 issue of the journal Science.
The researchers analyzed the submission and publication numbers in Science magazine from 2000 through 2009 and compared the effects of three distinct types of incentives on author behavior:
- Personal incentives that reward publication success with direct cash bonuses (practices common in China, Korea, and Turkey)
- Institutional incentives that link publication success with departmental funding (e.g., the UK’s RAE)
- Personal incentives that link publication success with individual career success — promotion, tenure, and salary increases (e.g., the promotion and tenure system common in the United States and Canada)
Controlling for external factors such as time and national funding for research, authors who were rewarded with direct cash bonuses increased their submission rate by 46% over the observation period but experienced no corresponding increase in publication success. Publications and acceptance rates for these authors actually decreased slightly.
Institutional incentives also drove up submission rates, although not nearly as high (24% increase), and had similar null effects on publication success.
The only group that experienced real publication success were authors who received career incentives for publishing. For these researchers, submission rates went up by 12% and publications success by 34%. Commenting on their findings, Franzoni writes:
It is career incentives that matter; neither institution-based incentives nor cash incentives to individuals show statistically significant association with publications. The results also suggest that acceptance rates are negatively correlated to cash bonuses.
While their study is limited to manuscripts submitted to one journal, the findings seem to confirm what many of us have experienced anecdotally in recent years: a growing trend of low-quality submissions from particular countries.
The study also sheds light on how three different policy approaches that encourage and reward productive scientists result in very different outcomes. At least for Science, providing long-term career rewards appears to trump short-term cash payouts.
Because the study is focused on a prestigious journal, for which publication is rewarded highly in all three policy scenarios, I’d be interested in whether specialist and archival journals show similar trends. Editors, feel free to share your experiences.
Furthermore, the study didn’t consider why a manuscript was rejected (and indeed, whether it even made it out of the editorial office for peer review). If manuscripts from cash-incentivized authors are less likely to be sent out for review, then this form of incentive is actively discouraging an efficient matching of quality manuscripts with quality journals.
Creating incentives that lead to poor submission decisions ultimately wastes the time of editors, reviewers, and authors themselves and unnecessarily leads to duplication of efforts as manuscripts are resubmitted down the pecking order of journals, cascading after each rejection until they finally reach an appropriate outlet.
Recent calls in the UK to improve the system of peer review have focused entirely on the processes that take place after an editor has a received a manuscript. What may be equally important are the processes that take place before a manuscript has been submitted.
Avoiding policies that cost the system more in collective time and effort may be the key for potential cost savings.