<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: PLoS Releases Article-level Metrics</title>
	<atom:link href="http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/feed/" rel="self" type="application/rss+xml" />
	<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/</link>
	<description>What&#039;s Hot &#38; What&#039;s Cooking in Scholarly Publishing - from the Society for Scholarly Publishing</description>
	<lastBuildDate>Wed, 15 Feb 2012 17:25:09 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.com/</generator>
	<item>
		<title>By: Greg</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-25590</link>
		<dc:creator><![CDATA[Greg]]></dc:creator>
		<pubDate>Fri, 17 Dec 2010 17:22:55 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-25590</guid>
		<description><![CDATA[I was wondering your feelings on the cumulative chart rather than a monthly comparison where you can see peaks and valleys?

There will never be a decline, which authors may enjoy, but they will also need to do visual subtraction to see the differences between monthly usage.

Shouldn&#039;t this be treated more like an analytic package?

Is it useful to authors to see results of news/blog posts/etc on their article rather than a running total put to a graph?]]></description>
		<content:encoded><![CDATA[<p>I was wondering your feelings on the cumulative chart rather than a monthly comparison where you can see peaks and valleys?</p>
<p>There will never be a decline, which authors may enjoy, but they will also need to do visual subtraction to see the differences between monthly usage.</p>
<p>Shouldn&#8217;t this be treated more like an analytic package?</p>
<p>Is it useful to authors to see results of news/blog posts/etc on their article rather than a running total put to a graph?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: The Pepsi Syndrome: Did ScienceBlogs Sell Out, or Was This Just Business As Usual? &#171; The Scholarly Kitchen</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-16609</link>
		<dc:creator><![CDATA[The Pepsi Syndrome: Did ScienceBlogs Sell Out, or Was This Just Business As Usual? &#171; The Scholarly Kitchen]]></dc:creator>
		<pubDate>Fri, 09 Jul 2010 09:25:55 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-16609</guid>
		<description><![CDATA[[...] valuable links to help search engine optimization, and actually gaming PLoS&#8217; own system for article level metrics (should it count toward an article&#8217;s benefit if it&#8217;s blogged about by the staff of the [...]]]></description>
		<content:encoded><![CDATA[<p>[...] valuable links to help search engine optimization, and actually gaming PLoS&#8217; own system for article level metrics (should it count toward an article&#8217;s benefit if it&#8217;s blogged about by the staff of the [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: How Meaningful Are User Ratings? (This Article = 4.5 Stars!) &#171; The Scholarly Kitchen</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-5598</link>
		<dc:creator><![CDATA[How Meaningful Are User Ratings? (This Article = 4.5 Stars!) &#171; The Scholarly Kitchen]]></dc:creator>
		<pubDate>Mon, 16 Nov 2009 10:11:47 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-5598</guid>
		<description><![CDATA[[...] to drive the creation of new, better measurements by releasing a variety of data through their article level metrics program.  PLoS is taking something of an “everything but the kitchen sink” approach here, compiling [...]]]></description>
		<content:encoded><![CDATA[<p>[...] to drive the creation of new, better measurements by releasing a variety of data through their article level metrics program.  PLoS is taking something of an “everything but the kitchen sink” approach here, compiling [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dwight Swain</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-4798</link>
		<dc:creator><![CDATA[Dwight Swain]]></dc:creator>
		<pubDate>Fri, 25 Sep 2009 19:49:05 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-4798</guid>
		<description><![CDATA[Brandon: &quot;If one creates, and promotes, a new metric such as article impacts then you need to take responsibility for the potential outcomes of its use.&quot; 

You seem to be missing the point that PLoS is not creating anything here (unlike ETS) Rather they are just exposing factual data that traditional publishers have been unable or unwilling to share.

Of course the facts can be misused and misinterpreted, as PLoS openly acknowledges.

As persons involved in science publishing, we should not argue for the suppression of factual information. The opposite of the flawed &#039;wisdom of the crowd&#039; is not wisdom.]]></description>
		<content:encoded><![CDATA[<p>Brandon: &#8220;If one creates, and promotes, a new metric such as article impacts then you need to take responsibility for the potential outcomes of its use.&#8221; </p>
<p>You seem to be missing the point that PLoS is not creating anything here (unlike ETS) Rather they are just exposing factual data that traditional publishers have been unable or unwilling to share.</p>
<p>Of course the facts can be misused and misinterpreted, as PLoS openly acknowledges.</p>
<p>As persons involved in science publishing, we should not argue for the suppression of factual information. The opposite of the flawed &#8216;wisdom of the crowd&#8217; is not wisdom.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Brandon A Nordin</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-4779</link>
		<dc:creator><![CDATA[Brandon A Nordin]]></dc:creator>
		<pubDate>Thu, 24 Sep 2009 13:21:09 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-4779</guid>
		<description><![CDATA[&quot;Don&#039;t blame the metric, blame the interpretation&quot; - seems to be ETS-like sophistry.  If one creates, and promotes, a new metric such as article impacts (and, let&#039;s ne clear, this isn&#039;t being advocated by PLoS as a type of &quot;top tracks&quot; ephemeral curiosity) then you need to take responsibility for the potential outcomes of its use.

Interesting too that this type of schema could reward notoriety over integrity: I would bet the next &quot;cloned cow&quot; paper will get lots of traffic/links etc...but may not be an example of sterling science.

[Editor&#039;s note: ETS = &quot;Educational Testing Service&quot;]]]></description>
		<content:encoded><![CDATA[<p>&#8220;Don&#8217;t blame the metric, blame the interpretation&#8221; &#8211; seems to be ETS-like sophistry.  If one creates, and promotes, a new metric such as article impacts (and, let&#8217;s ne clear, this isn&#8217;t being advocated by PLoS as a type of &#8220;top tracks&#8221; ephemeral curiosity) then you need to take responsibility for the potential outcomes of its use.</p>
<p>Interesting too that this type of schema could reward notoriety over integrity: I would bet the next &#8220;cloned cow&#8221; paper will get lots of traffic/links etc&#8230;but may not be an example of sterling science.</p>
<p>[Editor's note: ETS = "Educational Testing Service"]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Peter Binfield</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-4766</link>
		<dc:creator><![CDATA[Peter Binfield]]></dc:creator>
		<pubDate>Tue, 22 Sep 2009 21:35:51 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-4766</guid>
		<description><![CDATA[David and Richard

We completely agree that usage statistics need to be treated with caution and have been at pains to point this out in our various informational pages (as well as listing various caveats in their use) - see for example tab 2 of http://article-level-metrics.plos.org/ and also http://www.plosone.org/static/usageData.action  

We also make the point in several places that usage statistics need to be treated as indicators of trends, rather than absolute measures to be applied to a single article.

It is also worth noting, of course, that article-level metrics at PLoS are far more than just usage - they include citations, blog coverage, comments, notes, ratings, social bookmarks etc - all of which can provide readers with extra information and context as related to a particular article. Of course, though, usage data are a very visible addition to this suite of metrics.

At the end of the day, in our opinion openly providing the usage data (data which could be routinely provided by any publisher) is preferable to keeping it hidden. By making these data available, we are adding one more measure into the mix and allowing the community to make its own decisions as to how to use it. And now that we have started to provide usage data, it will be possible for the community to engage in meaningful debate (and research) into its significance.]]></description>
		<content:encoded><![CDATA[<p>David and Richard</p>
<p>We completely agree that usage statistics need to be treated with caution and have been at pains to point this out in our various informational pages (as well as listing various caveats in their use) &#8211; see for example tab 2 of <a href="http://article-level-metrics.plos.org/" rel="nofollow">http://article-level-metrics.plos.org/</a> and also <a href="http://www.plosone.org/static/usageData.action" rel="nofollow">http://www.plosone.org/static/usageData.action</a>  </p>
<p>We also make the point in several places that usage statistics need to be treated as indicators of trends, rather than absolute measures to be applied to a single article.</p>
<p>It is also worth noting, of course, that article-level metrics at PLoS are far more than just usage &#8211; they include citations, blog coverage, comments, notes, ratings, social bookmarks etc &#8211; all of which can provide readers with extra information and context as related to a particular article. Of course, though, usage data are a very visible addition to this suite of metrics.</p>
<p>At the end of the day, in our opinion openly providing the usage data (data which could be routinely provided by any publisher) is preferable to keeping it hidden. By making these data available, we are adding one more measure into the mix and allowing the community to make its own decisions as to how to use it. And now that we have started to provide usage data, it will be possible for the community to engage in meaningful debate (and research) into its significance.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David Crotty</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-4762</link>
		<dc:creator><![CDATA[David Crotty]]></dc:creator>
		<pubDate>Tue, 22 Sep 2009 14:42:20 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-4762</guid>
		<description><![CDATA[I do like the idea of article metrics, but like Richard above, I have serious reservations about their use for ranking the impact of a paper.  They do provide an interesting window for authors to see what&#039;s going on with their paper, but I feel it&#039;s far too easy to misinterpret what they mean.  To Richard&#039;s objections above, I&#039;d add the following:

Trusting the wisdom of the crowd is inherently flawed because &lt;a href=&quot;http://www.readwriteweb.com/archives/the_dirty_little_secret_about_the_wisdom_of_the_crowds.php&quot; rel=&quot;nofollow&quot;&gt;there is no crowd&lt;/a&gt;.  As the linked article points out, most online participation is done by small groups of dedicated users.  Often these groups have biases and agendas.  If the quality of science is judged by readers giving a paper a ranking, then what&#039;s to stop, as one example, a group of rabid creationists from marking down good evolution papers and repeatedly giving high rankings to creationist claptrap?  This would result in good science being underfunded and religion receiving lots fo grants.  The example cited in your blog entry here is telling as well--PLoS draws heavily on a readership that is very interested in science publishing and new models for information sharing.  Those interests may not be shared by the majority of scientists who spend less time reading PLoS journals, but you wouldn&#039;t know that from looking at these metrics.

The other issue is the ease with which such rankings are gamed.  Everyone knows that online reviews are heavily infested with fake comments from &lt;a href=&quot;http://www.ctv.ca/servlet/ArticleNews/story/CTVNews/1076990577460_35?hub=SciTech&quot; rel=&quot;nofollow&quot;&gt;authors on their own books&lt;/a&gt; and business owners touting their own products.  If a scientist&#039;s grant funding is going to be influenced by the rankings and download numbers of his papers, you can bet that he will make it his job to spend all available time downloading his own papers and giving them stellar reviews.]]></description>
		<content:encoded><![CDATA[<p>I do like the idea of article metrics, but like Richard above, I have serious reservations about their use for ranking the impact of a paper.  They do provide an interesting window for authors to see what&#8217;s going on with their paper, but I feel it&#8217;s far too easy to misinterpret what they mean.  To Richard&#8217;s objections above, I&#8217;d add the following:</p>
<p>Trusting the wisdom of the crowd is inherently flawed because <a href="http://www.readwriteweb.com/archives/the_dirty_little_secret_about_the_wisdom_of_the_crowds.php" rel="nofollow">there is no crowd</a>.  As the linked article points out, most online participation is done by small groups of dedicated users.  Often these groups have biases and agendas.  If the quality of science is judged by readers giving a paper a ranking, then what&#8217;s to stop, as one example, a group of rabid creationists from marking down good evolution papers and repeatedly giving high rankings to creationist claptrap?  This would result in good science being underfunded and religion receiving lots fo grants.  The example cited in your blog entry here is telling as well&#8211;PLoS draws heavily on a readership that is very interested in science publishing and new models for information sharing.  Those interests may not be shared by the majority of scientists who spend less time reading PLoS journals, but you wouldn&#8217;t know that from looking at these metrics.</p>
<p>The other issue is the ease with which such rankings are gamed.  Everyone knows that online reviews are heavily infested with fake comments from <a href="http://www.ctv.ca/servlet/ArticleNews/story/CTVNews/1076990577460_35?hub=SciTech" rel="nofollow">authors on their own books</a> and business owners touting their own products.  If a scientist&#8217;s grant funding is going to be influenced by the rankings and download numbers of his papers, you can bet that he will make it his job to spend all available time downloading his own papers and giving them stellar reviews.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Richard Sever</title>
		<link>http://scholarlykitchen.sspnet.org/2009/09/22/plos-releases-article-level-usage-data/#comment-4761</link>
		<dc:creator><![CDATA[Richard Sever]]></dc:creator>
		<pubDate>Tue, 22 Sep 2009 12:56:50 +0000</pubDate>
		<guid isPermaLink="false">http://scholarlykitchen.sspnet.org/?p=6029#comment-4761</guid>
		<description><![CDATA[The danger of  ‘article usage’ stats is twofold: (1) they equate popularity with quality; and (2) by providing yet another metric for quick and easy assessment of academic output, they fuel rather than confront the real problem: the inappropriate use of such metrics.

Many academics lament the fact that search teams and administrators often don’t take the trouble to read articles when assessing (potential) faculty. Instead they simply look up the impact factors of the journals in which they publish. Deposing the Impact Factor tyrant and replacing it with another metric won’t necessarily make things any fairer.

Moreover, since ‘article usage’ is arguably even less comparable across academic disciplines, it could make the situation worse. If an oceanography paper and a molecular biology paper are both published in Science, one can at least make the reasonable assumption that they are both high-quality articles - on the basis of the company they keep in that particular journal. If both are published in PLoS ONE, and the molecular biology paper is downloaded ten times more frequently than the oceanography paper, does that mean it has more academic merit – or just that it’s a molecular biology paper?]]></description>
		<content:encoded><![CDATA[<p>The danger of  ‘article usage’ stats is twofold: (1) they equate popularity with quality; and (2) by providing yet another metric for quick and easy assessment of academic output, they fuel rather than confront the real problem: the inappropriate use of such metrics.</p>
<p>Many academics lament the fact that search teams and administrators often don’t take the trouble to read articles when assessing (potential) faculty. Instead they simply look up the impact factors of the journals in which they publish. Deposing the Impact Factor tyrant and replacing it with another metric won’t necessarily make things any fairer.</p>
<p>Moreover, since ‘article usage’ is arguably even less comparable across academic disciplines, it could make the situation worse. If an oceanography paper and a molecular biology paper are both published in Science, one can at least make the reasonable assumption that they are both high-quality articles &#8211; on the basis of the company they keep in that particular journal. If both are published in PLoS ONE, and the molecular biology paper is downloaded ten times more frequently than the oceanography paper, does that mean it has more academic merit – or just that it’s a molecular biology paper?</p>
]]></content:encoded>
	</item>
</channel>
</rss>

