<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Three myths about scientific peer review</title>
	<atom:link href="http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/feed/" rel="self" type="application/rss+xml" />
	<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/</link>
	<description></description>
	<lastBuildDate>Fri, 10 Feb 2012 10:56:26 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3</generator>
	<item>
		<title>By: Eugene Stefanovich</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-2/#comment-35796</link>
		<dc:creator>Eugene Stefanovich</dc:creator>
		<pubDate>Wed, 08 Feb 2012 20:04:08 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-35796</guid>
		<description>An India physicist Satyendra Bose&#039;s paper on particle statistics was rejected by all the leading journals.After initial setbacks to his efforts to publish, he sent the article directly to Albert Einstein in Germany. Einstein, recognizing the importance of the paper, translated it into German himself and submitted it on Bose&#039;s behalf to the Zeitschrift für Physik.That was the humble beginning of quantum statistics -Bose-Einstein statistics.</description>
		<content:encoded><![CDATA[<p>An India physicist Satyendra Bose&#8217;s paper on particle statistics was rejected by all the leading journals.After initial setbacks to his efforts to publish, he sent the article directly to Albert Einstein in Germany. Einstein, recognizing the importance of the paper, translated it into German himself and submitted it on Bose&#8217;s behalf to the Zeitschrift für Physik.That was the humble beginning of quantum statistics -Bose-Einstein statistics.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: &#8220;Research Works Act&#8221; to legally solidify the share of federal funding for the &#8216;scientific&#8217; contribution of publishing companies &#171; Biochemistry, Molecular, Cellular &#38; Developmental Biology</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-2/#comment-35539</link>
		<dc:creator>&#8220;Research Works Act&#8221; to legally solidify the share of federal funding for the &#8216;scientific&#8217; contribution of publishing companies &#171; Biochemistry, Molecular, Cellular &#38; Developmental Biology</dc:creator>
		<pubDate>Wed, 11 Jan 2012 06:13:04 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-35539</guid>
		<description>[...] blogs, including by Michael Nielsen, another advocate for Open Access, who wrote a piece debunking three myths about peer review. These myths are: 1) scientists have always used peer review. 2) peer review is reliable. and 3) [...]</description>
		<content:encoded><![CDATA[<p>[...] blogs, including by Michael Nielsen, another advocate for Open Access, who wrote a piece debunking three myths about peer review. These myths are: 1) scientists have always used peer review. 2) peer review is reliable. and 3) [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Irene Hames</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-2/#comment-35538</link>
		<dc:creator>Irene Hames</dc:creator>
		<pubDate>Tue, 10 Jan 2012 11:41:11 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-35538</guid>
		<description>Hello, just got to this interesting old post via a tweet from Jonathan Eisen @phylogenomics . Re

“Krebs’ work on the citric acid cycle, which led to a Nobel Prize, was rejected by Nature. It was published in Experientia.”

my understanding is that Krebs’ citric acid cycle paper wasn’t really rejected by Nature – rather the editor told him he had enough letters to fill the Nature correspondence columns for 7 or 8 weeks, if Krebs didn’t mind the delay he’d keep it “until the congestion is relieved in the hope of making use of it” but was returning it to Krebs “in case Mr. Krebs prefers to submit it for early publication to another periodical”, which Krebs then did.

The original 1937 letter from the editor is available at Nature’s timeline of the journal’s history, 1953 entry, &lt;a href=&quot;http://www.nature.com/nature/history/timeline_1950s.html&quot; rel=&quot;nofollow&quot;&gt;One that got away&lt;/a&gt;, along with a lovely (“tongue firmly in cheek” ) retort from Krebs 16 years later after he’d won the Nobel prize for the work.

Actual letters &lt;a href=&quot;http://www.nature.com/nature/history/pdf/krebs_letter.pdf&quot; rel=&quot;nofollow&quot;&gt;here&lt;/a&gt; .

Links in case html ones don&#039;t work (can&#039;t preview)
http://www.nature.com/nature/history/timeline_1950s.html 
 http://www.nature.com/nature/history/pdf/krebs_letter.pdf</description>
		<content:encoded><![CDATA[<p>Hello, just got to this interesting old post via a tweet from Jonathan Eisen @phylogenomics . Re</p>
<p>“Krebs’ work on the citric acid cycle, which led to a Nobel Prize, was rejected by Nature. It was published in Experientia.”</p>
<p>my understanding is that Krebs’ citric acid cycle paper wasn’t really rejected by Nature – rather the editor told him he had enough letters to fill the Nature correspondence columns for 7 or 8 weeks, if Krebs didn’t mind the delay he’d keep it “until the congestion is relieved in the hope of making use of it” but was returning it to Krebs “in case Mr. Krebs prefers to submit it for early publication to another periodical”, which Krebs then did.</p>
<p>The original 1937 letter from the editor is available at Nature’s timeline of the journal’s history, 1953 entry, <a href="http://www.nature.com/nature/history/timeline_1950s.html" rel="nofollow">One that got away</a>, along with a lovely (“tongue firmly in cheek” ) retort from Krebs 16 years later after he’d won the Nobel prize for the work.</p>
<p>Actual letters <a href="http://www.nature.com/nature/history/pdf/krebs_letter.pdf" rel="nofollow">here</a> .</p>
<p>Links in case html ones don&#8217;t work (can&#8217;t preview)<br />
<a href="http://www.nature.com/nature/history/timeline_1950s.html" rel="nofollow">http://www.nature.com/nature/history/timeline_1950s.html</a><br />
 <a href="http://www.nature.com/nature/history/pdf/krebs_letter.pdf" rel="nofollow">http://www.nature.com/nature/history/pdf/krebs_letter.pdf</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: &#8220;Why the world of scientific research needs to be disrupted&#8221; &#124; Quantum Mechanics Blog</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-2/#comment-33616</link>
		<dc:creator>&#8220;Why the world of scientific research needs to be disrupted&#8221; &#124; Quantum Mechanics Blog</dc:creator>
		<pubDate>Wed, 09 Nov 2011 01:18:39 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-33616</guid>
		<description>[...] Great article by Michael Nielsen, &quot;Three myths about scientific peer review&quot; [...]</description>
		<content:encoded><![CDATA[<p>[...] Great article by Michael Nielsen, &quot;Three myths about scientific peer review&quot; [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Aaron Holmgren</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-31274</link>
		<dc:creator>Aaron Holmgren</dc:creator>
		<pubDate>Tue, 18 Oct 2011 17:49:52 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-31274</guid>
		<description>Also. For the same reason it is valuable to go back and reevaluate the criticisms of historical scientific studies that were not accepted; it could be equally valuable to science to be able to go back and reevaluate the studies themselves. For instance; if a study could not be reproduced, this could due to a particular detail in that study that was overlooked by future studies. It then becomes highly valuable to reevaluate past studies in science, as much as it is valuable to reevaluate our basic assumptions in science.

The idea that we should &quot;purge&quot; scientific works from the body of our scientific knowledge, I find to be an idea which is offensive to the core values of science.</description>
		<content:encoded><![CDATA[<p>Also. For the same reason it is valuable to go back and reevaluate the criticisms of historical scientific studies that were not accepted; it could be equally valuable to science to be able to go back and reevaluate the studies themselves. For instance; if a study could not be reproduced, this could due to a particular detail in that study that was overlooked by future studies. It then becomes highly valuable to reevaluate past studies in science, as much as it is valuable to reevaluate our basic assumptions in science.</p>
<p>The idea that we should &#8220;purge&#8221; scientific works from the body of our scientific knowledge, I find to be an idea which is offensive to the core values of science.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Aaron Holmgren</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-31273</link>
		<dc:creator>Aaron Holmgren</dc:creator>
		<pubDate>Tue, 18 Oct 2011 17:41:33 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-31273</guid>
		<description>@Ulrich, thank you for your contribution, that is exactly the kind of journal I hoped to find. What I consider to be one of the most important attributes:

&quot;foster and provide a lasting record of scientific discussion;&quot;

I really don&#039;t believe it serves the interest of science to completely, flat-out reject a scientific study, or to retract a study, even if it is at the request of the original author. I like the idea of keeping anonymity for the sake of removing social pressure on the reviewer, but the criticisms of the study need to remain open and transparent so that the public can evaluate the review. Should we change our scientific assumptions further down the road, it would also be valuable to be able to go back to historical studies that were not well received and be able to say &quot;hey, wait a minute, that study was not accepted by the public for these concerns, which have now been debunked, so the study now holds more significance&quot;.

Ultimately, it is the entire body of science that establishes our opinion of what studies most likely reflect reality; and this is the only truly reliable way to limit human bias. Consider this: the fundamental scientific principle of reproducibility  is so cherished because we have acknowledge the danger of human bias; and that it can only be reliably removed through such a principle. Well... non-transparent, peer review undermines this tenant by refusing to allow certain studies to stand up to the fundamental, unbiased test of reproducibility. You are essentially trading a biased process for a fundamental scientific principle.</description>
		<content:encoded><![CDATA[<p>@Ulrich, thank you for your contribution, that is exactly the kind of journal I hoped to find. What I consider to be one of the most important attributes:</p>
<p>&#8220;foster and provide a lasting record of scientific discussion;&#8221;</p>
<p>I really don&#8217;t believe it serves the interest of science to completely, flat-out reject a scientific study, or to retract a study, even if it is at the request of the original author. I like the idea of keeping anonymity for the sake of removing social pressure on the reviewer, but the criticisms of the study need to remain open and transparent so that the public can evaluate the review. Should we change our scientific assumptions further down the road, it would also be valuable to be able to go back to historical studies that were not well received and be able to say &#8220;hey, wait a minute, that study was not accepted by the public for these concerns, which have now been debunked, so the study now holds more significance&#8221;.</p>
<p>Ultimately, it is the entire body of science that establishes our opinion of what studies most likely reflect reality; and this is the only truly reliable way to limit human bias. Consider this: the fundamental scientific principle of reproducibility  is so cherished because we have acknowledge the danger of human bias; and that it can only be reliably removed through such a principle. Well&#8230; non-transparent, peer review undermines this tenant by refusing to allow certain studies to stand up to the fundamental, unbiased test of reproducibility. You are essentially trading a biased process for a fundamental scientific principle.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: The perils of filter-then-publish</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-30646</link>
		<dc:creator>The perils of filter-then-publish</dc:creator>
		<pubDate>Thu, 19 May 2011 03:07:09 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-30646</guid>
		<description>[...] We sacrifice scholarship for vanity.Further reading: Become independent of peer review and Three myths about scientific peer review.Source: This post was inspired by a comment made by Sylvain Hallé.   Comments (0)No Comments [...]</description>
		<content:encoded><![CDATA[<p>[...] We sacrifice scholarship for vanity.Further reading: Become independent of peer review and Three myths about scientific peer review.Source: This post was inspired by a comment made by Sylvain Hallé.   Comments (0)No Comments [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Know the biases of your operating system</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-30455</link>
		<dc:creator>Know the biases of your operating system</dc:creator>
		<pubDate>Thu, 24 Mar 2011 02:21:30 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-30455</guid>
		<description>[...] work is valid or not. By convention, any work which did not undergo this process is suspect. In Three myths about peer review, Michael Nielsen reminded us that traditional peer review is not a long tradition, and is not how [...]</description>
		<content:encoded><![CDATA[<p>[...] work is valid or not. By convention, any work which did not undergo this process is suspect. In Three myths about peer review, Michael Nielsen reminded us that traditional peer review is not a long tradition, and is not how [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ulrich Pöschl</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-27113</link>
		<dc:creator>Ulrich Pöschl</dc:creator>
		<pubDate>Sat, 27 Nov 2010 19:36:23 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-27113</guid>
		<description>Dear All:

A colleague  has drawn my attention to this discussion, and I would like to draw your attention to advanced forms of peer review that resolve most of the concerns and issues raised above.

Since 2001 the interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmospheric-chemistry-and-physics.net) and over a dozen of sister journals published by the European Geosciences Union (EGU, www.egu.eu) demonstrate how the efficiency of scientific communication and quality assurance can be enhanced by a two-stage process of publication with public peer review with interactive discussion. 

These interactive open access journals are by most if not all standards and statistical indicators more successful than comparable traditional journals, and the same or similar concepts of public peer review and discussion have recently also been adopted in other scientific disciplines (economics, life sciences, etc.). For more information see the web pages and references listed below.

With best regards,
Uli Pöschl

http://www.atmospheric-chemistry-and-physics.net/index.html

http://www.atmospheric-chemistry-and-physics.net/general_information/public_relations.html

http://www.atmospheric-chemistry-and-physics.net/pr_acp_poschl_liber_quarterly_2010_interactive_open_access_publishing.pdf</description>
		<content:encoded><![CDATA[<p>Dear All:</p>
<p>A colleague  has drawn my attention to this discussion, and I would like to draw your attention to advanced forms of peer review that resolve most of the concerns and issues raised above.</p>
<p>Since 2001 the interactive open access journal Atmospheric Chemistry and Physics (ACP, <a href="http://www.atmospheric-chemistry-and-physics.net" rel="nofollow">http://www.atmospheric-chemistry-and-physics.net</a>) and over a dozen of sister journals published by the European Geosciences Union (EGU, <a href="http://www.egu.eu" rel="nofollow">http://www.egu.eu</a>) demonstrate how the efficiency of scientific communication and quality assurance can be enhanced by a two-stage process of publication with public peer review with interactive discussion. </p>
<p>These interactive open access journals are by most if not all standards and statistical indicators more successful than comparable traditional journals, and the same or similar concepts of public peer review and discussion have recently also been adopted in other scientific disciplines (economics, life sciences, etc.). For more information see the web pages and references listed below.</p>
<p>With best regards,<br />
Uli Pöschl</p>
<p><a href="http://www.atmospheric-chemistry-and-physics.net/index.html" rel="nofollow">http://www.atmospheric-chemistry-and-physics.net/index.html</a></p>
<p><a href="http://www.atmospheric-chemistry-and-physics.net/general_information/public_relations.html" rel="nofollow">http://www.atmospheric-chemistry-and-physics.net/general_information/public_relations.html</a></p>
<p><a href="http://www.atmospheric-chemistry-and-physics.net/pr_acp_poschl_liber_quarterly_2010_interactive_open_access_publishing.pdf" rel="nofollow">http://www.atmospheric-chemistry-and-physics.net/pr_acp_poschl_liber_quarterly_2010_interactive_open_access_publishing.pdf</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Pavol</title>
		<link>http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/comment-page-1/#comment-27105</link>
		<dc:creator>Pavol</dc:creator>
		<pubDate>Sat, 13 Nov 2010 23:39:29 +0000</pubDate>
		<guid isPermaLink="false">http://michaelnielsen.org/blog/?p=531#comment-27105</guid>
		<description>Sorry for this to come so late after the discussion start, but a few remarks dropped in this debate need to be rectified no matter how late it happens, because otherwise they risk to cement wrong reasoning for a long time. With this I mean John Sidles&#039; statement in his very 1st comment on Jan 8, 2009, namely &quot;... by and large peer review works amazingly well … in part because there is no review so bad, that it can’t be used to help make an article better. This evolutionary process (although painful) causes better articles to emerge even from bad reviews. &quot;
With due respect, this argument reminds me of some of those Western leftwingers&#039; belated attempts to find something positive in the Soviet communism regimes that collapsed in the late 1980ies. I still remember them acknowledging reluctantly that the recently failed system with which they had preached appeasement was utterly unbearable for the people subject to it. Still, in the last attempt to justify the alliance with a wrong faith, they added: &quot;But at least you had free healthcare!&quot; (never mind it neither cared nor cured).
I can see here a lot of similarity with John Sidles&#039; words, trying to defend the undefendable. Please, scientific papers are not written to be literary masterpieces! And looking at the ACCEPTED papers one sees immediately that literary masterpieces do not emerge that way, no matter how obediently the authors had to honor referees&#039; suggestions. Papers are supposed to disseminate knowledge and innovation as quickly and efficiently as possible, period. Occasionlally, dumb and inane referee comments help the author find better words to eliminate one - surely not every - source of misunderstanding, but there are much better (quicker, more thorough) ways to achieve the same. Think of presentations at seminars and conferences. This is quick and reliable! On the contrary, a couple of years trying to please an anonymous &quot;peer&quot; who does not have to be a peer at all, and the whole work one did can turn out useless while coming too late to make a difference.
Let us not fool ourselves: what really decides about a paper&#039;s destiny is not a referee report but the editor&#039;s preference</description>
		<content:encoded><![CDATA[<p>Sorry for this to come so late after the discussion start, but a few remarks dropped in this debate need to be rectified no matter how late it happens, because otherwise they risk to cement wrong reasoning for a long time. With this I mean John Sidles&#8217; statement in his very 1st comment on Jan 8, 2009, namely &#8220;&#8230; by and large peer review works amazingly well … in part because there is no review so bad, that it can’t be used to help make an article better. This evolutionary process (although painful) causes better articles to emerge even from bad reviews. &#8221;<br />
With due respect, this argument reminds me of some of those Western leftwingers&#8217; belated attempts to find something positive in the Soviet communism regimes that collapsed in the late 1980ies. I still remember them acknowledging reluctantly that the recently failed system with which they had preached appeasement was utterly unbearable for the people subject to it. Still, in the last attempt to justify the alliance with a wrong faith, they added: &#8220;But at least you had free healthcare!&#8221; (never mind it neither cared nor cured).<br />
I can see here a lot of similarity with John Sidles&#8217; words, trying to defend the undefendable. Please, scientific papers are not written to be literary masterpieces! And looking at the ACCEPTED papers one sees immediately that literary masterpieces do not emerge that way, no matter how obediently the authors had to honor referees&#8217; suggestions. Papers are supposed to disseminate knowledge and innovation as quickly and efficiently as possible, period. Occasionlally, dumb and inane referee comments help the author find better words to eliminate one &#8211; surely not every &#8211; source of misunderstanding, but there are much better (quicker, more thorough) ways to achieve the same. Think of presentations at seminars and conferences. This is quick and reliable! On the contrary, a couple of years trying to please an anonymous &#8220;peer&#8221; who does not have to be a peer at all, and the whole work one did can turn out useless while coming too late to make a difference.<br />
Let us not fool ourselves: what really decides about a paper&#8217;s destiny is not a referee report but the editor&#8217;s preference</p>
]]></content:encoded>
	</item>
</channel>
</rss>

