博文

[转载]一些有关同行评审的段子

已有 731 次阅读 2024-1-29 08:28 |个人分类:微波吸收|系统分类:观点评述|文章来源:转载

[Ref. 1] “Can so many scientists have been wrong over the eighty years since 1925? Unhappily, yes. The mainstream in science, as any scientist will tell you, is often wrong. Otherwise, come to think of it, science would be complete. Few scientists would make that claim, or would want to. Statistical significance is surely not the only error in modern science, although it has been, as we will show, an exceptionally damaging one. Scientists are often tardy in fixing basic flaws in their sciences despite the presence of better alternatives. Think of the half century it took American geologists to recognize the truth of drifting continents, a theory proposed in 1915 by—of all eminently ignorable people—a German meteorologist. Scientists, after all, are human. What Nietzsche called the ‘twilight of the idols,’ the fear of losing a powerful symbol or god or technology, haunts us all”

Ziliak, S. T. and McCloskey, D. N. (2008). The cult of statistical significance: how the standard error costs us jobs, justice, and lives. University of Michigan Press

[Ref. 2] Nobel laureate Tasuku Honjo: “First-class work often overturns the established conclusion, so it is unpopular. The reviewers cannot fully understand your work and will give you many negative comments, …. Articles catering to the trend of the times are easy to be accepted, otherwise, it will take a long time to get recognized” (2000) and “If your research can’t overturn the established conclusion, science can’t progress. Of course, your research will be not recorded in history. The academic world is conservative. If you don’t write your paper according to the existing conclusion, it will be very difficult for your paper to be accepted, and you will suffer a lot, but the research that can survive in history is exactly this kind of research.“ (2013)

https://dataverse.harvard.edu/dataverse/BaFe12-iCeiO19-PPy

https://zhuanlan.zhihu.com/p/389134254

[Ref. 3] “A new scientific truth does not triumph by convincing its opponents and making them see the light, but rather because its opponents eventually die, and a new generation grows up that is familiar with it”

M. Planck, Scientific Autobiography and Other Paper, William & Norgate, London, 1950, pp. 33 -34.https://zhuanlan.zhihu.com/p/407998797

https://zhuanlan.zhihu.com/p/363487648

[Ref. 4] “some scientists wondered how a questionable line of research persisted for so long … experts were just too timid to take a stand.”

Harvard calls for retraction of dozens of studies by noted cardiologist, New York Times, http://www.staradvertiser.com/2018/10/16/news/harvard-calls-for-retraction-of-dozens-of-studies-by-noted-cardiologist/.

16 Oct 2018

[Ref. 5] S. Vazire, A toast to the error detectors, Nature 577(7788) (2020) 9. https://doi.org/10.1038/d41586-019-03909-2

[Ref. 6] “Poster 1: Charles Townes and the Laser [After] we had been at it for two years, Rabi and Kusch, the former and current chairman of the department — both of them Nobel laureates for work with atomic and molecular beams, and both with a lot of weight behind their opinions — came into my office and sat down. They were worried. Their research depended on support from the same source as did mine. ‘Look,’ they said, ‘you should stop the work you are doing. It isn‘t going to work. You know it‘s not going to work. We know it‘s not going to work. You‘re wasting money. Just stop!’ But Townes had come to Columbia on tenure, so he knew he couldn’t be fired for incompetence or ordered around. Nevertheless, the awesome weight of Rabi‘s reputation in particular — a one-time senior member of the Massachusetts Institute of Technology‘s legendary Radiation Laboratory set up by Vannevar Bush to develop wartime radar — must have been daunting. Such top brass cannot be defied lightly, and showing extraordinary courage, this junior faculty member stood his ground, and respectfully told his exalted colleagues that he would continue. Two months later (in April 1954), his experiment worked, and the maser (microwave amplification by stimulated emission of radiation) was born. Three years after that Arthur Schawlow, Townes‘ postdoc at Columbia, had moved to the Bell Laboratories, and their collaboration led to the optical version of the maser — the laser. Townes was awarded the Nobel Prize in Physics in 1964 for these discoveries [shared with Aleksander Prokhorov and Nikolai Basov (USSR), who developed the maser and laser independently]. Schawlow was awarded the Nobel Prize for Physics in 1981 for his work on laser spectroscopy.”

Donald W. Braben – Scientific Freedom – The Elixir of Civilization, Wiley Interscience (2008)

[Ref. 7] “So we have little evidence on the effectiveness of peer review, but we have considerable evidence on its defects. In addition to being poor at detecting gross defects and almost useless for detecting fraud it is slow, expensive, profligate of academic time, highly subjective, something of a lottery, prone to bias, and easily abused.”https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1420798

Peer review: a flawed process at the heart of science and journals

[Ref. 8] “Now pretty much every journal uses outside experts to vet papers, and papers that don‘t please reviewers get rejected … Weak-link thinking makes scientific censorship seem reasonable, but all censorship does is make old ideas harder to defeat. Remember that it used to be obviously true that the Earth is the center of the universe, and if scientific journals had existed in Copernicus‘ time, geocentrist reviewers would have rejected his paper and patted themselves on the back for preventing the spread of misinformation. Eugenics used to be hot stuff in science—do you think a bunch of racists would give the green light to a paper showing that Black people are just as smart as white people? Or any paper at all by a Black author? (And if you think that‘s ancient history: this dynamic is still playing out today.) We still don‘t understand basic truths about the universe, and many ideas we believe today will one day be debunked. Peer review, like every form of censorship, merely slows down truth.”https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review

The rise and fall of peer review

[Ref. 9] “Professor Braben argues that the introduction in the 1970s of the (peer) review of research proposals has led to a dearth of big scientific discoveries. The most radical ideas, he says, are unlikely to get funded because it is difficult to impress peers before they have been proven. … It (peer review) works well enough in the mainstream but it is at the margins where major discoveries are made, where people don’t believe in the current wisdom and want to head off into dramatically different directions. To submit those ideas to peer review is disastrous” https://www.timeshighereducation.com/news/kill-peer-review-save-civilisation/401457.article?storyCode=401457&site=cn

Kill peer review, save civilization

[Ref. 10] “On the off chance you do figure out a way to improve peer review without also making it worse, you can try convincing the nearly 30,000 scientific journals in existence to apply your magical method to the ~4.7 million articles they publish every year. Good luck!”https://www.experimental-history.com/p/the-rise-and-fall-of-peer-review

The rise and fall of peer review

[Ref. 11] “We thus planned to make posting peer review documents the next stage in opening up our peer review process, … The final step was, in my mind, to open up the whole process and conduct it in real time on the web in front of the eyes of anybody interested. Peer review would then be transformed from a black box into an open scientific discourse. Often I found the discourse around a study was a lot more interesting than the study itself.”https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1420798

J R Soc Med. 2006 Apr; 99(4): 178–182. doi: 10.1258/jrsm.99.4.178 Peer review: a flawed process at the heart of science and journals

[Ref. 12] “Beyond these considerations, the importance of many of the more recent developments cannot be evaluated objectively at this time. The history of mathematics teaches us that many subjects which aroused tremendous enthusiasm and engaged the attention of the best mathematicians ultimately faded into oblivion ... Indeed one of the interesting questions that the history answers is what survives in mathematics. History makes its own and sounder evaluations.”

--Morris Kline, Mathematical Thought from Ancient to Modern Times, Oxford University Press, 1972, ISBN 0-19-506136-5 引申：历史是最公正的。历史反复证明，那些在当世喧嚣尘上的东西往往是主流学者刻意炒作的糟粕，而那些被当世打压的经常是真金白银。 Expansion: History serves as the ultimate arbiter. It consistently reveals that what is often overemphasized by the prominent scholars of an era is often merely the intentional promotion of mediocrity, while that which is suppressed by the prevailing contemporary scholars often reveals itself to be authentic and of true value.

[Ref. 13] 梳理这段历史，会发现这些重大原始创新在刚面世时都遭到了业界的质疑和抵制，差点夭折。这不是个例，浮栅晶体管、异质结、绝缘栅双极型晶体管（IGBT）、微机电系统（MEMS）、浸没式光刻等重大发明都遭到过抵制。为什么这些发明一开始都不受待见呢？芯片的发展离不开持续的创新和超越，然而创新越大，对传统的叛逆和颠覆也越大，因而遭到传统势力的抵制就越大。

中国科学报，2023-09-16 第3版读书

When delving into this historical period, it becomes apparent that these groundbreaking original innovations faced skepticism and opposition within the industry upon their initial emergence, nearly teetering on the brink of extinction. This phenomenon is not an isolated occurrence; major breakthroughs like floating-gate transistors, heterojunctions, insulated gate bipolar transistors (IGBTs), microelectromechanical systems (MEMS), immersion lithography, and others have also confronted resistance. What prompted this initial lack of acceptance for these inventions? The advancement of semiconductor technology hinges on ongoing innovation and breakthroughs. However, the greater the innovation, the more it challenges and disrupts established norms, resulting in heightened resistance from traditional forces. Published in China Science Daily, September 16, 2023, 3rd Edition, Book Review.https://news.sciencenet.cn/dz/dzzz_1.aspx?dzsbqkid=39253 https://news.sciencenet.cn/dz/upload/2023/9/20239156508226.pdf

学术圈某种意义上像是个派系林立的“江湖”，学术权威如同“教主”一样，普通学者没有力量反抗其观点。随着发表的错误论文越来越多，跟风研究的越来越多，大家都成了既得利益者，就默许了这些错误的观点继续流传下去。 ———— 科技日报，2018-10-18 第01版：今日要闻，骗了全世界十余年干细胞“学术大牛”走下神坛https://baijiahao.baidu.com/s?id=1614619477235832974&wfr=spider&for=pc
https://baijiahao.baidu.com/s?id=1614619476870888302
https://www.rmzxb.com.cn/c/2018-10-18/2193148.shtml

In a certain sense, the academic community resembles a faction-ridden "martial arts world," where academic authorities wield power akin to "sect leaders," and ordinary scholars lack the strength to challenge their viewpoints. As the number of erroneous papers being published increases and more researchers follow the trend, everyone becomes a beneficiary, tacitly allowing these incorrect viewpoints to continue propagating.
— Science and Technology Daily, 2018-10-18, Page 01: Today's Headlines, Deception Spanning Over a Decade: Academic "Masters" in the Field of Stem Cells Fall from Grace

参考资料

Yue Liu – Kudos: Growing the influence of research (growkudos.com)

http://finance.sina.com.cn/hy/20131119/105717365753.shtml

http://finance.sina.com.cn/hy/20131119/105717365756.shtml

张维迎：创新就是大部分人都不认同的想法https://www.wenmi.com/article/puj98i03nn9k.html

多数人认同的不叫创新https://www.yicai.com/news/5345088.html

许小年：创新没有风口，凡是追逐风口的行为都不是创新https://www.sass.org.cn/_s3/_t31/2008/1229/c1201a26145/page.psp

但“创新”意味着与众不同，公认的东西往往是常识https://news.ifeng.com/c/7fcJvZmKtue

学术评价与学术程序的质量都取决于学术共同体的质量颠覆传统理论的创新会在高引论文中产生吗？有那么高共识的论文能是颠覆性创新吗？https://mp.weixin.qq.com/s/AyrjTS71DImtO3HQy-irfw

受不了了！在论文修改了5次之后，作者终于“怒怼”了审稿人！没想到这篇回复竟发了SCIhttps://zhidao.baidu.com/question/1438671826557224739.html

https://baijiahao.baidu.com/s?id=1669193669905192103&wfr=spider&for=pc

https://baijiahao.baidu.com/s?id=1730445894371096545&wfr=spider&for=pc