走进平常分享 http://blog.sciencenet.cn/u/cosismine 40岁,追求卓越,却走进平常

博文

《Science》社论:当头棒喝科学计量学研究!

已有 4348 次阅读 2013-5-21 09:19 |个人分类:我美丽的秃瓢岁月|系统分类:科研笔记

科学计量学算老几?长期以来,当科学计量学者们妄自菲薄的时候,我这个研究科学计量学的,常常会想到这个问题:你算老几啊,有什么资格在科学研究面前指手画脚?你脑子里瞎胡想几个字母,组成一个式子,然后你就那里说这是科学计量学指标,这些指标高了,你就好,指标低了,你就不好!结果你发现你所谓的式子也前后矛盾,从逻辑上不能自洽......连自己想说明的问题都没有办法说明......科学计量学,你真不量力啊!

 

有些路,科学计量学走弯了,但并不是说科学就不该计量,科学计量学就不该发展,而是,科学计量学要摆好和科学的关系,科学是第一位的,科学计量学是对科学的计量,而不是脱离科学的发展,自己在那里自娱自乐,数着数字玩。那么,科学计量学应该好好看看科学里面有什么,而这些东西如何表现,科学计量学如何抓住科学里面的东西,有什么样的理论可以让我们抓住科学里面的东西,这些东西才是重要的,而其他的,从科学计量学出发来说科学什么样子,简直是无稽之谈!

 

Impact Factor Distortions

 

THIS EDITORIAL COINCIDES WITH THE RELEASE OF THE SAN FRANCISCO DECLARATION ON RESEARCH Assessment (DORA), the outcome of a gathering of concerned scientists at the December 2012 meeting of the American Society for Cell Biology.* To correct distortions in the evaluation of scientific research, DORA aims to stop the use of the “journal impact factor” in judging an individual scientist’s work. The Declaration states that the impact factor must not be used as “a surrogate measure of the quality of individual research articles, to assess an individual scientist’s contributions, or in hiring, promotion, or funding decisions.” DORA also provides a list of specific actions, targeted at improving the way scientific publications are assessed, to be taken by funding agencies, institutions, publishers, researchers, and the organizations that supply metrics. These recommendations have thus far been endorsed by more than 150 leading scientists and 75 scientific organizations, including the American Association for the Advancement of Science (the publisher of Science). Here are some reasons why:

 

The impact factor, a number calculated annually for each scientific journal based on the average number of times its articles have been referenced in other articles, was never intended to be used to evaluate individual scientists, but rather as a measure of journal quality. However, it has been increasingly misused in this way, with scientists now being ranked by weighting each of their publications according to the impact factor of the journal in which it appeared. For this reason, I have seen curricula vitae in which a scientist annotates each of his or her publications with its journal impact factor listed to three significant decimal places (for example, 11.345). And in some nations, publication in a journal with an impact factor below 5.0 is officially of zero value. As frequently pointed out by leading scientists, this impact factor mania makes no sense.

 

The misuse of the journal impact factor is highly destructive, inviting a gaming of the metric that can bias journals against publishing important papers in fields (such as social sciences and ecology) that are much less cited than others (such as biomedicine). And it wastes the time of scientists by overloading highly cited journals such as Science with inappropriate submissions from researchers who are desperate to gain points from their evaluators.

 

But perhaps the most destructive result of any automated scoring of a researcher’s quality is the “me-too science” that it encourages. Any evaluation system in which the mere number of a researcher’s publications increases his or her score creates a strong disincentive to pursue risky and potentially groundbreaking work, because it takes years to create a new approach in a new experimental context, during which no publications should be expected. Such metrics further block innovation because they encourage scientists to work in areas of science that are already highly populated, as it is only in these fields that large numbers of scientists can be expected to reference one’s work, no matter how outstanding. Thus, for example, in my own field of cell biology, new tools now allow powerful approaches to understanding how a large single-celled organism such as the cilate Stentor can precisely pattern its surface, creating organlike features that are presently associated only with multicellular organisms.§ The answers are likely to bring new insights into how all cells operate, including our own. But only the very bravest of young scientists can be expected to venture into such a poorly populated research area, unless automated numerical evaluations of individuals are eliminated.

 

The DORA recommendations are critical for keeping science healthy. As a bottom line, the leaders of the scientific enterprise must accept full responsibility for thoughtfully analyzing the scientific contributions of other researchers. To do so in a meaningful way requires the actual reading of a small selected set of each researcher’s publications, a task that must not be passed by default to journal editors.

 



https://blog.sciencenet.cn/blog-215715-691974.html

上一篇:给儿子改的作文,明天删除!
下一篇:“最后守望者”守望着什么
收藏 IP: 222.66.175.*| 热度|

9 曹聪 刘桂锋 李学宽 闵应骅 徐迎晓 孙军杰 杨正瓴 zzjtcm cly85

该博文允许注册用户评论 请点击登录 评论 (11 个评论)

数据加载中...
扫一扫,分享此博文

Archiver|手机版|科学网 ( 京ICP备07017567号-12 )

GMT+8, 2024-12-27 09:25

Powered by ScienceNet.cn

Copyright © 2007- 中国科学报社

返回顶部