DP7887 Average-based versus High- and Low-Impact Indicators for the Evaluation of Scientific Distributions

Author(s): Pedro Albarrán, Ignacio Ortuño-Ortín, Javier Ruiz-Castillo
Publication Date: June 2010
Keyword(s): citation distributions, measuring scientific performance
JEL(s): I23, I32
Programme Areas: Industrial Organization
Link to this Page: cepr.org/active/publications/discussion_papers/dp.php?dpno=7887

Albarrán et al. (2009a ) introduced a novel methodology for the evaluation of citation distributions consisting of a pair of high- and a low-impact measures defined over the set of articles with citations below or above a critical citation level CCL. Albarrán et al. (2009b ) presented the first empirical applications to a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union, and the rest of the world. In this paper, we compare our results with those obtained with average-based indicators. For reasonable CCLs, such as the 80th percentile of the world citation distribution in each field, the cardinal differences between the results obtained with our high-impact index and the mean citation rate are of a large order of magnitude. When, in addition, the percentage in the top 5% of most cited articles or the percentage of uncited articles are used, there are still important quantitative differences with respect to the high- and low-impact indicators advocated in our approach when the CCL is fixed at the 80th or the 95th percentile.