“We are scaling the mountain of metrics, only to realize we have lost sight of the horizon of discovery.”

– Contemporary academic aphorism

The landscape of contemporary scientific evaluation has undergone a profound transformation, evolving from a qualitative realm of peer appreciation into a highly quantified, algorithmic matrix. Today, the career trajectories of researchers, the allocation of institutional funding, and the perceived prestige of scientific output are inextricably bound to quantitative indicators. As an international community, we must critically evaluate whether this pervasive reliance on bibliometric indices represents a triumphant meritocratic journey – the metaphorical climb of a lifetime, where each peer-reviewed publication marks a grueling step toward the academic summit – or whether it has devolved into the Caudine Forks, forcing researchers to pass through a humiliating, bureaucratic yoke that deforms the very nature of scientific inquiry. From one perspective, the rise of bibliometrics has been heralded as a major democratic advancement, mapping the steep terrain of a lifelong academic ascent by replacing subjective favoritism with objective criteria. To navigate this terrain, the scientific community developed specific indicators, each designed to capture a different dimension of impact.

The Journal Impact Factor (JIF), originally conceived by Eugene Garfield in the mid-twentieth century, emerged as the foundational metric for measuring journal prestige¹. Calculated annually by Clarivate Analytics within the Journal Citation Reports, the JIF for a specific year X is mathematically defined as the ratio between the citations received in that year by items published in the two preceding years, and the total number of citable items published during those same 2 years:

The primary strength of this formula lies in its ability to evaluate the average citation momentum of a journal over a tight, 2-year window, offering a historical benchmark that institutions have trusted for decades. However, its major weakness is that it measures the vehicle, not the passenger; a high JIF does not guarantee the quality of an individual paper. Furthermore, while the numerator encompasses citations to any document type, the denominator is strictly restricted to substantive research contributions, specifically original research articles and review papers, leaving the index vulnerable to artificial inflation through uncounted editorial front matter.

To address these structural imbalances, Elsevier’s Scopus introduced CiteScore, a metric that expands the evaluation window and applies a transparent, fully inclusive accounting policy². The mathematical formula for calculating the CiteScore for a specific year X utilizes a 4-year rolling window and is expressed as follows:

This equation introduces critical methodological deviations from traditional JIF. By extending the temporal window to 4 years and including the current year of calculation, CiteScore reduces the volatility of short-term citation spikes and offers a stabilized reflection of a journal’s citation longevity. Crucially, its denominator enforces a strict “no-exemptions” policy, incorporating every single published document type, including editorials, letters, notes, and conference papers, thereby preventing journals from manipulating their scores through selective front-matter publication.

While CiteScore offers a more transparent and comprehensive overview, its all-inclusive nature is occasionally criticized by traditionalists for lacking the strict selectivity associated with highly curated databases. A direct comparative evaluation of these two indicators reveals a fundamental philosophical and operational divide in journal matrix tracking. While the JIF prioritizes immediate citation velocity, acting as an acute indicator of short-term scientific interest, CiteScore captures long-term citation persistence, which is particularly beneficial for disciplines characterized by slower citation half-lives. Furthermore, their contrasting mathematical treatments of the denominator radically alter editorial behavior. Under the JIF framework, editors are structurally incentivized to publish high volumes of uncounted “front matter”, such as extensive editorials or letters to the editor, that actively cite the journal’s own research papers, thereby artificially inflating the numerator without penalizing the denominator. CiteScore completely neutralizes this loophole through its “no-exemptions” policy; because every written item counts toward the denominator, any expansion of front matter automatically dilutes the overall score unless those items receive a proportionally high volume of external citations. Consequently, the JIF rewards selective, high-velocity publishing models, whereas CiteScore provides a more egalitarian, transparent, and structurally stable representation of a journal’s total editorial output across a broader multidisciplinary indexing database².

On an individual level, the h-index, introduced by Jorge Hirsch, revolutionized author evaluation by mathematically fusing productivity and citation impact into a single, elegant number³. Formally, a researcher has an index h if h of their total N_p papers received at least h citations each, while the remaining N_p – h papers have received fewer than h citations each. Mathematically, if an author’s publications are ranked in descending order based on their citation counts (C_i), the h-index is defined as:

The undeniable strength of this formulation is its absolute robustness against both the “one-hit wonder” phenomenon and the inflation of unreferenced volume; it ensures that an investigator cannot achieve elite status based on a single highly cited paper or through sheer, low-quality prolificacy. Nevertheless, its structural weaknesses are profound: it fails to account for the career stage of the researcher, as it can only increase over time, inherently penalizing early-career investigators. Furthermore, it completely ignores author placement, rewarding a middle co-author on a massive multicenter trial equally to a first or corresponding author who drove the entire project³.

To resolve these cross-disciplinary and career-stage discrepancies, modern bibliometrists rely on advanced normalized indices, such as Elsevier’s Field-Weighted Citation Impact (FWCI) and Clarivate’s Category Normalized Citation Impact (CNCI)^4,5. For a specific publication k, the normalized citation impact is mathematically formulated as the ratio of the actual number of citations received by that paper (c_k) to the expected baseline average number of citations (e_k) received by all global publications of the same document type, published in the same year, and indexed within the same subject category or discipline:

When evaluating an entire publication portfolio of an author consisting of N papers, the FWCI or CNCI represents the mean of these individual ratios. For a structural portfolio where the global baseline expectations vary across multiple co-existing disciplines, the institutional definition is formulated as:

A resulting value of exactly 1.0 indicates that the researcher’s output matches the global average. Values greater than 1.0 (e.g., 1.45) signify that the portfolio’s impact is 45% higher than the global baseline for that exact field and year.

The undeniable strength of these normalized metrics is their mathematical ability to eliminate discipline-specific structural biases, allowing an equitable comparison between researchers across completely distinct clinical fields; their weakness, however, rests in their statistical complexity, making them less intuitive and harder to implement for traditional university tenure committees. To appreciate the necessity of these normalized parameters, one must contrast them directly with raw, unnormalized measurements like a foundational Citation Index – originally engineered by Eugene Garfield to capture absolute citation frequencies. Garfield’s core Citation Index tabulates absolute counts without mathematical filtering, meaning every single reference carries equal weight regardless of structural context. Consequently, a traditional Citation Index functions as a raw, field-dependent accumulation ledger, making it highly sensitive to the massive volume variations inherent to different scientific cultures. In contrast, modern normalized metrics, such as the FWCI and CNCI, decouple citation performance from disciplinary boundaries. The mathematical architecture of both FWCI and CNCI dynamically establishes a shifting expected baseline average based on publication year, document type, and subject classification. While a paper with ten citations in molecular biology might look identically positioned to a paper with 10 citations in the humanities within a standard Citation Index, the normalized framework immediately exposes the hidden truth: the former sits well below its field’s expected average, while the latter dramatically outperforms its disciplinary baseline. By computing these contextual ratios, FWCI and CNCI transform raw data into equitable cross-disciplinary impact vectors, although they sacrifice the immediate, transparent arithmetic simplicity of Garfield’s classical model.

When these measures are used uncritically, a darker pathophysiological process initiates within the academic body corporate, exposing the severe structural damage caused by a “publish or perish” culture. The modern researcher, midway through this lifelong ascent, is increasingly forced to pass under the Caudine Forks of algorithmic dictatorship, where these indices are manipulated through self-citation loops, reciprocal citation cartels, and the artificial slicing of robust studies into multiple minimum publishable units.

In this landscape of perpetual quantitative pursuit, the doors to a dangerous academic trap have swung wide open: the phenomenon of predatory publishing. Where traditional channels impose biblical review times and staggering rejection rates, these predatory outlets offer an illusory escape route. Behind the promise of rapid, effortless publication lies a purely lucrative business, devoid of any genuine peer review. For the desperate researcher, crushed by the mandate to inflate their H-index, predatory publishing becomes a modern siren song, corrupting the foundational principles of the open access movement⁶. To navigate these murky waters, the scientific community long sought a guiding light. The most famous attempt was Beall’s List, the pioneering catalog curated by librarian Jeffrey Beall to unmask deceptive publishers⁷. However, the fate of that list underscores the complexity of the crisis: shuttered in 2017 under the weight of intense legal pressure and controversy, its disappearance left a void that contemporary databases (such as Cabells) and institutional whitelists struggle to fill, forcing researchers to rely on archived open-source versions of the directory⁸. Consequently, for the modern researcher stripped of a universal compass, vigilance becomes yet another bureaucratic burden. The risk is dramatic: paying to step into an ambush that not only generates zero scientific value but leaves an indelible stain on one’s professional reputation, turning the long-sought lifelong ascent into academic suicide.

This systemic tension necessitates a definitive paradigm shift. Scientific publishing must transcend the reductionist view of treating papers as mere currency to inflate an individual’s metrics. We must actively support international frameworks and active projects that champion responsible research assessment. Chief among these is the San Francisco Declaration on Research Assessment (DORA), which explicitly denounces the misuse of journal-based metrics as a surrogate for individual paper quality^9,10.

Furthermore, this vision is systematically operationalized by the Coalition for Advancing Research Assessment (CoARA). Rather than offering mere abstract declarations, CoARA binds its signatories to ten core commitments designed to establish a systemic overhaul of evaluation practices¹¹. Central to this framework is the mandate to recognize the diverse outputs, practices, and activities that maximize research quality, moving academic validation far beyond traditional journal articles. Signatories explicitly pledge to base research assessment primarily on qualitative judgment, reinstating peer review as the bedrock of evaluation while ensuring that quantitative indicators play a strictly supportive, responsible role. Crucially, the agreement demands that institutions abandon the inappropriate uses of journal- and publication-based metrics – specifically targeting the inappropriate application of the JIF and h-index as shorthand markers for individual quality. It also requires organizations to avoid using rankings of research organizations as a primary metric in the evaluation of individual researchers. To bridge the gap between policy and practice, CoARA enforces tangible operational accountability. Every member organization is required to commit resources to advance assessment reform, share lessons learned through an international network of knowledge exchange, and submit a comprehensive Action Plan within one year of signing the agreement. By participating in specialized Working Groups and National Chapters, institutions actively test and pilot new, inclusive assessment tools. Editorial boards, funding bodies, and university committees must lead this transition, shifting the evaluative framework away from a reactive compliance with algorithmic metrics toward a proactive defense of scientific integrity, ensuring that research evaluation serves as a strategic cornerstone for progress, transforming the modern researcher’s path back into a noble, rewarding, and lifelong ascent.

Conflict of Interest

The author declares no conflict of interest.

Ethics Approval and Informed Consent

Not required due to the nature of the article.

ORCID ID

Andrea Pession: 0000-0002-0379-9562

References

1. Garfield E. Citation indexes for science: A new dimension in documentation through association of ideas. Science 1955; 122: 108-111.
2. James C, Colledge L, Meester W, Azoulay N, Plume A. CiteScore metrics: Creating journal metrics from the Scopus citation index. Learned Publishing 2019; 32: 367-374.
3. Hirsch JE. An index to quantify an individual’s scientific research output. Proc Natl Acad Sci USA 2005; 102: 16569-16572.
4. Elsevier. Research Metrics Guidebook: Field-Weighted Citation Impact (FWCI) [Internet]. Amsterdam: Elsevier; 2022. Available at: https://supportcontent.elsevier.com/RightNow%20Next%20Gen/SciVal/ACAD_RL_ElsevierResearchMetricsBook_WEB.pdf (accessed 2 June 2026).
5. Clarivate. InCites Benchmarking & Analytics Help: Category Normalized Citation Impact (CNCI) [Internet]. Philadelphia: Clarivate; 2025. Available at:  https://incites.zendesk.com/hc/en-gb/articles/25087312115601-Category-Normalized-Citation-Impact-CNCI (accessed 2 June 2026).
6. Beall J. Predatory publishers are corrupting open access. Nature 2012; 489: 179.
7. Beall J. What I learned from predatory publishers. Biochem Med (Zagreb) 2017; 27: 273-279.
8. Beall’s List of Potential Predatory Journals and Publishers [Internet]. [Post-2017/Archived version]. Available at: https://beallslist.net/ (accessed 2 June 2026).
9. San Francisco Declaration on Research Assessment (DORA). San Francisco, CA: DORA; 2013. Available at:  https://sfdora.org (accessed 2 June 2026).
10. Cagan R. San Francisco Declaration on Research Assessment. Dis Models Mech 2013; 6: 869-870.
11. Coalition for Advancing Research Assessment (CoARA). Agreement on Reforming Research Assessment. Brussels: CoARA; 2022. Available at: https://coara.eu (accessed 1 June 2026).