Editor’s Note: Today’s post is by Yehonatan Banino, a research analyst and a member of the YCR-index project, a non-profit open-science initiative. Reviewer credit to Chef Haseeb Irfanullah.
The Prestige Paradox
Does a high citation count truly signal a groundbreaking discovery, or does it simply reflect the prestige of the journal that published it? In an era where “publish or perish” is the rule, we’ve fallen into a dangerous trap: using journal reputation as a proxy for research quality. We assume that a paper in a top-tier journal is inherently more valuable than one published in a niche publication, but in doing so, we often overlook transformative science hidden in plain sight. How many life-saving insights are currently buried under the weight of institutional bias?
The Problem: The “Raw Citation” Dilemma
When a researcher encounters a paper with 25 citations, a fundamental question arises: Are 25 citations few or many? Without context, this number is meaningless. The academic community is increasingly turning toward Article-Level Metrics (ALM), but even here, we face the “Raw Citation” trap. To truly understand a paper’s impact, we must shift our focus from absolute numbers to relative influence. A paper’s weight must be measured within its own ecosystem- accounting for its field, its year of publication, and its peers. Without this lens of relative influence, we aren’t measuring scientific value; we are simply counting noise.
To address this, the YCR-index essentially grades on a curve. Imagine two students scoring 80 on a test. Without context, they seem equal. But if Student A’s test had a class average of 95, that 80 is a disappointment. If Student B’s test had an average of 40, that 80 is a phenomenal achievement. The YCR-index builds this ‘curve’ for each scientific niche by benchmarking a paper against its specific field and publication year, answering a fundamental question: “Given its specific field and publication year, is this paper receiving more or less attention than expected from its peer group?”
The Personal Catalyst: From Tragedy to Transparency
This search for objective value is more than a technical challenge; it is a personal mission. The YCR-index did not begin in a lab, but in a hospital room. When our founder lost his mother to pancreatic cancer, he spent months navigating the labyrinth of oncology research. He discovered a frustrating truth: discovery is frequently shaped by budgets and prestige rather than the intrinsic merit of the science itself. Scientists spend valuable time searching for relevant studies, unsure if the metrics they see reflect the best science or just the best funding. This realization led to the birth of the YCR-index, an open-source initiative designed to provide a “Glass Box” alternative to traditional metrics. To ensure these insights are practical and easy to use, we developed a free Chrome extension that surfaces our field-normalized data directly within a researcher’s existing workflow on PubMed and Google Scholar.
The YCR-index is meant to serve as a critical navigation layer for researchers and specialists, helping them prioritize high-value science in an increasingly noise-heavy environment.
The Hour of Discovery: The YCR Triplets
To demonstrate the necessity of relative metrics, the YCR-index home page features a dynamic “Triplets” section that refreshes every hour. This feature presents three different papers that share a common keyword or topic, often appearing to have similar influence based on their raw citation counts. However, once the YCR lens is applied, the reality of their impact changes.
Take, for example, a recent triplet of papers investigating Ziv-aflibercept, a potent inhibitor of vascular endothelial growth factor. While these three studies share a core subject, their “Relative Influence” tells three different stories:
- The Side-Effect Breakthrough: A 2016 study (PMID: 28078129) investigating the drug’s association with osteonecrosis of the jaw has 27 citations. With a YCR score of 1.25, it clearly outperforms its field’s average, signaling a high-impact discovery regarding patient safety.
- The Solid Baseline: A 2016 ophthalmology study (PMID: 27703326) on its use for macular edema has 16 citations. Its YCR of 0.87 places it in the “good enough” range (0.80–0.99), marking it as a solid, expected contribution to the field.
- The Underperformer: A 2013 Phase II multicenter trial for metastatic cancer (PMID: 24292447) has 25 citations. Despite having nearly the same raw count as the first study, its YCR is only 0.74. For a large-scale metastatic trial from 2013, these numbers indicate it has underperformed relative to the typical citation velocity of its discipline.
In a traditional search, a researcher might see 27 and 25 citations as essentially equal. The YCR-index reveals that one is a high performer, while the other is lagging behind.
Decoding the YCR: Year / Citations / Relative
The YCR-index simplifies this complex analysis into a clear formula: Year / Citations / Relative. By leveraging the comprehensive, open metadata of OpenAlex, we map the entire spectrum of research, ensuring that our metrics are as democratic as the science they aim to measure.
Our Relative metric (R) serves as the ultimate equalizer:
- R > 1.0: The paper is outperforming its field; the higher the score, the greater the relative impact.
- R 0.80–0.99: The paper is performing well, meeting the expected standards of its discipline.
- The internal logic of this calculation, from the integration of OpenAlex metadata to the benchmarking against NIH-funded benchmark sets, is detailed in our relative score workflow (Figure 1).

Inside the Glass Box: Methodology and Precision
Field-normalization is our cornerstone, yet the YCR-index goes beyond isolated metrics by fostering algorithmic interoperability. While existing tools like the NIH’s iCite provide valuable field-normalized data, the YCR-index extends this utility by integrating it directly into the researcher’s workflow and combining it with network-based ranking to offer a more holistic evaluation. We have begun integrating the output of one evaluation model as the input for another.
Specifically, we developed a variation of our PaperRank algorithm that utilizes the YCR’s relative score (1+R) as its primary input signal. By feeding field-normalized impact back into the network ranking, we create a cascading evaluation system where the “weight” of a citation is determined by the proven quality of the citing work.
Furthermore, we address a common pitfall in metrics: the “false negative.” A low citation count (R) doesn’t always equate to low quality; it might simply reflect a newly published work or a highly specialized niche. To provide a broader perspective, our system “rescues” these papers by integrating author performance statistics as a contextual signal.
When a paper shows a low relative score, the YCR-index automatically presents the historical performance of its lead researchers across different teams and projects. Crucially, this “rescue” mechanism does not modify the paper’s objective YCR score; instead, it acts as an interim proxy for quality during the inevitable citation lag that follows a new publication. If a first author has a consistent track record of high-impact work elsewhere, even in different collaborations, the system signals this potential to the reader. For early-career researchers without an established track record, the metric remains purely performance-based, ensuring the system provides transparency without institutionalizing bias or penalizing new voices. This holistic approach ensures that research is evaluated not just as a standalone data point, but as part of a continuous scientific journey.
This comprehensive data flow, illustrating how raw bibliographic information is transformed into real-time metrics for the end-user, is captured in our combined system architecture (Figure 2).
Future Outlook: The Road to Open Metrics
The YCR-index is more than a technological tool; it is a proposal for a more rigorous and democratic academic standard. Our commitment to this mission is rooted in complete transparency. As the project evolves, we are moving toward a phased release of our source code and processed data, ensuring that our methodology is not only public but fully reproducible. We invite the research community to examine our tool, scrutinize our methodology, and join the discussion on building a future for research evaluation that relies on verifiable evidence rather than institutional reputation. Professional feedback remains vital to the evolution of this initiative.
Looking ahead, the vision for the YCR-index is ambitious. We envision a future generation of the algorithm capable of predicting a brand-new paper’s future influence before it has earned a single citation. This pre-citation signal would be derived from a deep analysis of the paper’s co-citation network. Rather than waiting for citations to accrue, the system would examine the specific cluster of references the paper relies on. By analyzing the momentum of a paper’s references, the algorithm could identify its ‘intellectual neighborhood.’ Combined with the author’s track record, this would create a predictive bridge to recognize merit long before citations accumulate.
As the project continues to grow, it is poised to become a central part of a scientific landscape where impact is determined by merit and transparent data. By cutting through the fog of prestige, we aim to ensure that the next life-saving breakthrough is recognized for its true value, from the moment it is published.
For any inquiries or further information, please feel free to reach out to us at: info@ycr-index.org
Discussion
10 Thoughts on "Guest Post — Beyond the Prestige: Why Scientific Impact is More Than a Numbers Game"
Absolutely not. Neither groundbreaking research nor prestige of a journal is reflected by high number of citations. First, citations are a political and game able metric. Different publication access model generate different frequency of citations. For instance, toll access generates less citations as compared to open access. Second, if you read a majority of the publish corpus of literature, you will find that above 95% citations are “for the sake of citations.” Unfortunate, they don’t reflect any intrinsic value. Citations like “Abc et al. (2024) studied capital flight and capital export and make a comparison” is just a narration. Now look at this citation “we propose and develop our model rooted in the model of capital flight by Abc et al. (2024).” Look at the difference between both citations. One is a citation for the sake of citation, whereas other is a real one. I wonder why we weight both on same scale. Thanks
Sir, you are quite correct, and there is surely immense additional value in accounting for this distinction.
Still, I don’t think this matter undermines the intrinsic value of the proposed new calculation.
I’m more curious to understand where/how the boundaries for comparable cohorts are drawn. That’s my first inclination towards understanding how intrinsically robust this may be in making broadly applicable claims to ‘betterness’.
Back to your (valid and complementary) point… If only some folks had already classified citations by support/refute/neutral… oh, hang on a minute… 🙂
But before going there… how well DOES this stand alone?
Fiona, Thanks. The answer to your questions can only be given by the author of this article. However, I write my observations about YCR-Index and other similar indexes. All the indexes heavily relying on other platforms give inaccurate/imperfect results. For instance, YCR import data from OpenAlex. Now look, according to OpenAlex the citation count of article with DOI: 10.3389/fnhum.2016.00051 is 18. However, the actual Clarivate citations of this article are 30. Therefore, the results presented by YCR was wrong because they are based on wrong information input from OpenAlex. Presenting something wrong based on wrong will result in wrong. I hope you will understand.
Isn’t this essentially just field weighted citation index, but open? Scopus has been calculating citations relative to field and year for a long time.
That is a fair question. Field-normalized metrics like Scopus’s FWCI or Clarivate’s CNCI have indeed been around for a long time. However, YCR-index is fundamentally different in three ways:
* The Cohort Definition: While FWCI relies on rigid, predetermined journal subject categories, YCR utilizes the NIH’s RCR co-citation framework. The “field” is generated dynamically by the paper’s actual citation neighborhood, not a generic journal label.
* Algorithmic Interoperability: YCR feeds this normalized score back into a network-based ranking system (PaperRank), meaning the quality of the citing environment scales the metric.
* The Workflow Integration: FWCI is locked behind expensive corporate paywalls. YCR democratizes this logic by making it entirely open-source and deploying it via a free Chrome extension directly inside Google Scholar and PubMed, putting advanced bibliometrics instantly into the hands of the individual researcher.
Best,
Yehonatan
Hi Mahmood and Fiona,
Thank you both for this engaging and incredibly sharp discussion. You’ve hit on the exact core challenges of modern bibliometrics.
To Mahmood’s point on citation intent and weighting:
You are absolutely right that a casual mention shouldn’t carry the same weight as a foundational methodological citation. This is precisely why the YCR-index doesn’t stop at field-normalization. As detailed in Figure 2, our workflow integrates a customized PaperRank algorithm. Instead of treating all citations equally, PaperRank recalculates the network, ensuring that a citation from a highly-cited, highly-efficient paper carries significantly more “weight” than a casual mention in an underperforming paper. It’s our way of moving past the flat, one-size-fits-all citation counting.
To Fiona’s question on cohort boundaries (and how it stands alone):
This ties directly into how we define a “field.” Rather than forcing papers into rigid, top-down journal categories (which often misclassify multidisciplinary work), YCR adopts the NIH’s Relative Citation Ratio (RCR) methodology. The boundaries for a comparable cohort are drawn dynamically using a co-citation network. The peer group of a target paper consists of all articles published in the same year that are co-cited alongside it. This creates a fluid, organically defined “intellectual neighborhood” that accurately reflects the paper’s true peers. While semantic citation tools (like classifying by support/refute) add immense value, YCR is built to stand robustly on its own by normalizing against these precise, network-derived cohorts.
Regarding OpenAlex data discrepancies:
Mahmood, the example you raised is a known reality in data science. Open data ecosystems like OpenAlex are rapidly evolving; while coverage gaps between open and proprietary databases (like Clarivate) can occur in specific sub-fields, OpenAlex has been closing the gap at an unprecedented rate. The core philosophy of YCR is the “Glass Box” approach. By using open metadata, our calculations are fully auditable, reproducible, and democratic: free from proprietary paywalls that restrict institutional access.
Thank you both for pushing this conversation forward!
Best,
Yehonatan
Thanks for this, agree 100% with the diagnosis. Raw counts are noise without context, and journal prestige is a broken proxy. Field-normalization genuinely improves on both.
Where I would push back: Every version of this (Raw counts, FWCI, RCR, YCR) answers “how much attention did this get relative to its peers”. None answer “why is this paper sound, or consequential?” And when someone decides whether to trust or build on a paper, the ‘Why’ is what they need.
Quick illustration, on your own triplet. We ran a rubric that reads the paper’s text – blind to citations, journal, and author. Findings:
Osteonecrosis case series (your top performer, 1.25): useful pharmacovigilance signal, but 3 patients, no causality → impact Low.
RVO pilot (0.87): 9-eye uncontrolled, efficacy preliminary → impact Low.
Phase II NSCLC trial (your underperformer, 0.74): closed early after confirmed RPLS cases, ending development of an unsafe regimen → impact Medium, highest of the three.
Your lowest-ranked paper is the one that actually changed a clinical decision. It’s cited less because negative and safety-stopping results always are, and normalizing the citation signal can’t correct a bias baked into the signal itself. Both the YCR score and Open Alex’s FWCI put this trial at the bottom of the three, so it isn’t an OpenAlex-vs-Clarivate data question either. It’s about what citations can and can’t see.
These are not competing evaluations, but different axis from each other. Genuinely curious whether these end up as one system, or two layers researchers run side by side.
Evaluation links:
https://www.nabu.science/evaluation/10.21037%2Fjgo.2016.05.07; https://nabu.science/evaluation/10.2147%2Fopth.s116343; https://www.nabu.science/evaluation/10.1038%2Fbjc.2013.735
(Disclosure: Founder of Nabu – flagging since I’m citing our own tool.)
Hi Swapan,
Thank you for this incredibly sharp and challenging comment. The case study you ran using Nabu is a fascinating look at a well-known edge case in bibliometrics: the systemic under-citation of negative results or safety-stopping trials. You are completely right that the sociology of science creates a baked-in bias here.
However, this example highlights exactly why a network-level metric like the YCR-index is indispensable, and why intrinsic text analysis captures a fundamentally different dimension.
While a textual rubric evaluates a paper’s isolated, static potential at the moment of publication, it cannot capture how knowledge actually diffuses and evolves through the scientific ecosystem over time. A paper might be structurally perfect on paper, but its realized impact depends on how the global community interacts with it. YCR tracks this collective intelligence and actual network utilization.
Furthermore, scaling deep text analysis across the 3 to 5 million papers published annually presents massive operational bottlenecks. Beyond the immense computational overhead required for deep qualitative LLM evaluation at that scale, text-level tools hit a hard infrastructure wall: proprietary paywalls. Because a vast portion of global research is locked away, full-text AI analysis remains constrained.
YCR bypasses this by operating entirely on open citation metadata. By deploying a fully algorithmic workflow (RCR + PaperRank), it delivers an instant, democratic, macro-level navigation system for the entire global corpus, directly in the browser.
Intrinsic validation tools like Nabu offer a valuable micro-layer for evaluating specific papers, but as I see it, they represent a different axis entirely: one that complements, rather than replaces, the scalable network dynamics that YCR maps.
Thanks for pushing the boundaries of this methodology!
Best,
Yehonatan
This is an interesting application of previously closed models on an open dataset, but unfortunatley the data behind this tool can be broken due to a ‘garbage in, garbage out’ issue with raw OpenAlex snapshots. If you look at YCR’s own ‘Best YCR Papers’ list (https://ycr-index.org/best-ycr) for 2021, the top spot is occupied by obscure butterfly taxonomy papers with impossible relative citation (R) scores over 40 caused by a citation-aggregation bug in OpenAlex. Actually, this bug is partially corrected in the current OpenAlex dataset, but the published YCR’s were calculated from an older 2024 OpenAlex snapshot (according to the data statistics info). Furthermore, the platform treats overlapping, redundant categories like “10041: Coronavirus Disease 2019” and “10118: Coronavirus Disease 2019 Research” as separate fields, which questions the relevancy and reliability of the field normalization method used. I understand that the developers of the YCR-index are aware of these (or some of these) problems, but unfortunately there are no quick and reliable fixes to get rid of these errors in OpenAlex data.
Gabor, thanks for the rigorous review of our data.
We are well aware of the 2024 OpenAlex citation-counting bug that caused the butterfly taxonomy anomaly. Our technical team is already upgrading the backend to sync with their corrected dataset, which will automatically clear out these legacy errors in our next update.
However, your ability to audit our lists and isolate this specific glitch is the ultimate validation of our open-source philosophy. In proprietary, closed databases, these indexing errors happen constantly: they are just hidden behind corporate paywalls where nobody can inspect them. This is exactly why we built a Glass Box: open data doesn’t pretend to be perfect, it exposes flaws so the community can build something genuinely resilient.
Regarding the overlapping fields like the redundant Coronavirus categories: this actually highlights a core strength of how YCR operates.
The YCR-index does not rely on text-based subject labels or journal categories to calculate field normalization. Instead, we use the NIH’s RCR co-citation method. The peer cohort for any paper is generated dynamically based strictly on which articles are organically cited alongside it. Because of this, even if the underlying database creates messy or redundant categorical names, our normalization remains insulated from those taxonomy errors: it responds only to actual citing behavior.
We are building this for the community, and audits like yours are exactly what it takes to get it right. I’d love to hear your thoughts once the new dataset is live.
Best,
Yehonatan