Note: Clarivate provided responses to my questions that were unfortunately held up in transit and captured as spam. Please see their responses at the end of this post.
The Web of Science Core Collection has over 21,000 journals and includes:
- Science Citation Index Expanded (SCIE)*
- Social Sciences Citation Index (SSCI)*
- Arts and Humanities Citation Index (AHCI)
- Emerging Sources Citation Index (ESCI)
Those journals in the indices with an asterisk currently get an Impact Factor. Starting with the 2023 release (the 2022 Impact Factors), journals in the Arts and Humanities Index and the Emerging Sources Citation Index will also get Impact Factors. Journals with an Impact Factor are included in the Journal Citation Report (JCR).
About the Emerging Sources Citation Index (ESCI)
In 2015, Clarivate launched the ESCI. It was initially described as an index of journals that are up-and-coming — meaning new journals, or established journals in niche areas that are growing in impact. At the time of launch, publishers were told that a journal selected for ESCI will likely get an Impact Factor within a few years.
The model for ESCI seemed to shift a few years later and there are many journals in ESCI that have been there since 2015 that still don’t have Impact Factors. In fact, Clarivate includes content for indexed journals back to 2005 so there clearly were journals older than 10 years in the database when it launched.
Clarivate reports that ESCI has over 7800 journals with 3 million records. A little over a third of those records are open access records.
The inclusion criteria for all four indices include 24 quality measures and four “impact” measures. Those journals that meet all 28 criteria are included in SCIE, SSCI, and AHCI. Those that only meet the 24 quality measures were relegated to the ESCI.
This change announced today indicates that the four impact measures are no longer required in order to get an Impact Factor.
About the Four “Impact” Measures
The 24 quality measures for inclusion in the Web of Science Core Collection includes everything you would expect — an ISSN, a peer-review policy, timeliness of publication, author and editorial board affiliations, ethics statement, and consistency between the content and citations to the stated aims and scope of the journal.
Again, any journal that passes all 24 of these criteria is likely to be included in the Web of Science Core Collection. I say “likely” because there is an editorial board of actual humans that makes the decision.
The four impact measures include:
- Comparative Citation Analysis: Number and sources of citations — are good journals citing the work in candidate journals and is this sustainable over some period of time.
- Author Citation Analysis: Most authors published in the candidate journal should have a “discernable” publication history in other indexed journals.
- Editorial Board Citation Analysis: Most editorial board members listed in the candidate journal should have a “discernable” publication history in other indexed journals.
- Content Significance: Content should be “of interest, importance, and value to its intended readership and Web of Science subscribers.”
Candidate journals that meet the 24 quality measures, but do not meet the four impact measures are likely to be in the ESCI only.
What Benefit Does the ESCI Bring?
Clarivate’s Web of Science is in hot competition with Elsevier’s Scopus database. Scopus has traditionally had a more inclusive take on admitting journals, giving it the advantage of having more content than Web of Science. Launching the ESCI allowed Web of Science to lower their inclusion standards, admit thousands of journals and their backfiles, and still only bestow Impact Factors on the journals that meet a higher standard.
Web of Science’s Core Collection and Elsevier’s Scopus are largely duplicative of each other. New “baskets of metrics” have been added to both as they compete for library subscriptions.
Journals that do not have an Impact Factor face major uphill battles. Authors care very much about Impact Factor, despite some groups trying for decades to move the dependence on the Impact Factor into the trash bin. New journals that lack the word “Nature” or “Lancet” in their titles may have to wait years (3 years would be the minimum — some exclusions apply, see note below) if not decades for an Impact Factor.
Note: some brand new journals are granted partial Impact Factors because they are deemed important to the field based on title and editor affiliations alone.
Having a journal accepted into the Core Collection, even if just in the ESCI, means that the content of the journal is discoverable in the Web of Science database. It also shows that you have met the quality criteria. And mostly, it signals to potential authors that you are likely to get an Impact Factor at some point. So to this end, the ESCI does benefit included journals. That said, there is the purgatory problem.
Journals in Purgatory
Journals can sit in the ESCI for a very long time, or forever even. This presents a few problems.
You can’t be “emerging” forever. You either emerge or you don’t. Calling something an “Emerging Source” indicates that journals will get promoted at some point in the not so far off future. However, I know of several journals that have been in that Index since 2015 or 2016. I don’t mean journals that launched in 2015, but older journals included in the database within the first year of ESCI.
To remain true to the name, those journals named “emerging” that have not been deemed “emergent” in the last 7 years either need to be kicked out or promoted. It’s like having someone as an intern for a decade — it no longer looks like an honor.
According to the Clarivate site, a journal in the ESCI whose estimated Impact Factor would put it in the top half of the subject category (Quartiles 1 or 2) will likely get an Impact Factor. Again, I know of journals that hit this mark and are still in ESCI.
Clarivate is not going to want to reduce the collection by eliminating journals they already decided met the 24 quality markers. And based on what they claim is in the ESCI, they would potentially be eliminating a fair number of open access journals, niche regional journals, and journals from the “Global South”. In essence, it would mean punishing journals because their authors and editors aren’t established enough.
Clarivate had two options — arbitrarily set a time limit for journals in the ESCI or give them all Impact Factors.
Unanswered Questions about the ESCI
My first question is whether the ESCI is being eliminated. It’s possible that Clarivate will keep the ESCI and just put Impact Factors next to each title it includes. This has the potential of a public relations nightmare. (See below).
Journals care about two things regarding the Impact Factor — the number and the rank. As the last several years have shown, Impact Factors overall can have wild swings due to changes in the corpus, changes to what is counted and when, and huge environmental impacts, such as a global pandemic. If every journal in a category goes up, or down, rank is the next way to differentiate yourself from the competition.
Journals that have an Impact Factor but are still in a separate list will sort themselves for promotion purposes into the ranking list. No one will know what is going on. Confusion has already ensued with the Journal Citation Indicator, a metric rolled out last year. The JCI field normalizes citation impact of journals and provides an indicator number to all journals in the Core Collection, even if they don’t have Impact Factors.
The introduction of the JCI was met with some skepticism. The Impact Factor has long been criticized because of the lack of transparency. Clarivate has offered new tools over the last several years to take the mystery out of the Impact Factor.
The JCI seems to go in the opposite direction. In fact Clarivate described it this way: “Although the calculations behind the Journal Citation Indicator are complex, requiring considerable computing power, the end result is simple: a single value that is easy to interpret and compare, complementing current journal metrics and further supporting responsible use.”
Perhaps giving all journals in the Core Collection an Impact Factor will ease the confusion about why some journals have one metric and other journals have another metric. Presumably now all journals in the Core Collection will have an Impact Factor and a JCI.
It’s also possible that ESCI will remain, but with far fewer journals. Perhaps those journals that have been around for less than three years or don’t garner enough citations (a threshold perhaps) will stay in the ESCI while the others go to their respective indices.
In theory, this change announced today will speed up getting an Impact Factor for most journals. What will that average wait time be? Will journals that meet the 24 quality markers automatically get an Impact Factor in the 3rd year?
Clarivate currently moves journals from SCIE and SSIE to the ESCI if they no longer meet the qualifications of the impact measures. If ESCI is eliminated, will those journals just stay in the Journal Citation Reports? Or will we see journals moving between indices as their impact changes.
I have asked these questions but did not get a response in time for posting today. (See below for answers)
What About the Decimals?
The second big announcement today is that with the 2023 release, Clarivate will “display” Impact Factors with only one decimal place instead of three!
Clarivate states that they want to “encourage users to consider the other indicators and descriptive data in the JCR when comparing journals”. It should be noted that not everyone that cares about a journal Impact Factor has access to the JCR. Those without access that have been relying solely on the multi-digit Impact Factors and ranks will lose some of their ability to independently assess journals.
Presenting numbers to the thousandths has been ridiculed for a long time. The rationale given previously is that it is necessary to determine rank. This is undoubtedly true. Often in the middle of any category you see journals that are merely a hundredth or thousandths off from their nearest competitor. It’s a virtual tie — well, now an actual tie!
Reducing to one decimal point devalues rank and focuses on the actual number. This may be a harder story for a journal to tell.
The bigger question is how many journals, particularly those in the ESCI, will have an Impact Factor of 0.0. I don’t know what the lowest Impact Factor is. I saw an undated list online that claimed 0.017 was the lowest. A small journal that publishes 20 papers a year need only get one citation to have an Impact Factor of 0.05 that rounds up to 0.1. But if they publish 23 papers, they slip into 0.0 land.
What happens to those journals with a 0.0? Are they kicked off the list or will they actually show as having no, or virtually no, citations?
Arts and Humanities
I am not purposefully ignoring the fact that journals in the Arts and Humanities Citation Index have never received Impact Factors and now will get them. I just don’t personally know what this means for those journals. Do they want Impact Factors?
Most anecdotes I can find online indicate that some in the humanities don’t find the two-year citation window in the Impact Factor helpful. Papers are much longer, peer review takes more time, and the peak citation window is no where near the two-year Impact Factor period.
I would love to learn more about whether AHCI journals think getting Impact Factors is a benefit or a curse.
It is clear that Impact Factors are here to stay and also that Clarivate does seem to be reacting to the criticism against Impact Factors, oddly by giving out more of them. Having more journals with Impact Factors should not negatively affect journals already with Impact Factors, as citations from the ESCI journals have counted toward Impact Factors since 2015.
The larger impact is what this means for assessing journals. We need to have clarity on what will happen to ESCI and whether the JCR inclusion criteria are changing. In the meantime, journals in purgatory can celebrate as they await their forthcoming Impact Factors.
Dr. Nandita Quaderi, Editor in Chief and Editorial Vice President, Web of Science provided the following answers to my questions. Unfortunately the response got held up in transit and was not received in time to be included in the original post.
Q: Is the ESCI being deprecated?
A: No there are no plans to make product-level changes as a result of expanding JIF eligibility – ESCI will remain, as will the three discipline-specific indexes. Expanding the JIF to ESCI journals will help them demonstrate their value to the research community. This decision is aligned to our position that publications in all quality journals, not just highly cited journals, should be eligible for inclusion in research assessment exercises
Q: If all journals get an Impact Factor, why separate them into the different databases that aren’t dependent on subject matter?
A: The difference between multidisciplinary ESCI and the three discipline-specific indexes is that to enter the discipline-specific indexes, journals must pass both the 24 quality criteria and the additional four impact criteria. This is not changing as a result of JIF expansion.
Q: If it is not being eliminated, will the journals in ESCI appear in the appropriate subject rankings?
A: There are no plans to display ‘combined’ category rankings that include flagship (SCIE, SSCI, AHCI) journals and ESCI journals. In next year’s JCR release, each category will have a ranking for flagship journals and a separate ranking for ESCI journals.
Q: Currently, there is criteria for inclusion in the ESCI and different criteria for inclusion in the SCIE, SSCI, or AHCI. It is my understanding that all journals must meet the 24 quality criteria, but that there are four additional impact criteria required for getting an Impact Factor. Is this new policy just eliminating the four impact criteria?
A: The 24 quality criteria and the four impact criteria will remain. All journals, including those indexed in ESCI, need to pass the 24 quality criteria that are designed to select for editorial rigor and best practice at the journal level. Journals indexed in SCIE, SSCI and AHCI need to pass the four impact criteria designed to select the most impactful journals in their respective fields using citation activity as the primary indicator of impact. Details of our evaluation process can be found here: https://clarivate.com/products/scientific-and-academic-research/research-discovery-and-workflow-solutions/web-of-science/core-collection/editorial-selection-process/editorial-selection-process/
Q: The release states that over 9,000 journals will get Impact Factors. Can you provide a breakdown like how many from ESCI and how many from AHCI?
We estimate that over 1300 AHCI journals will get a JIF and over 7600 ESCI journals will get a JIF. These numbers will be approximate until the time of JCR extraction next year. Approx. 450 AHCI journals already have a JIF as they are also covered in SCIE and/or SSCI
Q: Are there other sources of journals in the Core Collection that currently don’t get an Impact Factor?
No. There are four journal indexes in the Core Collection. Journals in SCIE and SCIE already get a JIF; from next year AHCI & ESCI journals will also get a JIF.
Q: Current Clarivate policy states that a journal with an Impact Factor that slips in citations could be “demoted” to the ESCI database. Will there be new rules about journals that “lose impact”? Could they lose their Impact Factor?
Ask slightly differently: Once you have an Impact Factor, and as long as you meet the 24 quality criteria, would you ever lose an Impact Factor?
A: All journals that have passed the rigorous Web of Science quality criteria will receive a JIF. Journals will not lose their JIF if they move from flagship to ESCI. However, JIF suppression analysis will be extended to ESCI and AHCI journals.
Q: Regarding the three decimal places, what impact will this have on Rank? I would expect there to be a whole lot of ties.
A: Yes, there will be a lot more ties, particularly in the lower quartiles. We see this as a positive development that will encourage users to consider the other indicators and descriptive data (for example, the Journal Citation Indicator [JCI]) in the JCR when comparing journals.
Q: Are there journals currently with Impact Factors so low that they won’t register for an IF anymore (like 0.009?)
A: If the calculated JIF is 0.049 or lower, the value <0.1 will be displayed.