Citation Research and Impact Metrics
Need more help?
Introduction to Journal Assessment
Journal rankings typically use citation data to assess the quality of a given journal. The most well-known journal ranking system is the Journal Impact Factor (JIF), which is produced from citation counts collected from the Web of Science database. Other systems have been developed more recently, including Eigenfactor, Scimago Journal Ranking (SJR), Source Normalized Impact per Paper (SNIP), and SCOPUS CiteScore.
In this section, we focus on SCOPUS CiteScore and the Journal Impact Factor, however, we also have a brief explanation of other journal rankings.
Important Points:
- Journal rankings are commonly misunderstood and frequently misused.
- Journal rankings evaluate the performance of a journal as a whole but say nothing about the impact or quality of an individual article within the journal. Publication in a highly ranked journal does not guarantee an article will have impact, nor does publication in a low ranked journal indicate the absence of impact. Consequently, journal rankings should not be used to assess an author's publication packet nor an article's impact as the rankings measure neither author nor article performance.
Best Uses:
- Journal rankings were originally intended to help librarians determine what journals should be in their collections and for editors to compare their journal's performance to others in the same field. These remain acceptable uses for journal rankings.
- Journal rankings also help researchers find appropriate places for submitting their articles, although researchers should also consider such things as the journal's subject content, readership, and open access/open data policies. (See the Getting Published Library Guide for additional guidance in selecting a publishing venue)
The Journal Impact Factor
Please note that ASU Library does not have a subscription to Web of Science and Journal Citation Reports.
The Journal Impact Factor (JIF), using citation data from the Web of Science database (provided by Clarivate Analytics), is the original journal ranking product. JIF is a measure reflecting the annual average number of citations to recent articles published in a given journal. The full JIF information is found in the Journal Citation Reports (JCR) database which also includes Eigenfactor rankings and a five-year JIF. Selected JIF information can also be found directly in the Web of Science database. For a discussion of some of the issues associated with the JIF, please see the article below.
-
Rethinking impact factors: better ways to judge a journalWe need a broader, more-transparent suite of metrics to improve science publishing, say Paul Wouters, colleagues and co-signatories. Comment in Nature 569, 621-623 (2019)
SCOPUS CiteScore
CiteScore is a product from Elsevier, using citation data from the Scopus database to rank journals. As with other journal ranking metrics, to compare journals across disciplines requires a "normalized" ranking, which CiteScore provides as a percentile ranking within the journal's subject category. In addition to the CiteScore number and percentile ranking, CiteScore also includes the SJR (Scimago Journal Rank) and SNIP (Source Normalized Impact per Paper) numbers.
Important Points:
- Because the CiteScore is based on raw citations counts, comparing CiteScores in different disciplines penalizes journals in fields with naturally low citation numbers.
- CiteScore may assign journals to more than one subject category. Additionally, the selected subject category for CiteScore in some cases has been either incorrect or questionable.
- To compare journals across subject areas, CiteScore provides a CiteScore Percentile which normalizes the raw CiteScore within its subject area. The scale runs from 100 (highest rank) down to 1 (lowest rank).
- If a journal has been assigned to more than one subject area, the CiteScore Percentile will be from the subject area in which the journal ranked the highest.
- CiteScore uses approximately 22,000 journals plus conference papers and reviews indexed in the Scopus database as its source data.
- The annual CiteScore covers articles published in the previous three years.
- CiteScore includes front matter (editorials, news, letters to editors, etc.) in its calculations for how many documents are in each journal; consequently, journals with a lot of front matter, which is generally not cited, have a lower CiteScore (sometimes substantially lower) than their Journal Impact Factor (JIF).
- CiteScore is produced by a major publisher (Elsevier) of journals which some have criticized as conflict of interest.
Journal Impact Factor
Please note that ASU Library does not have a subscription to Web of Science. Scopus is the preferred alternative for performing journal assessments.
The Journal Impact Factor (JIF), using citation data from the Web of Science database (provided by Clarivate Analytics), is the original journal ranking product. JIF is a measure reflecting the annual average number of citations to recent articles published in a given journal. The full JIF information is found in the Journal Citation Reports database which also includes Eigenfactor rankings and a five-year JIF. Selected JIF information can also be found directly in the Web of Science database.
Important Points:
- Because the Journal Impact Factor (JIF) is based on raw citations counts, comparing JIFs in different disciplines penalizes journals in fields with naturally low citation numbers.
- To compare journals across subject areas, Journal Citation Reports provides a JIF percentile and quartile ranking both of which normalizes the raw JIF. Either the quartile or the percentile ranking can be used for comparison purposes depending on whether a broader rank (quartile) or a more finely tuned rank (percentile) is desired.
- The quartile is given as either Q1, Q2, Q3, or Q4 where Q1 indicates that the journal is in the top 25% of its subject category while Q4 indicates it is in the bottom 25% of the journals in that category.
- For the percentile figure, the scale runs from 100 (highest rank) down to 1 (lowest rank).
- Journal Citation Reports uses approximately 11,000 journals indexed in the Web of Science database to obtain its source data.
- The JIF formula uses articles citation counts from the 2 previous years but also offers a 5 year JIF.
- JIF eliminates front matter (editorials, news, letters to editors, etc.) in its calculations. Therefore, journals with a lot of front matter, which is generally not cited, fare much better in the JIF ranking than the CiteScore ranking.
- JIF assigns journals to 1-4 different subject categories.
- Data is available for 1997 to the last full year; annual data usually appears at the end of June. For recently introduced journals, a JIF will not be available until after its third year of publication.
-
What’s wrong with the journal impact factor in 5 graphsThis explainer from Dalmeet Singh Chawla in Nature Index, April 3, 2018 provides context for important considerations when evaluating journal impact factors.
Other Sources of Journal Rankings
-
Google Scholar MetricsRanks publications in Google Scholar by analyzing the last 5 years of journal articles from websites that follow Google's inclusion guidelines. The metrics provided are the h-index and the h-median.
- The h-index of a publication is the largest number h such that h articles published that publication have at least h citations each.
- The h-core of a publication is a set of the h articles in a publication that the h-index is based on.
- The h-median of a publication is the median number of citations for the articles that make up the h-core.
- The h5-index, h5-core, and h5-median reflect the above counts for articles published in the last 5 complete calendar years.
-
SCImago Journal RankingsThe SCImago Journal & Country Rank is a publicly available portal that includes the journals and country scientific indicators developed from the information contained in the Scopus database. The SJR reflects the average number of weighted citations received in the selected year by the documents published in the journal in the 3 previous years. Journal subjects include arts and humanities, in addition to business, social sciences, and science. SCImago also generate country rankings and comparisons of countries or journals.
-
ERIH PlusERIH PLUS is an academic journal index for the HSS (Humanities and Social Sciences) society in Europe. All journals must meet certain quality criteria to be included.
-
Harzing.com - Journal Quality ListThe Journal Quality List is a collation of journal rankings from a variety of sources. It is published primarily to assist academics to target papers at journals of an appropriate standard. The Journal Quality List comprises academic journals in the following broad areas: Economics, Finance, Accounting, Management, and Marketing.
-
MLA Directory of PeriodicalsA searchable directory for scholars seeking outlets to publish their work. The directory includes publication details, submission requirements, and subscription information for thousands of journals and series in the MLA’s core subject areas. (ASU affiliation required)