Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking

Pan Su, Changjing Shang, Tianhua Chen, Qiang Shen

Research output: Contribution to journalArticle

15 Citations (Scopus)

Abstract

Journal impact indicators are widely accepted as possible measurements of academic journal quality. However, much debate has recently surrounded their use, and alternative journal impact evaluation techniques are desirable. Aggregation of multiple indicators offers a promising method to produce a more robust ranking result, avoiding the possible bias caused by the use of a single impact indicator. In this paper, fuzzy aggregation and fuzzy clustering, especially the ordered weighted averaging (OWA) operators are exploited to aggregate the quality scores of academic journals that are obtained from different impact indicators. Also, a novel method for linguistic term-based fuzzy cluster grouping is proposed to rank academic journals. The paper allows for the construction of distinctive fuzzy clusters of academic journals on the basis of their performance with respect to different journal impact indicators, which may be subsequently combined via the use of the OWA operators. Journals are ranked in relation to their memberships in the resulting combined fuzzy clusters. In particular, the nearest-neighbor guided aggregation operators are adopted to characterize the reliability of the indicators, and the fuzzy clustering mechanism is utilized to enhance the interpretability of the underlying ranking procedure. The ranking results of academic journals from six subjects are systematically compared with the outlet ranking used by the Excellence in Research for Australia, demonstrating the significant potential of the proposed approach.
Original languageEnglish
Pages (from-to)1306-1319
Number of pages14
JournalIEEE Transactions on Fuzzy Systems
Volume25
Issue number5
Early online date21 Sep 2016
DOIs
Publication statusPublished - Oct 2017
Externally publishedYes

Fingerprint

Fuzzy clustering
Fuzzy Clustering
Ranking
Agglomeration
Averaging Operators
Linguistics
Aggregation
Aggregation Operators
Interpretability
Grouping
Nearest Neighbor
Alternatives
Evaluation
Term

Cite this

Su, Pan ; Shang, Changjing ; Chen, Tianhua ; Shen, Qiang. / Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking. In: IEEE Transactions on Fuzzy Systems. 2017 ; Vol. 25, No. 5. pp. 1306-1319.
@article{98b431a1bd1849698502bff8c33a7d3c,
title = "Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking",
abstract = "Journal impact indicators are widely accepted as possible measurements of academic journal quality. However, much debate has recently surrounded their use, and alternative journal impact evaluation techniques are desirable. Aggregation of multiple indicators offers a promising method to produce a more robust ranking result, avoiding the possible bias caused by the use of a single impact indicator. In this paper, fuzzy aggregation and fuzzy clustering, especially the ordered weighted averaging (OWA) operators are exploited to aggregate the quality scores of academic journals that are obtained from different impact indicators. Also, a novel method for linguistic term-based fuzzy cluster grouping is proposed to rank academic journals. The paper allows for the construction of distinctive fuzzy clusters of academic journals on the basis of their performance with respect to different journal impact indicators, which may be subsequently combined via the use of the OWA operators. Journals are ranked in relation to their memberships in the resulting combined fuzzy clusters. In particular, the nearest-neighbor guided aggregation operators are adopted to characterize the reliability of the indicators, and the fuzzy clustering mechanism is utilized to enhance the interpretability of the underlying ranking procedure. The ranking results of academic journals from six subjects are systematically compared with the outlet ranking used by the Excellence in Research for Australia, demonstrating the significant potential of the proposed approach.",
keywords = "aggregation of indicators, data reliability, Excellence in Research for Australia (ERA), fuzzy clustering, journal ranking, ordered weighted averaging (OWA)",
author = "Pan Su and Changjing Shang and Tianhua Chen and Qiang Shen",
year = "2017",
month = "10",
doi = "10.1109/TFUZZ.2016.2612265",
language = "English",
volume = "25",
pages = "1306--1319",
journal = "IEEE Transactions on Fuzzy Systems",
issn = "1063-6706",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "5",

}

Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking. / Su, Pan ; Shang, Changjing; Chen, Tianhua; Shen, Qiang.

In: IEEE Transactions on Fuzzy Systems, Vol. 25, No. 5, 10.2017, p. 1306-1319.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Exploiting Data Reliability and Fuzzy Clustering for Journal Ranking

AU - Su, Pan

AU - Shang, Changjing

AU - Chen, Tianhua

AU - Shen, Qiang

PY - 2017/10

Y1 - 2017/10

N2 - Journal impact indicators are widely accepted as possible measurements of academic journal quality. However, much debate has recently surrounded their use, and alternative journal impact evaluation techniques are desirable. Aggregation of multiple indicators offers a promising method to produce a more robust ranking result, avoiding the possible bias caused by the use of a single impact indicator. In this paper, fuzzy aggregation and fuzzy clustering, especially the ordered weighted averaging (OWA) operators are exploited to aggregate the quality scores of academic journals that are obtained from different impact indicators. Also, a novel method for linguistic term-based fuzzy cluster grouping is proposed to rank academic journals. The paper allows for the construction of distinctive fuzzy clusters of academic journals on the basis of their performance with respect to different journal impact indicators, which may be subsequently combined via the use of the OWA operators. Journals are ranked in relation to their memberships in the resulting combined fuzzy clusters. In particular, the nearest-neighbor guided aggregation operators are adopted to characterize the reliability of the indicators, and the fuzzy clustering mechanism is utilized to enhance the interpretability of the underlying ranking procedure. The ranking results of academic journals from six subjects are systematically compared with the outlet ranking used by the Excellence in Research for Australia, demonstrating the significant potential of the proposed approach.

AB - Journal impact indicators are widely accepted as possible measurements of academic journal quality. However, much debate has recently surrounded their use, and alternative journal impact evaluation techniques are desirable. Aggregation of multiple indicators offers a promising method to produce a more robust ranking result, avoiding the possible bias caused by the use of a single impact indicator. In this paper, fuzzy aggregation and fuzzy clustering, especially the ordered weighted averaging (OWA) operators are exploited to aggregate the quality scores of academic journals that are obtained from different impact indicators. Also, a novel method for linguistic term-based fuzzy cluster grouping is proposed to rank academic journals. The paper allows for the construction of distinctive fuzzy clusters of academic journals on the basis of their performance with respect to different journal impact indicators, which may be subsequently combined via the use of the OWA operators. Journals are ranked in relation to their memberships in the resulting combined fuzzy clusters. In particular, the nearest-neighbor guided aggregation operators are adopted to characterize the reliability of the indicators, and the fuzzy clustering mechanism is utilized to enhance the interpretability of the underlying ranking procedure. The ranking results of academic journals from six subjects are systematically compared with the outlet ranking used by the Excellence in Research for Australia, demonstrating the significant potential of the proposed approach.

KW - aggregation of indicators

KW - data reliability

KW - Excellence in Research for Australia (ERA)

KW - fuzzy clustering

KW - journal ranking

KW - ordered weighted averaging (OWA)

U2 - 10.1109/TFUZZ.2016.2612265

DO - 10.1109/TFUZZ.2016.2612265

M3 - Article

VL - 25

SP - 1306

EP - 1319

JO - IEEE Transactions on Fuzzy Systems

JF - IEEE Transactions on Fuzzy Systems

SN - 1063-6706

IS - 5

ER -