Ensemble analysis of topical journal ranking in bioinformatics

Min Song, Su Yeon Kim, Keeheon Lee

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Journal rankings, frequently determined by the journal impact factor or similar indices, are quantitative measures for evaluating a journal's performance in its discipline, which is presently a major research thrust in the bibliometrics field. Recently, text mining was adopted to augment journal ranking-based evaluation with the content analysis of a discipline taking a time-variant factor into consideration. However, previous studies focused mainly on a silo analysis of a discipline using either citation-or content-oriented approaches, and no attempt was made to analyze topical journal ranking and its change over time in a seamless and integrated manner. To address this issue, we propose a journal-time-topic model, an extension of Dirichlet multinomial regression, which we applied to the field of bioinformatics to understand journal contribution to topics in a field and the shift of topic trends. The journal-time-topic model allows us to identify which journals are the major leaders in what topics and the manner in which their topical focus. It also helps reveal an interesting distinct pattern in the journal impact factor of high- and low-ranked journals. The study results shed a new light for understanding topic specific journal rankings and shifts in journals' concentration on a subject.

Original languageEnglish
Pages (from-to)1564-1583
Number of pages20
JournalJournal of the Association for Information Science and Technology
Volume68
Issue number6
DOIs
Publication statusPublished - 2017 Jun 1

Fingerprint

Bioinformatics
ranking
content analysis
leader
regression
time
Journal ranking
trend
evaluation
performance
Journal impact
Topic model
Impact factor

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management
  • Library and Information Sciences

Cite this

@article{e61e1ef9f14e4f1cacfc29edef2ac473,
title = "Ensemble analysis of topical journal ranking in bioinformatics",
abstract = "Journal rankings, frequently determined by the journal impact factor or similar indices, are quantitative measures for evaluating a journal's performance in its discipline, which is presently a major research thrust in the bibliometrics field. Recently, text mining was adopted to augment journal ranking-based evaluation with the content analysis of a discipline taking a time-variant factor into consideration. However, previous studies focused mainly on a silo analysis of a discipline using either citation-or content-oriented approaches, and no attempt was made to analyze topical journal ranking and its change over time in a seamless and integrated manner. To address this issue, we propose a journal-time-topic model, an extension of Dirichlet multinomial regression, which we applied to the field of bioinformatics to understand journal contribution to topics in a field and the shift of topic trends. The journal-time-topic model allows us to identify which journals are the major leaders in what topics and the manner in which their topical focus. It also helps reveal an interesting distinct pattern in the journal impact factor of high- and low-ranked journals. The study results shed a new light for understanding topic specific journal rankings and shifts in journals' concentration on a subject.",
author = "Min Song and Kim, {Su Yeon} and Keeheon Lee",
year = "2017",
month = "6",
day = "1",
doi = "10.1002/asi.23840",
language = "English",
volume = "68",
pages = "1564--1583",
journal = "Journal of the Association for Information Science and Technology",
issn = "2330-1635",
publisher = "John Wiley and Sons Ltd",
number = "6",

}

Ensemble analysis of topical journal ranking in bioinformatics. / Song, Min; Kim, Su Yeon; Lee, Keeheon.

In: Journal of the Association for Information Science and Technology, Vol. 68, No. 6, 01.06.2017, p. 1564-1583.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Ensemble analysis of topical journal ranking in bioinformatics

AU - Song, Min

AU - Kim, Su Yeon

AU - Lee, Keeheon

PY - 2017/6/1

Y1 - 2017/6/1

N2 - Journal rankings, frequently determined by the journal impact factor or similar indices, are quantitative measures for evaluating a journal's performance in its discipline, which is presently a major research thrust in the bibliometrics field. Recently, text mining was adopted to augment journal ranking-based evaluation with the content analysis of a discipline taking a time-variant factor into consideration. However, previous studies focused mainly on a silo analysis of a discipline using either citation-or content-oriented approaches, and no attempt was made to analyze topical journal ranking and its change over time in a seamless and integrated manner. To address this issue, we propose a journal-time-topic model, an extension of Dirichlet multinomial regression, which we applied to the field of bioinformatics to understand journal contribution to topics in a field and the shift of topic trends. The journal-time-topic model allows us to identify which journals are the major leaders in what topics and the manner in which their topical focus. It also helps reveal an interesting distinct pattern in the journal impact factor of high- and low-ranked journals. The study results shed a new light for understanding topic specific journal rankings and shifts in journals' concentration on a subject.

AB - Journal rankings, frequently determined by the journal impact factor or similar indices, are quantitative measures for evaluating a journal's performance in its discipline, which is presently a major research thrust in the bibliometrics field. Recently, text mining was adopted to augment journal ranking-based evaluation with the content analysis of a discipline taking a time-variant factor into consideration. However, previous studies focused mainly on a silo analysis of a discipline using either citation-or content-oriented approaches, and no attempt was made to analyze topical journal ranking and its change over time in a seamless and integrated manner. To address this issue, we propose a journal-time-topic model, an extension of Dirichlet multinomial regression, which we applied to the field of bioinformatics to understand journal contribution to topics in a field and the shift of topic trends. The journal-time-topic model allows us to identify which journals are the major leaders in what topics and the manner in which their topical focus. It also helps reveal an interesting distinct pattern in the journal impact factor of high- and low-ranked journals. The study results shed a new light for understanding topic specific journal rankings and shifts in journals' concentration on a subject.

UR - http://www.scopus.com/inward/record.url?scp=85019012575&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019012575&partnerID=8YFLogxK

U2 - 10.1002/asi.23840

DO - 10.1002/asi.23840

M3 - Article

VL - 68

SP - 1564

EP - 1583

JO - Journal of the Association for Information Science and Technology

JF - Journal of the Association for Information Science and Technology

SN - 2330-1635

IS - 6

ER -