Exploiting the categorical reliability difference for binary classification

Lei Sun; Kar Ann Toh; Badong Chen; Zhiping Lin

doi:10.1016/j.jfranklin.2017.11.024

Exploiting the categorical reliability difference for binary classification

Lei Sun, Kar Ann Toh, Badong Chen, Zhiping Lin

Department of Electrical and Electronic Engineering

Research output: Contribution to journal › Article › peer-review

2 Citations (Scopus)

Abstract

In binary pattern classification, the reliabilities of statistics obtained from the samples of the two categories are generally different. When the statistics are used for modeling a classifier, such reliability difference could impact the generalization performance. We formulate a disparity index to show the statistical disparity based on the generalized eigenvalue decomposition of the categorical moment matrices. It is shown that this disparity index can effectively indicate the reliability difference between the two categories. The obtained reliability difference is subsequently utilized to adjust the regularization term of a classifier for effective learning generalization. Our experiments based on 10 real-world benchmark data sets validate the effectiveness of the proposed method.

Original language	English
Pages (from-to)	2022-2040
Number of pages	19
Journal	Journal of the Franklin Institute
Volume	355
Issue number	4
DOIs	https://doi.org/10.1016/j.jfranklin.2017.11.024
Publication status	Published - 2018 Mar

Bibliographical note

Funding Information:
This work was partly supported by National NSF of China (Nos. 61673059 , 61372152 and 91648208 ) and the National Basic Research Program of China (973 Program) under grant No. 2015CB351703.

Publisher Copyright:
© 2017 The Franklin Institute

All Science Journal Classification (ASJC) codes

Control and Systems Engineering
Signal Processing
Computer Networks and Communications
Applied Mathematics

Access to Document

10.1016/j.jfranklin.2017.11.024

Cite this

@article{3fde04d9445c43feb4e563f16d0640fd,

title = "Exploiting the categorical reliability difference for binary classification",

abstract = "In binary pattern classification, the reliabilities of statistics obtained from the samples of the two categories are generally different. When the statistics are used for modeling a classifier, such reliability difference could impact the generalization performance. We formulate a disparity index to show the statistical disparity based on the generalized eigenvalue decomposition of the categorical moment matrices. It is shown that this disparity index can effectively indicate the reliability difference between the two categories. The obtained reliability difference is subsequently utilized to adjust the regularization term of a classifier for effective learning generalization. Our experiments based on 10 real-world benchmark data sets validate the effectiveness of the proposed method.",

author = "Lei Sun and Toh, {Kar Ann} and Badong Chen and Zhiping Lin",

note = "Funding Information: This work was partly supported by National NSF of China (Nos. 61673059 , 61372152 and 91648208 ) and the National Basic Research Program of China (973 Program) under grant No. 2015CB351703. Publisher Copyright: {\textcopyright} 2017 The Franklin Institute",

year = "2018",

month = mar,

doi = "10.1016/j.jfranklin.2017.11.024",

language = "English",

volume = "355",

pages = "2022--2040",

journal = "Journal of the Franklin Institute",

issn = "0016-0032",

publisher = "Elsevier Limited",

number = "4",

}

TY - JOUR

T1 - Exploiting the categorical reliability difference for binary classification

AU - Sun, Lei

AU - Toh, Kar Ann

AU - Chen, Badong

AU - Lin, Zhiping

N1 - Funding Information: This work was partly supported by National NSF of China (Nos. 61673059 , 61372152 and 91648208 ) and the National Basic Research Program of China (973 Program) under grant No. 2015CB351703. Publisher Copyright: © 2017 The Franklin Institute

PY - 2018/3

Y1 - 2018/3

N2 - In binary pattern classification, the reliabilities of statistics obtained from the samples of the two categories are generally different. When the statistics are used for modeling a classifier, such reliability difference could impact the generalization performance. We formulate a disparity index to show the statistical disparity based on the generalized eigenvalue decomposition of the categorical moment matrices. It is shown that this disparity index can effectively indicate the reliability difference between the two categories. The obtained reliability difference is subsequently utilized to adjust the regularization term of a classifier for effective learning generalization. Our experiments based on 10 real-world benchmark data sets validate the effectiveness of the proposed method.

AB - In binary pattern classification, the reliabilities of statistics obtained from the samples of the two categories are generally different. When the statistics are used for modeling a classifier, such reliability difference could impact the generalization performance. We formulate a disparity index to show the statistical disparity based on the generalized eigenvalue decomposition of the categorical moment matrices. It is shown that this disparity index can effectively indicate the reliability difference between the two categories. The obtained reliability difference is subsequently utilized to adjust the regularization term of a classifier for effective learning generalization. Our experiments based on 10 real-world benchmark data sets validate the effectiveness of the proposed method.

UR - http://www.scopus.com/inward/record.url?scp=85038849332&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85038849332&partnerID=8YFLogxK

U2 - 10.1016/j.jfranklin.2017.11.024

DO - 10.1016/j.jfranklin.2017.11.024

M3 - Article

AN - SCOPUS:85038849332

VL - 355

SP - 2022

EP - 2040

JO - Journal of the Franklin Institute

JF - Journal of the Franklin Institute

SN - 0016-0032

IS - 4

ER -

Exploiting the categorical reliability difference for binary classification

Abstract

Bibliographical note

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this