Feature Extraction Based on Decision Boundaries

Chulhee Lee, David A. Landgrebe

Research output: Contribution to journalArticle

284 Citations (Scopus)


In this paper, a novel approach to feature extraction for classification is proposed based directly on the decision boundaries. We note that feature extraction is equivalent to retaining informative features or eliminating redundant features; thus, the terms “discriminantly information feature” and “discriminantly redundant feature” are first defined relative to feature extraction for classification. Next, it is shown how discriminantly redundant features and discriminantly informative features are related to decision boundaries. A novel characteristic of the proposed method arises by noting that usually only a portion of the decision boundary is effective in discriminating between classes, and the concept of the effective decision boundary is therefore introduced. Next, a procedure to extract discriminantly informative features based on a decision boundary is proposed. The proposed feature extraction algorithm has several desirable properties: 1) It predicts the minimum number of features necessary to achieve the same classification accuracy as in the original space for a given pattern recognition problem; 2) it finds the necessary feature vectors. The proposed algorithm does not deteriorate under the circumstances of equal class means or equal class covariances as some previous algorithms do. Experiments show that the performance of the proposed algorithm compares favorably with those of previous algorithms.

Original languageEnglish
Pages (from-to)388-400
Number of pages13
JournalIEEE transactions on pattern analysis and machine intelligence
Issue number4
Publication statusPublished - 1993 Apr


All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Computer Vision and Pattern Recognition
  • Software
  • Applied Mathematics
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this