Sparse functional linear discriminant analysis

Juhyun Park, Jeongyoun Ahn, Yongho Jeon

Research output: Contribution to journalArticlepeer-review

Abstract

Functional linear discriminant analysis provides a simple yet efficient method for classification, with the possibility of achieving perfect classification. Several methods have been proposed in the literature that mostly address the dimensionality of the problem. On the other hand, there is growing interest in interpretability of the analysis, which favours a simple and sparse solution. In this paper we propose a new approach that incorporates a type of sparsity that identifies nonzero subdomains in the functional setting, yielding a solution that is easier to interpret without compromising performance. Given the need to embed additional constraints in the solution, we reformulate functional linear discriminant analysis as a regularization problem with an appropriate penalty. Inspired by the success of $ 1$-Type regularization at inducing zero coefficients for scalar variables, we develop a new regularization method for functional linear discriminant analysis that incorporates an $L 1$-Type penalty, $ $, to induce zero regions. We demonstrate that our formulation has a well-defined solution that contains zero regions, achieving functional sparsity in the sense of domain selection. In addition, the misclassification probability of the regularized solution is shown to converge to the Bayes error if the data are Gaussian. Our method does not assume that the underlying function has zero regions in the domain, but it produces a sparse estimator that consistently estimates the true function whether or not the latter is sparse. Using both simulated and real data examples, we demonstrate this property of our method in finite samples through comparisons with existing methods.

Original languageEnglish
Pages (from-to)209-226
Number of pages18
JournalBiometrika
Volume109
Issue number1
DOIs
Publication statusPublished - 2022 Mar 1

Bibliographical note

Publisher Copyright:
© 2021 The Author(s) 2021. Published by Oxford University Press on behalf of the Biometrika Trust. All rights reserved.

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Mathematics(all)
  • Agricultural and Biological Sciences (miscellaneous)
  • Agricultural and Biological Sciences(all)
  • Statistics, Probability and Uncertainty
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Sparse functional linear discriminant analysis'. Together they form a unique fingerprint.

Cite this