Minimizing structural risk on decision tree classification

Research output: Chapter in Book/Report/Conference proceedingChapter

3 Citations (Scopus)

Abstract

Tree induction algorithms use heuristic information to obtain decision tree classification. However, there has been little research on how many rules are appropriate for a given set of data, that is, how we can find the best structure leading to desirable generalization performance. In this chapter, an evolutionary multi-objective optimization approach with genetic programming will be applied to the data classification problem in order to find the minimum error rate or the best pattern classifier for each size of decision trees. As a result, we can evaluate the classification performance under various structural complexity of decision trees. Following structural risk minimization suggested by Vapnik, we can determine a desirable number of rules with the best generalization performance. The suggested method is compared with C4.5 application for machine learning data.

Original languageEnglish
Title of host publicationMulti-Objective Machine Learning
EditorsYaochu Jin
Pages241-260
Number of pages20
DOIs
Publication statusPublished - 2006 Dec 12

Publication series

NameStudies in Computational Intelligence
Volume16
ISSN (Print)1860-949X

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence

Cite this

Kim, D. E. (2006). Minimizing structural risk on decision tree classification. In Y. Jin (Ed.), Multi-Objective Machine Learning (pp. 241-260). (Studies in Computational Intelligence; Vol. 16). https://doi.org/10.1007/11399346_11