An Information Theoretic Approach to The Construction of Efficient Decision Trees

Jaime M. De Faria, Syracuse University
Carlos R.P. Hartmann, Syracuse University
Carl L. Gerberich, Syracuse University
Pramod K. Varshney, Syracuse University



This paper treats the problem of construction of efficient decision trees. Construction of optimal decision trees is an NP-complete problem and, therefore, a heuristic approach for the design of efficient decision trees is considered. The approach is based on information theoretic concepts and the proposed algorithm provides us with a simple procedure for the construction of near-optimal decision trees.