Polynomial Representation of Classifiers with Independent Discrete-Valued Features

It is shown that for n-valued conditionally independent features a large family of classifiers can be expressed as an (n-1)st-degree polynomial discriminant function. The usefulness of the polynomial expansion is discussed and demonstrated by considering the first-order Minkowski metric, the Euclidean distance, and Bayes' classifiers for the ternary-feature case. Finally, some interesting side observations on the classifiers are made with respect to optimality and computational requirements.

[1]  Paul W. Cooper,et al.  The Hypersphere in Pattern Recognition , 1962, Inf. Control..

[2]  Donald F. Specht,et al.  Generation of Polynomial Discriminant Functions for Pattern Recognition , 1967, IEEE Trans. Electron. Comput..

[3]  Richard O. Duda,et al.  Pattern Classification by Iteratively Determined Linear and Piecewise Linear Discriminant Functions , 1966, IEEE Trans. Electron. Comput..

[4]  G. Toussaint,et al.  Algorithms for Recognizing Contour-Traced Handprinted Characters , 1970, IEEE Transactions on Computers.

[5]  C. K. Chow,et al.  Statistical Independence and Threshold Functions , 1965, IEEE Trans. Electron. Comput..

[6]  Karl Steinbuch,et al.  Adaptive Systems in Pattern Recognition , 1963, IEEE Trans. Electron. Comput..

[7]  N. E. Day Linear and quadratic discrimination in pattern recognition (Corresp.) , 1969, IEEE Trans. Inf. Theory.

[8]  Marvin Minsky,et al.  Steps toward Artificial Intelligence , 1995, Proceedings of the IRE.

[9]  Paul W. Cooper,et al.  Quadratic discriminant functions in pattern recognition (Corresp.) , 1965, IEEE Trans. Inf. Theory.

[10]  Godfried T. Toussaint On a Simple Minkowski Metric Classifier , 1970, IEEE Trans. Syst. Sci. Cybern..

[11]  W. Highleyman Linear Decision Functions, with Application to Pattern Recognition , 1962, Proceedings of the IRE.