Rule Improvement Through Decision Boundary Detection Using Sensitivity Analysis

Rule extraction from artificial neural networks (ANN) provides a mechanism to interpret the knowledge embedded in the numerical weights. Classification problems with continuous-valued parameters create difficulties in determining boundary conditions for these parameters. This paper presents an approach to locate such boundaries using sensitivity analysis. Inclusion of this decision boundary detection approach in a rule extraction algorithm resulted in significant improvements in rule accuracies.

[1]  Andries P. Engelbrecht,et al.  A sensitivity analysis algorithm for pruning feedforward neural networks , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[2]  Eric B. Baum,et al.  Neural net algorithms that learn in polynomial time from examples and queries , 1991, IEEE Trans. Neural Networks.

[3]  EnvironmentHL Viktor,et al.  Incorporating Rule Extraction from ANNs into a CooperativeLearning , 1998 .

[4]  Tharam S. Dillon,et al.  Automated knowledge acquisition , 1994, Prentice Hall International series in computer science and engineering.

[5]  Jenq-Neng Hwang,et al.  Query-based learning applied to partially trained multilayer perceptrons , 1991, IEEE Trans. Neural Networks.

[6]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[7]  Andries P. Engelbrecht Sensitivity analysis of multilayer neural networks , 1999 .

[8]  Jude W. Shavlik,et al.  Learning Symbolic Rules Using Artificial Neural Networks , 1993, ICML.

[9]  Herna Lydia Viktor Learning by cooperation : an approach to rule induction and knowledge fusion , 1999 .

[10]  Andries P. Engelbrecht,et al.  Selective learning using sensitivity analysis , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[11]  Herna L. Viktor,et al.  Reduction of symbolic rules from artificial neural networks using sensitivity analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.