Evolutionary artiicial neural networks (EANNs) refer to a special class of artiicial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. The evolution in EANNs is often simulated by genetic algorithms (GAs), evolutionary programming (EP), or other evolutionary algorithms. This paper describes an EP-based EANNs which learn both their weights and architectures through the combination of a hybrid learning algorithm and the EP algorithm. A nonlinear ranking scheme and ve mutation operators are used in our EP. These ve mutation operators are applied sequentially and selectively to each individual in a population. Such sequential application encourages the evolution of smaller ANNs with fewer hidden nodes and connections. We have tested our EP-based EANNs on the parity problem of various sizes. Very good results have been achieved. For example, a three hidden node feed-forward ANN can be evolved for the 9-parity problem. In order to improve the generalisation capability of our EP-based EANNs, we have introduced two validation sets in the combined evolution and learning process. Such an approach can improve the generalisation ability of our EP-based EANNs signiicantly. Our experimental study with a credit card problem has connrmed that EP-based EANNs can generalise well, at least for the problem concerned. In fact, it produces one of the best results we are aware of.
[1]
Neil Burgess,et al.
A Constructive Algorithm that Converges for Real-Valued Input Patterns
,
1994,
Int. J. Neural Syst..
[2]
Peter J. Angeline,et al.
An evolutionary algorithm that constructs recurrent neural networks
,
1994,
IEEE Trans. Neural Networks.
[3]
R. Stephenson.
A and V
,
1962,
The British journal of ophthalmology.
[4]
Jean-Pierre Nadal,et al.
Study of a Growth Algorithm for a Feedforward Network
,
1989,
Int. J. Neural Syst..
[5]
Aiko M. Hormann,et al.
Programs for Machine Learning. Part I
,
1962,
Inf. Control..
[6]
Xin Yao,et al.
Evolving Artificial Neural Networks for Medical Applications
,
1995
.
[7]
Christian Lebiere,et al.
The Cascade-Correlation Learning Architecture
,
1989,
NIPS.
[8]
Ferdinand Hergert,et al.
Improving model selection by nonconvergent methods
,
1993,
Neural Networks.
[9]
Robert G. Reynolds,et al.
Evolutionary computation: Towards a new philosophy of machine intelligence
,
1997
.
[10]
Donald E. Waagen,et al.
Evolving recurrent perceptrons for time-series modeling
,
1994,
IEEE Trans. Neural Networks.