Adaptive Computational Chemotaxis in Bacterial Foraging Optimization: An Analysis

In his seminal paper published in 2002, Passino pointed out how individual and groups of bacteria forage for nutrients and how to model it as a distributed optimization process, which he called the bacterial foraging optimization algorithm (BFOA). One of the major driving forces of BFOA is the chemotactic movement of a virtual bacterium that models a trial solution of the optimization problem. This paper presents a mathematical analysis of the chemotactic step in BFOA from the viewpoint of the classical gradient descent search. The analysis points out that the chemotaxis employed by classical BFOA usually results in sustained oscillation, especially on flat fitness landscapes, when a bacterium cell is close to the optima. To accelerate the convergence speed of the group of bacteria near the global optima, two simple schemes for adapting the chemotactic step height have been proposed. Computer simulations over several numerical benchmarks indicate that BFOA with the adaptive chemotactic operators shows better convergence behavior, as compared to the classical BFOA. The paper finally investigates an interesting application of the proposed adaptive variants of BFOA to the frequency-modulated sound wave synthesis problem, appearing in the field of communication engineering.

[1]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[2]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: The (, )-Theory , 1994, Evolutionary Computation.

[3]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[4]  David B. Fogel,et al.  Meta-evolutionary programming , 1991, [1991] Conference Record of the Twenty-Fifth Asilomar Conference on Signals, Systems & Computers.

[5]  John E. Moody,et al.  Towards Faster Stochastic Gradient Search , 1991, NIPS.

[6]  G. Panda,et al.  Bacteria Foraging Based Independent Component Analysis , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[7]  Mingui Sun,et al.  An adaptive training algorithm for back-propagation neural networks , 1995, IEEE Trans. Syst. Man Cybern..

[8]  Yoonseon Song,et al.  Evolutionary programming using the Levy probability distribution , 1999 .

[9]  Dong Hwa Kim,et al.  A hybrid genetic algorithm and bacterial foraging approach for global optimization , 2007, Inf. Sci..

[10]  Francisco Herrera,et al.  Gradual distributed real-coded genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[11]  Barak A. Pearlmutter,et al.  Automatic Learning Rate Maximization by On-Line Estimation of the Hessian's Eigenvectors , 1992, NIPS 1992.

[12]  Sukumar Mishra,et al.  A hybrid least square-fuzzy bacterial foraging strategy for harmonic estimation , 2005, IEEE Transactions on Evolutionary Computation.

[13]  Ajith Abraham,et al.  Synergy of PSO and Bacterial Foraging Optimization - A Comparative Study on Numerical Benchmarks , 2008, Innovations in Hybrid Intelligent Systems.

[14]  H. Berg,et al.  Dynamics of formation of symmetrical patterns by chemotactic bacteria , 1995, Nature.

[15]  B. Verma,et al.  Clustering and Least Square Based Neural Technique for Learning and Identification of Suspicious Areas within Digital Mammograms , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[16]  M. Ulagammai,et al.  Application of bacterial foraging technique trained artificial and wavelet neural networks in load forecasting , 2007, Neurocomputing.

[17]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[18]  Sukumar Mishra,et al.  Transmission Loss Reduction Based on FACTS and Bacteria Foraging Algorithm , 2006, PPSN.

[19]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[20]  Hajime Kita,et al.  A Comparison Study of Self-Adaptation in Evolution Strategies and Real-Coded Genetic Algorithms , 2001, Evolutionary Computation.

[21]  David B. Fogel,et al.  Evolving artificial intelligence , 1992 .

[22]  Daniel A. Ashlock,et al.  Evolutionary computation for modeling and optimization , 2005 .

[23]  R. Fletcher Practical Methods of Optimization , 1988 .

[24]  M. Eisenbach,et al.  Tar-dependent and -independent pattern formation by Salmonella typhimurium , 1995, Journal of bacteriology.

[25]  R. Kanwal Generalized Functions: Theory and Technique , 1998 .

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  Jan A Snyman,et al.  Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms , 2005 .

[28]  Dong Hwa Kim,et al.  Bacteria Foraging Based Neural Network Fuzzy Learning , 2005, IICAI.

[29]  Mordecai Avriel,et al.  Nonlinear programming , 1976 .

[30]  Q. Henry Wu,et al.  A Novel Model for Bacterial Foraging in Varying Environments , 2006, ICCSA.

[31]  L. Armijo Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[32]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[33]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[34]  Eduardo Caicedo Bravo,et al.  Bacteria Swarm Foraging Optimization for Dynamical Resource Allocation in a Multizone Temperature Experimentation Platform , 2007, Analysis and Design of Intelligent Systems using Soft Computing Techniques.

[35]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[36]  C. N. Bhende,et al.  Bacterial Foraging Technique-Based Optimized Active Power Filter for Load Compensation , 2007, IEEE Transactions on Power Delivery.

[37]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[38]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[39]  R. Durrett Random walks and random environments. Volume 1: Random walks , 1996 .

[40]  Maurizio Valle,et al.  Evaluation of gradient descent learning algorithms with adaptive and local learning rate for recognising hand-written numerals , 2002, ESANN.

[41]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[42]  Hans-Georg Beyer,et al.  Theory of evolution strategies - a tutorial , 2001 .

[43]  George D. Magoulas,et al.  Learning Rate Adaptation in Stochastic Gradient Descent , 2001 .

[44]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[45]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: Self-Adaptation , 1995, Evolutionary Computation.

[46]  S. Mishra Bacteria foraging based solution to optimize both real power loss and voltage stability limit , 2007, 2007 IEEE Power Engineering Society General Meeting.

[47]  K. Passino,et al.  Biomimicry of Social Foraging Bacteria for Distributed Optimization: Models, Principles, and Emergent Behaviors , 2002 .

[48]  James W. Beauchamp,et al.  Machine Tongues XVI: Genetic Algorithms and Their Application to FM Matching Synthesis , 1993 .

[49]  S. Mishra,et al.  Bacteria Foraging-Based Solution to Optimize Both Real Power Loss and Voltage Stability Limit , 2007, IEEE Transactions on Power Systems.

[50]  Lawrence J. Fogel,et al.  Intelligence Through Simulated Evolution: Forty Years of Evolutionary Programming , 1999 .

[51]  Todd K. Leen,et al.  Using Curvature Information for Fast Stochastic Search , 1996, NIPS.

[52]  Q. Henry Wu,et al.  Bacterial Foraging Algorithm with Varying Population for Optimal Power Flow , 2009, EvoWorkshops.

[53]  René Thomsen,et al.  Flexible ligand docking using evolutionary algorithms: investigating the effects of variation operators and local search hybrids. , 2003, Bio Systems.

[54]  P. M. Lee,et al.  Random Walks and Random Environments: Volume 1: Random Walks , 1995 .

[55]  Steven M. Lalonde,et al.  A First Course in Multivariate Statistics , 1997, Technometrics.

[56]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[57]  Amitava Chatterjee,et al.  BACTERIAL FORAGING TECHNIQUES FOR SOLVING EKF-BASED SLAM PROBLEMS , 2004 .