Ant colony optimization for determining the optimal dimension and delays in phase space reconstruction

The selection of parameters in time-delay embedding for phase space reconstruction is crucial to chaotic time series analysis and forecasting. Although various methods have been developed for determining the parameters of embedding dimension and time delay for uniform embedding, the study of parameter selection for non-uniform embedding is progressed at a slow pace. In a non-uniform embedding which enables different dimensions in the phase space to have different time delays, the optimal selection of time delays presents a difficult optimization problem with combinatorial explosion. To solve this problem, this paper proposes an ant colony optimization (ACO) approach. The advantages of ACO for the embedding parameter selection problem are in two aspects. First, as ACO builds solution in an incremental way, it does not need to use a fixed embedding dimension as the encoding length of a solution. Instead, both the embedding dimension and the time delays can be optimized together. Second, ACO enables the use of problem-based heuristics. Therefore heuristics designed based on the original observed time series can be used to accelerate the search speed of ACO. Experimental results show that the proposed algorithm is promising.

[1]  Chi K. Tse,et al.  Optimal embedding parameters: a modelling paradigm , 2004 .

[2]  Richard J. Povinelli,et al.  Selecting dimensions and delay values for a time-delay embedding using a genetic algorithm , 2001 .

[3]  Jun Zhang,et al.  An intelligent testing system embedded with an ant colony optimization based test composition method , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[5]  Jun Zhang,et al.  Optimizing Discounted Cash Flows in Project Scheduling—An Ant Colony Optimization Approach , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Guoqiang Peter Zhang,et al.  Quarterly Time-Series Forecasting With Neural Networks , 2007, IEEE Transactions on Neural Networks.

[7]  Jun Zhang,et al.  An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[9]  Minvydas Ragulskis,et al.  Non-uniform attractor embedding for time series forecasting by fuzzy inference systems , 2009, Neurocomputing.

[10]  F. Takens Detecting strange attractors in turbulence , 1981 .

[11]  J. Yorke,et al.  HOW MANY DELAY COORDINATES DO YOU NEED , 1993 .

[12]  Minvydas Ragulskis,et al.  Evolutionary algorithms for the selection of time lags for time series forecasting by fuzzy inference systems , 2010, Neurocomputing.

[13]  J. Rissanen A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH , 1983 .

[14]  L. Cao Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[15]  Luca Maria Gambardella,et al.  A COOPERATIVE LEARNING APPROACH TO TSP , 1997 .

[16]  Henry Leung,et al.  Reconstruction of piecewise chaotic dynamic using a genetic algorithm multiple model approach , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[17]  Chuanhou Gao,et al.  Evidence of Chaotic Behavior in Noise From Industrial Process , 2007, IEEE Transactions on Signal Processing.

[18]  Mehmet Emre Çek,et al.  Analysis of observed chaotic data , 2004 .

[19]  Basabi Chakraborty,et al.  A novel approach for estimation of optimal embedding parameters of nonlinear time series by structural learning of neural network , 2007, Neurocomputing.

[20]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[21]  T. Schreiber Interdisciplinary application of nonlinear time series methods , 1998, chao-dyn/9807001.

[22]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[23]  H. S. Kim,et al.  Nonlinear dynamics , delay times , and embedding windows , 1999 .

[24]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Jun Zhang,et al.  Chaotic Time Series Prediction Using a Neuro-Fuzzy System with Time-Delay Coordinates , 2008, IEEE Transactions on Knowledge and Data Engineering.

[26]  Takashi Matsumoto,et al.  Reconstructions and predictions of nonlinear dynamical systems: a hierarchical Bayesian approach , 2001, IEEE Trans. Signal Process..

[27]  Guanrong Chen,et al.  Fuzzy modeling, prediction, and control of uncertain chaotic systems based on time series , 2000 .

[28]  Farmer,et al.  Predicting chaotic time series. , 1987, Physical review letters.

[29]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[30]  Kevin Judd,et al.  Embedding as a modeling problem , 1998 .

[31]  Michael Small,et al.  Optimal time delay embedding for nonlinear time series modeling , 2003, nlin/0312011.

[32]  P. Grassberger An optimized box-assisted algorithm for fractal dimensions , 1990 .