Detecting Nonlinearity in Data with Long Coherence Times

We consider the limitations of two techniques for detecting nonlinearity in time series. The first technique compares the original time series to an ensemble of surrogate time series that are constructed to mimic the linear properties of the original. The second technique compares the forecasting error of linear and nonlinear predictors. Both techniques are found to be problematic when the data has a long coherence time; they tend to indicate nonlinearity even for linear time series. We investigate the causes of these difficulties both analytically and with numerical experiments on ``real'' and computer-generated data. In particular, although we do see some initial evidence for nonlinear structure in the SFI dataset E, we are inclined to dismiss this evidence as an artifact of the long coherence time.

[1]  Joseph P. Romano,et al.  The stationary bootstrap , 1994 .

[2]  J. Theiler,et al.  Don't bleach chaotic data. , 1993, Chaos.

[3]  B. LeBaron,et al.  Simple Technical Trading Rules and the Stochastic Properties of Stock Returns , 1992 .

[4]  A. Provenzale,et al.  Convergence of the K 2 entropy for random noises with power law spectra , 1991 .

[5]  P. Grassberger Do climatic attractors exist? , 1986, Nature.

[6]  Robert Tibshirani,et al.  Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy , 1986 .

[7]  James Theiler,et al.  Testing for nonlinearity in time series: the method of surrogate data , 1992 .

[8]  N. Packard,et al.  POWER SPECTRA AND MIXING PROPERTIES OF STRANGE ATTRACTORS , 1980 .

[9]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[10]  A. Provenzale,et al.  A search for chaotic behavior in large and mesoscale motions in the Pacific Ocean , 1986 .

[11]  B. Efron Computers and the Theory of Statistics: Thinking the Unthinkable , 1979 .

[12]  A. Provenzale,et al.  Finite correlation dimension for stochastic systems with power-law spectra , 1989 .

[13]  H. Akaike A new look at the statistical model identification , 1974 .

[14]  John E. Moody,et al.  The Effective Number of Parameters: An Analysis of Generalization and Regularization in Nonlinear Learning Systems , 1991, NIPS.

[15]  M. Casdagli Chaos and Deterministic Versus Stochastic Non‐Linear Modelling , 1992 .

[16]  J. Doyne Farmer,et al.  Spectral Broadening of Period-Doubling Bifurcation Sequences , 1981 .

[17]  Martin Casdagli,et al.  Nonlinear Forecasting, Chaos and Statistics , 1992 .

[18]  D. M. Keenan,et al.  A Tukey nonadditivity-type test for time series nonlinearity , 1985 .

[19]  Blake LeBaron,et al.  Do Moving Average Trading Rule Results Imply Nonlinearites in Foreign Exchange Markets , 1992 .

[20]  David M. Rubin,et al.  Use of forecasting signatures to help distinguish periodicity, randomness, and chaos in ripples and other spatial patterns. , 1992, Chaos.

[21]  David Hsieh Chaos and Nonlinear Dynamics: Application to Financial Markets , 1991 .

[22]  D. G. Watts,et al.  Spectral analysis and its applications , 1968 .

[23]  Ruey S. Tsay,et al.  Model Checking Via Parametric Bootstraps in Time Series Analysis , 1992 .

[24]  A. I. McLeod,et al.  DIAGNOSTIC CHECKING ARMA TIME SERIES MODELS USING SQUARED‐RESIDUAL AUTOCORRELATIONS , 1983 .

[25]  J. Kurths,et al.  An attractor in a solar time series , 1987 .

[26]  Clive W. J. Granger,et al.  Testing for neglected nonlinearity in time series models: A comparison of neural network methods and alternative tests , 1993 .

[27]  W. Brock,et al.  Statistical Inference Theory for Measures of Complexity in Chaos Theory and Nonlinear Science , 1989 .

[28]  James Theiler,et al.  Estimating fractal dimension , 1990 .

[29]  Leonard A. Smith Identification and prediction of low dimensional dynamics , 1992 .

[30]  Joseph P. Romano,et al.  Bootstrap technology and applications , 1992 .

[31]  William A. Brock,et al.  Diagnostic testing for Nonlinearity Chaos, and General Dependence in Time Series Data , 1991 .

[32]  James Theiler,et al.  Using surrogate data to detect nonlinearity in time series , 1991 .

[33]  R. Tsay Nonlinearity tests for time series , 1986 .

[34]  William H. Press,et al.  Numerical recipes , 1990 .

[35]  J. Theiler Some Comments on the Correlation Dimension of 1/fαNoise , 1991 .

[36]  Kennel,et al.  Method to distinguish possible chaos from colored noise and to determine embedding parameters. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[37]  J. Theiler Quantifying Chaos: Practical Estimation of the Correlation Dimension. , 1988 .

[38]  David E. Rumelhart,et al.  Predicting the Future: a Connectionist Approach , 1990, Int. J. Neural Syst..

[39]  M. Rosenblatt,et al.  Deconvolution and Estimation of Transfer Function Phase and Coefficients for NonGaussian Linear Processes. , 1982 .

[40]  B. LeBaron,et al.  Nonlinear Dynamics and Stock Returns , 2021, Cycles and Chaos in Economic Equilibrium.

[41]  T. Rao,et al.  A TEST FOR LINEARITY OF STATIONARY TIME SERIES , 1980 .

[42]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[43]  H. Künsch The Jackknife and the Bootstrap for General Stationary Observations , 1989 .

[44]  H. Tong Non-linear time series. A dynamical system approach , 1990 .

[45]  M. Hinich Testing for Gaussianity and Linearity of a Stationary Time Series. , 1982 .

[46]  W. Brock,et al.  Is the business cycle characterized by deterministic chaos , 1988 .

[47]  M. Kanter Lower Bounds for Nonlinear Prediction Error in Moving Average Processes , 1979 .

[48]  P. Grassberger,et al.  Characterization of Strange Attractors , 1983 .