Neural learning of Kalman filtering, Kalman control, and system identification

This paper shows how to implement Kalman estimation (including filtering and prediction) and control, and system identification, within a neural network (NN) whose only input is a stream of noisy measurement data. The operation of the fully-integrated algorithm is illustrated by a numerical example. The resulting network is a multilayer recurrent NN that may be useful for engineering applications. The algorithm is found to impose constraints on the NN circuitry and architecture. It is of interest that the derived circuit bears certain resemblances to the putative ‘local circuit’ of mammalian cerebral cortex. These similarities are discussed with reference to speculations on the possible fundamental operations of cerebral cortex.

[1]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[2]  Anthony G. Pipe,et al.  Neural networks for prediction and control of discrete systems , 1993, Neural Parallel Sci. Comput..

[3]  András Lörincz,et al.  Erratum , 2007, Neural Computation.

[4]  Rajesh P. N. Rao,et al.  Bayesian Inference and Attentional Modulation in the Visual Cortex Correspondence and Requests for Reprints to Rajesh , 2005 .

[5]  S. Grossberg,et al.  A neural model of how horizontal and interlaminar connections of visual cortex develop into adult circuits that carry out perceptual grouping and learning. , 2010, Cerebral cortex.

[6]  Andreas Ziehe,et al.  Adaptive On-line Learning in Changing Environments , 1996, NIPS.

[7]  Tomaso Poggio,et al.  Generalization in vision and motor control , 2004, Nature.

[8]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[9]  V. Mountcastle Perceptual Neuroscience: The Cerebral Cortex , 1998 .

[10]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.

[11]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[12]  E. Callaway Local circuits in primary visual cortex of the macaque monkey. , 1998, Annual review of neuroscience.

[13]  Peter Dayan,et al.  Probabilistic Computation in Spiking Populations , 2004, NIPS.

[14]  Rajesh P. N. Rao Bayesian Computation in Recurrent Neural Circuits , 2004, Neural Computation.

[15]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[16]  Terrence J. Sejnowski,et al.  Bayesian Unsupervised Learning of Higher Order Structure , 1996, NIPS.

[17]  Ralph Linsker,et al.  Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network , 1992, Neural Computation.

[18]  S. Grossberg,et al.  Context-sensitive binding by the laminar circuits of V1 and V2: A unified model of perceptual grouping, attention, and orientation contrast , 2001 .

[19]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[20]  C. Gilbert Microcircuitry of the visual cortex. , 1983, Annual review of neuroscience.

[21]  Ralph Linsker,et al.  Improved local learning rule for information maximization and related applications , 2005, Neural Networks.

[22]  D. George,et al.  A hierarchical Bayesian model of invariant pattern recognition in the visual cortex , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[23]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[24]  Geoffrey E. Hinton,et al.  Generative models for discovering sparse distributed representations. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[25]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[26]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  Barnabás Póczos,et al.  Neural Kalman filter , 2005, Neurocomputing.

[28]  Ralph Linsker,et al.  Neural network learning of optimal Kalman prediction and control , 2008, Neural Networks.

[29]  Peter Dayan,et al.  Inference, Attention, and Decision in a Bayesian Neural Architecture , 2004, NIPS.