Finding compact and sparse-distributed representations of visual images
暂无分享,去创建一个
Some recent work has investigated the dichotomy between compact coding using dimensionality reduction and sparse-distributed coding in the context of understanding biological information processing. We introduce an artificial neural network which self-organizes on the basis of simple Hebbian learning and negative feedback of activation and show that it is capable both of forming compact codings of data distributions and of identifying filters most sensitive to sparse-distributed codes. The network is extremely simple and its biological relevance is investigated via its response to a set of images which are typical of everyday life. However, an analysis of the network's identification of the filter for sparse coding reveals that this coding may not be globally optimal and that there exists an innate limiting factor which cannot be transcended.
[1] Robin Sibson,et al. What is projection pursuit , 1987 .
[2] Erkki Oja,et al. Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..
[3] Colin Fyfe. PCA Properties of Interneurons , 1993 .
[4] Juha Karhunen,et al. Representation and separation of signals using nonlinear PCA type learning , 1994, Neural Networks.
[5] David J. Field,et al. What Is the Goal of Sensory Coding? , 1994, Neural Computation.