Multi-Dimensional Density Shaping by Sigmoidal Networks

An estimate of the probability density function of a random vector is obtained by maximizing the output entropy of a feed-forward network of sigmoidal units with respect to the input weights. particularly suitable for “real time” prediction. A triangular connectivity between the neurons and the input, which is naturally suggested by the statistical setting, reduces the number of parameters.