On the complexity of loading shallow neural networks