Unconventional computing using evolution-in-nanomaterio: neural networks meet nanoparticle networks

Recently published experimental work on evolution-in-materio applied to nanoscale materials shows promising results for future reconfigurable devices. These experiments were performed on disordered nano-particle networks that have no predefined design. The material has been treated as a blackbox, and genetic algorithms have been used to find appropriate configuration voltages to enable the target functionality. In order to support future experiments, we developed simulation tools for predicting candidate functionalities. One of these tools is based on a physical model, but the one we introduce in this paper is based on an artificial neural network. The advantage of this newly presented approach is that, after training the neural network to match either the real material or its physical model, it can be configured using gradient descent instead of a black-box optimisation. The experiments we report here demonstrate that the neural network can model the simulated nano-material quite accurately. The differentiable, neural network-based material model is then used to find logic gates, as a proof of principle. This shows that the new approach has great potential for partly replacing costly and time-consuming experiments with the real materials. Therefore, this approach has a high relevance for future computing, either as an alternative to digital computing or as an alternative way of producing multi-functional reconfigurable devices.

[1]  R. L. Anderson,et al.  RECENT ADVANCES IN FINDING BEST OPERATING CONDITIONS , 1953 .

[2]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[3]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[4]  Paul J. Werbos,et al.  Applications of advances in nonlinear sensitivity analysis , 1982 .

[5]  Y. Nesterov A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2) , 1983 .

[6]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[7]  A. Korotkov Coulomb Blockade and Digital Single-Electron Devices , 1996, cond-mat/9602165.

[8]  Siegfried Selberherr,et al.  SIMON-A simulator for single-electron tunnel devices and circuits , 1997, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[9]  C. Wasshuber Computational Single-Electronics , 2001 .

[10]  周天舒 Simulation program with integrated circuit emphasis (SPICE) model building method for size reduced process , 2010 .

[11]  Jürgen Schmidhuber,et al.  A committee of neural networks for traffic sign classification , 2011, The 2011 International Joint Conference on Neural Networks.

[12]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[13]  Julian Francis Miller,et al.  Nascence Project: Nanoscale Engineering for Novel Computation Using Evolution , 2012, Int. J. Unconv. Comput..

[14]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Ilya Sutskever,et al.  Training Deep and Recurrent Networks with Hessian-Free Optimization , 2012, Neural Networks: Tricks of the Trade.

[16]  Andrew W. Senior,et al.  Long Short-Term Memory Based Recurrent Neural Network Architectures for Large Vocabulary Speech Recognition , 2014, ArXiv.

[17]  Celestine Preetham Lawrence,et al.  Evolution of a designless nanoparticle network into reconfigurable Boolean logic. , 2015, Nature nanotechnology.

[18]  Hajo Broersma,et al.  A simulation tool for evolving functionalities in disordered nanoparticle networks , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).