论文信息 - Incorporating Nesterov Momentum into Adam - 字舞流文

Incorporating Nesterov Momentum into Adam

Timothy Dozat | Timothy Dozat | T. Dozat

[1] Jeffrey Dean,et al. Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[2] Geoffrey E. Hinton,et al. On the importance of initialization and momentum in deep learning , 2013, ICML.

[3] Andrew Y. Ng,et al. Parsing Natural Scenes and Natural Language with Recursive Neural Networks , 2011, ICML.

[4] Yoram Singer,et al. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[5] James Martens,et al. Deep learning via Hessian-free optimization , 2010, ICML.

[6] Beatrice Santorini,et al. Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[7] Boris Polyak. Some methods of speeding up the convergence of iteration methods , 1964 .