Jazz Melody Generation from Recurrent Network Learning of Several Human Melodies

Recurrent (neural) networks have been deployed as models for learning musical processes, by computational scientists who study processes such as dynamic systems. Over time, more intricate music has been learned as the state of the art in recurrent networks improves. One particular recurrent network, the Long Short-Term Memory (LSTM) network shows promise as a module that can learn long songs, and generate new songs. We are experimenting with using two LSTM modules to cooperatively learn several human melodies, based on the songs’ harmonic structures, and the feedback inherent in the network. We show that these networks can learn to reproduce four human melodies. We then introduce two harmonizations, constructed by us, that are given to the learned networks. i.e. we supply a reharmonization of the song structure, so as to generate new songs. We describe the reharmonizations, and show the new melodies that result. We also use a different harmonic structure from an existing jazz song not in the training set, to generate a new melody.

[1]  Eleanor Selfridge-Field,et al.  Conceptual and representational issues in melodic comparison , 1998 .

[2]  Jürgen Schmidhuber,et al.  Learning the Long-Term Structure of the Blues , 2002, ICANN.

[3]  Michael C. Mozer,et al.  Neural Network Music Composition by Prediction: Exploring the Benefits of Psychoacoustic Constraints and Multi-scale Processing , 1994, Connect. Sci..

[4]  Louis P. DiPalma,et al.  Music and Connectionism , 1991 .

[5]  Peter M. Todd,et al.  A Connectionist Approach To Algorithmic Composition , 1989 .

[6]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[7]  Judy A. Franklin,et al.  Recurrent Neural Networks for Musical Pitch Memory and Classification , 2005, Int. J. Artif. Intell. Tools.

[8]  P. Todd,et al.  Musical networks: Parallel distributed perception and performance , 1999 .

[9]  Douglas H. Keefe,et al.  The Representation of Pitch in a Neural Net Model of Chord Classification , 1989 .

[10]  D. Corkill Blackboard Systems , 1991 .

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Judy A. Franklin,et al.  Recurrent Neural Networks and Pitch Representations for Music Tasks , 2004, FLAIRS.

[13]  John F. Kolen,et al.  Field Guide to Dynamical Recurrent Networks , 2001 .

[14]  H. P Nii,et al.  Blackboard Systems , 1986 .

[15]  Judy A. Franklin,et al.  Recurrent Neural Networks for Music Computation , 2006, INFORMS J. Comput..

[16]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .