Mamba-Diffusion Model with Learnable Wavelet for Controllable Symbolic Music Generation

Mamba-Diffusion Model with Learnable Wavelet for Controllable Symbolic Music Generation 1 st Jincheng Zhang Centre for Digital Music Queen Mary University of London London, UK jincheng.zhang@qmul.ac.uk 2 nd Gy orgy Fazekas Centre for Digital Music Queen Mary University of London London, UK george.fazekas@qmul.ac.uk 3 rd Charalampos Saitis Centre for Digital Music Queen Mary University of London London, UK c.saitis@qmul.ac.uk Abstract --The recent surge in the popularity of diffusion models for image synthesis has attracted new attention to their potential for generation tasks in other domains. However, their applications to symbolic music generation remain largely under-explored because symbolic music is typically represented as sequences of discrete events and standard diffusion models are not well-suited for discrete data. We represent symbolic music as image-like pi-anorolls, facilitating the use of diffusion models for the generation of symbolic music. Moreover, this study introduces a novel diffusion model that incorporates our proposed Transformer-Mamba block and learnable wavelet transform. Classifier-free guidance is utilised to generate symbolic music with target chords. Our evaluation shows that our method achieves compelling results in terms of music quality and controllability, outperforming the strong baseline in pianoroll generation. Index T erms --symbolic music generation, deep learning, diffusion models, wavelet transform, Mamba I.