SqueezeComposer: Temporal Speed-up is A Simple Trick for Long-form Music Composing
Not on the map. Why?
Abstract (arXiv)
Composing coherent long-form music remains a significant challenge due to the complexity of modeling long-range dependencies and the prohibitive memory and computational requirements associated with lengthy audio representations. In this work, we propose a simple yet powerful trick: we assume that AI models can understand and generate time-accelerated (speeded-up) audio at rates such as 2x, 4x, or even 8x. By first generating a high-speed version of the music, we greatly reduce the temporal length and resource requirements, making it feasible to handle long-form music that would otherwise exceed memory or computational limits. The generated audio is then restored to its original speed, recovering the full temporal structure. This temporal speed-up and slow-down strategy naturally follows the principle of hierarchical generation from abstract to detailed content, and can be conveniently applied to existing music generation models to enable long-form music generation. We instantiate this idea in SqueezeComposer, a framework that employs diffusion models for generation in the accelerated domain and refinement in the restored domain. We validate the effectiveness of this approach on two tasks: long-form music generation, which evaluates temporal-wise control (including continuation, completion, and generation from scratch), and whole-song singing accompaniment generation, which evaluates track-wise control. Experimental results demonstrate that our simple temporal speed-up trick enables efficient, scalable, and high-quality long-form music generation. Audio samples are available at https://SqueezeComposer.github.io/.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 22 Mar 2026.
Builds on
49 of 56 references.
References · 49
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2017Neural Discrete Representation Learningcited by 4,680
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,440
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,148
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 702
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 613
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 602
- 2020Jukebox: A Generative Model for Musiccited by 537
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 427
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 353
37 more
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 250
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 211
- 2018Music Transformercited by 209
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 180
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 177
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2021Symbolic Music Generation with Diffusion Modelscited by 152
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 152
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2022Hybrid Transformers for Music Source Separationcited by 134
- 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 134
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
- 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
- 2024Long-form music generation with latent diffusioncited by 89
- 2024Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Modelcited by 71
- 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 66
- 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
- 2023SingSong: Generating musical accompaniments from singingcited by 55
- 2022Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generationcited by 48
- 2023AudioDec: An Open-source Streaming High-fidelity Neural Audio Codeccited by 47
- 2024SNAC: Multi-Scale Neural Audio Codeccited by 43
- 2024Audio Mamba: Bidirectional State Space Model for Audio Representation Learningcited by 36
- 2024TS3-Codec: Transformer-Based Simple Streaming Single Codeccited by 25
- 2023ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Modelscited by 15
- 2024Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformerscited by 10
- 2025UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebookcited by 10
- 2023EnCodecMAE: Leveraging neural codecs for universal audio representation learningcited by 9
- 2024MuCodec: Ultra Low-Bitrate Music Codeccited by 9
- 2024FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generationcited by 5
- 2024Multi-Source Music Generation with Latent Diffusioncited by 4
- 2025Exploring State-Space-Model based Language Model in Music Generationcited by 2
- 2025MBCodec:Thorough disentangle for high-fidelity audio compressioncited by 2
- 2025SwitchCodec: A High-Fidelity Nerual Audio Codec With Sparse Quantizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023JEN-1 Composer: A Unified Framework for High-Fidelity Multi-Track Music Generation
- 2025MusicWeaver: Programmable Long-Form Music Generation with Provably Local Editing ↗
- 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion
- 2026Towards Real-Time Human-AI Musical Co-Performance: Accompaniment Generation with Latent Diffusion Models and MAX/MSP
- 2025ProGress: Structured Music Generation via Graph Diffusion and Hierarchical Music Analysis
- 2025SAMUeL: Efficient Vocal-Conditioned Music Generation via Soft Alignment Attention and Latent Diffusion
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation