mlsanityData to 13 Oct 2026

SqueezeComposer: Temporal Speed-up is A Simple Trick for Long-form Music Composing

arXiv 2603.21073 ↗First posted 22 Mar 2026eess.AS cs.CL cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Composing coherent long-form music remains a significant challenge due to the complexity of modeling long-range dependencies and the prohibitive memory and computational requirements associated with lengthy audio representations. In this work, we propose a simple yet powerful trick: we assume that AI models can understand and generate time-accelerated (speeded-up) audio at rates such as 2x, 4x, or even 8x. By first generating a high-speed version of the music, we greatly reduce the temporal length and resource requirements, making it feasible to handle long-form music that would otherwise exceed memory or computational limits. The generated audio is then restored to its original speed, recovering the full temporal structure. This temporal speed-up and slow-down strategy naturally follows the principle of hierarchical generation from abstract to detailed content, and can be conveniently applied to existing music generation models to enable long-form music generation. We instantiate this idea in SqueezeComposer, a framework that employs diffusion models for generation in the accelerated domain and refinement in the restored domain. We validate the effectiveness of this approach on two tasks: long-form music generation, which evaluates temporal-wise control (including continuation, completion, and generation from scratch), and whole-song singing accompaniment generation, which evaluates track-wise control. Experimental results demonstrate that our simple temporal speed-up trick enables efficient, scalable, and high-quality long-form music generation. Audio samples are available at https://SqueezeComposer.github.io/.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

49 of 56 references.

References · 49

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
  2. 2017Neural Discrete Representation Learningcited by 4,680
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,658
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,440
  5. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,148
  6. 2021SoundStream: An End-to-End Neural Audio Codeccited by 762
  7. 2016CNN Architectures for Large-Scale Audio Classificationcited by 702
  8. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 613
  9. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 602
  10. 2020Jukebox: A Generative Model for Musiccited by 537
  11. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 427
  12. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 353
37 more
  1. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  2. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 250
  3. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 211
  4. 2018Music Transformercited by 209
  5. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 180
  6. 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 177
  7. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  8. 2021Symbolic Music Generation with Diffusion Modelscited by 152
  9. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 152
  10. 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
  11. 2022Hybrid Transformers for Music Source Separationcited by 134
  12. 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 134
  13. 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
  14. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
  15. 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
  16. 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
  17. 2023Adapting Frechet Audio Distance for Generative Music Evaluationcited by 92
  18. 2024Long-form music generation with latent diffusioncited by 89
  19. 2024Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Modelcited by 71
  20. 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 66
  21. 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
  22. 2023SingSong: Generating musical accompaniments from singingcited by 55
  23. 2022Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generationcited by 48
  24. 2023AudioDec: An Open-source Streaming High-fidelity Neural Audio Codeccited by 47
  25. 2024SNAC: Multi-Scale Neural Audio Codeccited by 43
  26. 2024Audio Mamba: Bidirectional State Space Model for Audio Representation Learningcited by 36
  27. 2024TS3-Codec: Transformer-Based Simple Streaming Single Codeccited by 25
  28. 2023ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Modelscited by 15
  29. 2024Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformerscited by 10
  30. 2025UniCodec: Unified Audio Codec with Single Domain-Adaptive Codebookcited by 10
  31. 2023EnCodecMAE: Leveraging neural codecs for universal audio representation learningcited by 9
  32. 2024MuCodec: Ultra Low-Bitrate Music Codeccited by 9
  33. 2024FastSAG: Towards Fast Non-Autoregressive Singing Accompaniment Generationcited by 5
  34. 2024Multi-Source Music Generation with Latent Diffusioncited by 4
  35. 2025Exploring State-Space-Model based Language Model in Music Generationcited by 2
  36. 2025MBCodec:Thorough disentangle for high-fidelity audio compressioncited by 2
  37. 2025SwitchCodec: A High-Fidelity Nerual Audio Codec With Sparse Quantizationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023JEN-1 Composer: A Unified Framework for High-Fidelity Multi-Track Music Generation
  2. 2025MusicWeaver: Programmable Long-Form Music Generation with Provably Local Editing ↗
  3. 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinement
  4. 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion
  5. 2026Towards Real-Time Human-AI Musical Co-Performance: Accompaniment Generation with Latent Diffusion Models and MAX/MSP
  6. 2025ProGress: Structured Music Generation via Graph Diffusion and Hierarchical Music Analysis
  7. 2025SAMUeL: Efficient Vocal-Conditioned Music Generation via Soft Alignment Attention and Latent Diffusion
  8. 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation