mlsanityData to 7 Oct 2026

SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation

arXiv 2603.01101 ↗First posted 1 Mar 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-track music generation has garnered significant research interest due to its precise mixing and remixing capabilities. However, existing models often overlook essential attributes such as rhythmic stability and synchronization, leading to a focus on differences between tracks rather than their inherent properties. In this paper, we introduce SyncTrack, a synchronous multi-track waveform music generation model designed to capture the unique characteristics of multi-track music. SyncTrack features a novel architecture that includes track-shared modules to establish a common rhythm across all tracks and track-specific modules to accommodate diverse timbres and pitch ranges. Each track-shared module employs two cross-track attention mechanisms to synchronize rhythmic information, while each track-specific module utilizes learnable instrument priors to better represent timbre and other unique features. Additionally, we enhance the evaluation of multi-track music quality by introducing rhythmic consistency through three novel metrics: Inner-track Rhythmic Stability (IRS), Cross-track Beat Synchronization (CBS), and Cross-track Beat Dispersion (CBD). Experiments demonstrate that SyncTrack significantly improves the multi-track music quality by enhancing rhythmic consistency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 1 Mar 2026.

Builds on

36 of 52 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  7. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  9. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  10. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
  11. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  12. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
24 more
  1. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
  2. 2024Stable Audio Opencited by 192
  3. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  4. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
  5. 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
  6. 2016SampleRNN: An Unconditional End-to-End Neural Audio Generation Modelcited by 110
  7. 2023MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup Strategiescited by 94
  8. 2024Long-form music generation with latent diffusioncited by 88
  9. 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
  10. 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
  11. 2025A Comprehensive Survey of Deep Learning for Multivariate Time Series Forecasting: A Channel Strategy Perspectivecited by 58
  12. 2023SingSong: Generating musical accompaniments from singingcited by 54
  13. 2022Museformer: Transformer with Fine- and Coarse-Grained Attention for Music Generationcited by 48
  14. 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 39
  15. 2023StemGen: A music generation model that listenscited by 32
  16. 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
  17. 2025SongEval: A Benchmark Dataset for Song Aesthetics Evaluationcited by 24
  18. 2024Diff-BGM: A Diffusion Model for Video Background Music Generationcited by 22
  19. 2023Long-Term Rhythmic Video Soundtrackercited by 17
  20. 2023JEN-1 Composer: A Unified Framework for High-Fidelity Multi-Track Music Generationcited by 17
  21. 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
  22. 2025Synchronized Video-to-Audio Generation via Mel Quantization-Continuum Decompositioncited by 10
  23. 2024VidMusician: Video-to-Music Generation with Semantic-Rhythmic Alignment via Hierarchical Visual Featurescited by 9
  24. 2022And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?cited by 3

Built on by

Not cited yet.