mlsanityData to 7 Oct 2026

ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation

arXiv 2602.00744 ↗First posted 31 Jan 2026cs.SDcited by 22

Not on the map. Why?

Abstract (arXiv)

We present ACE-Step v1.5, a highly efficient open-source music foundation model that brings commercial-grade generation to consumer hardware. On commonly used evaluation metrics, ACE-Step v1.5 achieves quality beyond most commercial music models while remaining extremely fast -- under 2 seconds per full song on an A100 and under 10 seconds on an RTX 3090. The model runs locally with less than 4GB of VRAM, and supports lightweight personalization: users can train a LoRA from just a few songs to capture their own style. At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprints -- scaling from short loops to 10-minute compositions -- while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilities -- such as cover generation, repainting, and vocal-to-BGM conversion -- while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. The code, the model weights and the demo are available at: https://ace-step.github.io/ace-step-v1.5.github.io/

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Jan 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 22.

22 papers.

Sort:

By area:

  1. 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessmentcited by 6
  2. 2026Stable Audio 3cited by 5
  3. 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Trainingcited by 4
  4. 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 2
  5. 2026SAME: A Semantically-Aligned Music Autoencodercited by 2
  6. 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Musiccited by 1
  7. 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidancecited by 1
  8. 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Renderingcited by 1
  9. 2026StepAudio 3 Music Technical Reportcited by 1
  10. 2026S2Accompanist: A Semantic-Aware and Structure-Guided Diffusion Model for Music Accompaniment Generationcited by 0
  11. 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
  12. 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modelingcited by 0
10 more
  1. 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
  2. 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
  3. 2026Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillationcited by 0
  4. 2026WanSong v1.0 Technical Reportcited by 0
  5. 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Modelscited by 0
  6. 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generationcited by 0
  7. 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generationcited by 0
  8. 2026Ghost in the Encoder: Decodable Artist Identity Representations in Lyrics-to-Song Generationcited by 0
  9. 2026Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generationcited by 0
  10. 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intentcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ACE-Step: A Step Towards Music Generation Foundation Model
  2. 2024MusicRL: Aligning Music Generation to Human Preferences
  3. 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation
  4. 2026Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
  5. 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusion
  6. 2025JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment
  7. 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matching
  8. 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation