ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation
Not on the map. Why?
Abstract (arXiv)
We present ACE-Step v1.5, a highly efficient open-source music foundation model that brings commercial-grade generation to consumer hardware. On commonly used evaluation metrics, ACE-Step v1.5 achieves quality beyond most commercial music models while remaining extremely fast -- under 2 seconds per full song on an A100 and under 10 seconds on an RTX 3090. The model runs locally with less than 4GB of VRAM, and supports lightweight personalization: users can train a LoRA from just a few songs to capture their own style. At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprints -- scaling from short loops to 10-minute compositions -- while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilities -- such as cover generation, repainting, and vocal-to-BGM conversion -- while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. The code, the model weights and the demo are available at: https://ace-step.github.io/ace-step-v1.5.github.io/
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Jan 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 22.
22 papers.
Sort:
By area:
- 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessmentcited by 6
- 2026Stable Audio 3cited by 5
- 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Trainingcited by 4
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 2
- 2026SAME: A Semantically-Aligned Music Autoencodercited by 2
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Musiccited by 1
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidancecited by 1
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Renderingcited by 1
- 2026StepAudio 3 Music Technical Reportcited by 1
- 2026S2Accompanist: A Semantic-Aware and Structure-Guided Diffusion Model for Music Accompaniment Generationcited by 0
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modelingcited by 0
10 more
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillationcited by 0
- 2026WanSong v1.0 Technical Reportcited by 0
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Modelscited by 0
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generationcited by 0
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generationcited by 0
- 2026Ghost in the Encoder: Decodable Artist Identity Representations in Lyrics-to-Song Generationcited by 0
- 2026Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generationcited by 0
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intentcited by 0
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent7 Oct 2026
- 2026Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generation7 Oct 2026
- 2026Ghost in the Encoder: Decodable Artist Identity Representations in Lyrics-to-Song Generation30 Sep 2026
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation11 Sep 2026
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generation10 Aug 2026
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models30 Jul 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026WanSong v1.0 Technical Report16 Jul 2026
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance13 Jul 2026
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music1 Jul 2026
- 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Training29 Jun 2026
10 more
- 2026Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillation23 Jun 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation5 Jun 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark1 Jun 2026
- 2026SAME: A Semantically-Aligned Music Autoencoder18 May 2026
- 2026Stable Audio 318 May 2026
- 2026S2Accompanist: A Semantic-Aware and Structure-Guided Diffusion Model for Music Accompaniment Generation17 May 2026
- 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessment16 Apr 2026
- 2026TADA! Tuning Audio Diffusion Models through Activation Steering12 Feb 2026
- 2026Stable Audio 3cited by 5
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 2
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidancecited by 1
- 2026StepAudio 3 Music Technical Reportcited by 1
- 2026S2Accompanist: A Semantic-Aware and Structure-Guided Diffusion Model for Music Accompaniment Generationcited by 0
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generationcited by 0
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation11 Sep 2026
- 2026Anysynth:Zero-Shot Instrument Cloning via In-Context Learning and Asymmetric Hierarchical Guidance13 Jul 2026
- 2026Stable Audio 318 May 2026
- 2026S2Accompanist: A Semantic-Aware and Structure-Guided Diffusion Model for Music Accompaniment Generation17 May 2026
- 2026TADA! Tuning Audio Diffusion Models through Activation Steering12 Feb 2026
- 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessmentcited by 6
- 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Trainingcited by 4
- 2026SAME: A Semantically-Aligned Music Autoencodercited by 2
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Musiccited by 1
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Renderingcited by 1
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modelingcited by 0
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generationcited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillationcited by 0
- 2026WanSong v1.0 Technical Reportcited by 0
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Modelscited by 0
12 most cited of 16 All 16 (JSON)
- 2026MIRA: A Musical Intent Refinement Agent for Aligning Text-to-Music Generation with User Intent7 Oct 2026
- 2026Tracing Inputs, Verifying Outputs: Validating Attribution in Music Generation7 Oct 2026
- 2026Ghost in the Encoder: Decodable Artist Identity Representations in Lyrics-to-Song Generation30 Sep 2026
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generation10 Aug 2026
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models30 Jul 2026
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Rendering22 Jul 2026
- 2026WanSong v1.0 Technical Report16 Jul 2026
- 2026What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music1 Jul 2026
- 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Training29 Jun 2026
- 2026Real-Time Interactive Music Generation via Data-Free Streaming Consistency Distillation23 Jun 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Making the Most of Limited Data: Score-Aware Training for Text-to-Music Generation5 Jun 2026
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025ACE-Step: A Step Towards Music Generation Foundation Model
- 2024MusicRL: Aligning Music Generation to Human Preferences
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation
- 2026Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
- 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusion
- 2025JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment
- 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matching
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation