Seed-Music: A Unified Framework for High Quality and Controlled Music Generation
Not on the map. Why?
Abstract (arXiv)
We introduce Seed-Music, a suite of music generation systems capable of producing high-quality music with fine-grained style control. Our unified framework leverages both auto-regressive language modeling and diffusion approaches to support two key music creation workflows: controlled music generation and post-production editing. For controlled music generation, our system enables vocal music generation with performance controls from multi-modal inputs, including style descriptions, audio references, musical scores, and voice prompts. For post-production editing, it offers interactive tools for editing lyrics and vocal melodies directly in the generated audio. We encourage readers to listen to demo audio examples at https://team.doubao.com/seed-music "https://team.doubao.com/seed-music".
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 9.
21 papers.
Sort:
By area:
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 23
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 13
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformerscited by 11
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generationcited by 10
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectivescited by 4
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generationcited by 2
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generationcited by 1
- 2026Evaluating Disentangled Representations for Controllable Music Generationcited by 1
- 2026Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generationcited by 1
- 2026StepAudio 3 Music Technical Reportcited by 1
9 more
- 2025Mozualization: Crafting Music and Visual Representation with Multimodal AIcited by 0
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separationcited by 0
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspectivecited by 0
- 2026LaDA-Band: Language Diffusion Models for Vocal-to-Accompaniment Generationcited by 0
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraintscited by 0
- 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitionscited by 0
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modelingcited by 0
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokenscited by 0
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generationcited by 0
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generation10 Aug 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions1 Jun 2026
- 2026Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generation29 May 2026
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints20 Apr 2026
- 2026LaDA-Band: Language Diffusion Models for Vocal-to-Accompaniment Generation13 Apr 2026
- 2026Evaluating Disentangled Representations for Controllable Music Generation10 Feb 2026
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation19 Sep 2025
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation22 Aug 2025
9 more
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generation7 Aug 2025
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation10 Jun 2025
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment9 Jun 2025
- 2025Mozualization: Crafting Music and Visual Representation with Multimodal AI5 Apr 2025
- 2025A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives1 Apr 2025
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generation25 Mar 2025
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion3 Mar 2025
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation28 Feb 2025
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformers30 Oct 2024
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformerscited by 11
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generationcited by 10
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generationcited by 2
- 2026StepAudio 3 Music Technical Reportcited by 1
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspectivecited by 0
- 2026LaDA-Band: Language Diffusion Models for Vocal-to-Accompaniment Generationcited by 0
- 2026StepAudio 3 Music Technical Report11 Sep 2026
- 2026LaDA-Band: Language Diffusion Models for Vocal-to-Accompaniment Generation13 Apr 2026
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation10 Jun 2025
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusion3 Mar 2025
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation28 Feb 2025
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformers30 Oct 2024
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 23
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generationcited by 1
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraintscited by 0
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints20 Apr 2026
- 2025Towards Hallucination-Free Music: A Reinforcement Learning Preference Optimization Framework for Reliable Song Generation7 Aug 2025
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment9 Jun 2025
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 13
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectivescited by 4
- 2026Evaluating Disentangled Representations for Controllable Music Generationcited by 1
- 2026Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generationcited by 1
- 2025Mozualization: Crafting Music and Visual Representation with Multimodal AIcited by 0
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separationcited by 0
- 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitionscited by 0
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modelingcited by 0
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokenscited by 0
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generationcited by 0
- 2026MusicLayout: Explicit Structural Planning for Controllable Text-to-Music Generation10 Aug 2026
- 2026Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens31 Jul 2026
- 2026SketchSong: Hierarchical Song Generation with Sketch Planning and Fine-Grained Multi-Track Modeling2 Jun 2026
- 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions1 Jun 2026
- 2026Latent Space Disentanglement via Activation Steering for Interpretable Attribute Control in Symbolic Music Generation29 May 2026
- 2026Evaluating Disentangled Representations for Controllable Music Generation10 Feb 2026
- 2025TISDiSS: A Training-Time and Inference-Time Scalable Framework for Discriminative Source Separation19 Sep 2025
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation22 Aug 2025
- 2025Mozualization: Crafting Music and Visual Representation with Multimodal AI5 Apr 2025
- 2025A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives1 Apr 2025
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generation25 Mar 2025