YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality
Not on the map. Why?
Abstract (arXiv)
Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs while leaving composition implicit. We introduce YuE2, which unifies symbolic and audio music generation at frontier quality through symbolic planning. A single AR-NAR Mixture-of-Transformers (MoT) first writes a readable score specifying melody and harmony, expands it into semantic music tokens, and realizes it as full-song audio. In comparisons using the same checkpoint, experts prefer symbolic planning for overall quality and musicality, with 49.3% of overall preferences versus 34.6% without planning. Experts also favor the unified model over a separate language model and diffusion Transformer. On WildSongBench, YuE2 scores 6.73 on SongBench Global Avg, exceeding all evaluated public baselines. Selecting from eight candidates (best-of-8), YuE2 reaches 6.96, the highest observed mean among all evaluated systems. Expert listening further establishes its competitiveness with proprietary song generators, favoring best-of-8 over Suno v4.5 and yielding nearly balanced preferences against Suno v5. To learn this generation process from recordings without aligned scores, we introduce MERT2 and SheetSage2 to supply semantic and symbolic supervision. MERT2 sets a new state of the art in music representation learning, surpassing previous best results on 14 of 15 MARBLE metrics; SheetSage2 leads 12 of 15 benchmark-metric pairs in our lead-sheet transcription comparison. The same checkpoint follows score edits while largely preserving unedited musical content and generates zero-shot covers without cover-specific training. Its readable score also enables agentic music editing, with external language models translating user feedback into revisions of the composition.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 91 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
48 of 91 references.
References · 48
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2017Neural Discrete Representation Learningcited by 4,712
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2022A ConvNet for the 2020scited by 3,579
- 2020GLU Variants Improve Transformercited by 1,804
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2024Qwen2-Audio Technical Reportcited by 560
- 2025Qwen3-Omni Technical Reportcited by 497
- 2023Simple and Controllable Music Generationcited by 488
36 more
- 2023MusicLM: Generating Music From Textcited by 448
- 2024The Platonic Representation Hypothesiscited by 382
- 2018Music Transformercited by 211
- 2024Stable Audio Opencited by 197
- 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 137
- 2026Qwen3-ASR Technical Reportcited by 118
- 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 83
- 2021MT3: Multi-Task Multitrack Music Transcriptioncited by 71
- 2025YuE: Scaling Open Foundation Models for Long-Form Music Generationcited by 71
- 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 68
- 2021MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modelingcited by 32
- 2024Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generationcited by 28
- 2025SongEval: A Benchmark Dataset for Song Aesthetics Evaluationcited by 26
- 2026ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generationcited by 26
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 25
- 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 23
- 2024Seed-Music: A Unified Framework for High Quality and Controlled Music Generationcited by 22
- 2025SongFormer: Scaling Music Structure Analysis with Heterogeneous Supervisioncited by 16
- 2024MusicFlow: Cascaded Flow Matching for Text Guided Music Generationcited by 15
- 2025DiffRhythm 2: Efficient and High Fidelity Song Generation via Block Flow Matchingcited by 15
- 2026HeartMuLa: A Family of Open Sourced Music Foundation Modelscited by 15
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 14
- 2025SPEAR: A Unified SSL Framework for Learning Speech and Audio Representationscited by 10
- 2025Supervised contrastive learning from weakly-labeled audio segments for musical version matchingcited by 8
- 2026SongBench: A Fine-Grained Multi-Aspect Benchmark for Song Quality Assessmentcited by 7
- 2025MATPAC++: Enhanced Masked Latent Prediction for Self-Supervised Audio Representation Learningcited by 6
- 2026LeVo 2: Stable and Melodious Song Generation via Hierarchical Representation Modeling and Progressive Post-Trainingcited by 6
- 2024SymPAC: Scalable Symbolic Music Generation With Prompts And Constraintscited by 5
- 2024Discogs-VI: A Musical Version Identification Dataset Based on Public Editorial Metadatacited by 5
- 2026Qwen-Music Technical Reportcited by 5
- 2026Pushing the Frontier of Full-Song Generation: Hierarchical Autoregressive Planning Meets Flow-Matching Renderingcited by 4
- 2025Via Score to Performance: Efficient Human-Controllable Long Song Generation with Bar-Level Symbolic Notationcited by 3
- 2026SongEcho: Towards Cover Song Generation via Instance-Adaptive Element-wise Linear Modulationcited by 3
- 2025ChordFormer: A Conformer-Based Architecture for Large-Vocabulary Audio Chord Recognitioncited by 2
- 2026Frequency-Aware Self-Supervised Music Representation Learningcited by 1
- 2026AllMusicCaps: Album Reviews as Complementary Supervision for Music CLAPcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SAGE-Music: Low-Latency Symbolic Music Generation via Attribute-Specialized Key-Value Head Sharing
- 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generation
- 2026Verifier-Guided Twelve-Tone Composition: A Generate-Verify-Repair Harness for Symbolic Music Generation
- 2024Efficient Fine-Grained Guidance for Diffusion Model Based Symbolic Music Generation
- 2026Efficient Long-Sequence Diffusion Modeling for Symbolic Music Generation
- 2024Whole-Song Hierarchical Generation of Symbolic Music Using Cascaded Diffusion Models
- 2026High-Fidelity Song Generation with Joint Discrete and Continuous Modeling ↗
- 2026How Far Can Pretrained LLMs Go in Symbolic Music? Controlled Comparisons of Supervised and Preference-based Adaptation