Dasheng AudioGen: A Unified Model for Generating Coherent Audio Scenes from Text
Not on the map. Why?
Abstract (arXiv)
Audio generation has long been fragmented, with speech, music, and sound effects produced by domain-specific models that fail to jointly generate coherent audio scenes from a single description. The key obstacles are insufficient fine-grained supervision for real-world mixed audio and limited acoustic representations for modeling concurrent audio components. We present Dasheng AudioGen, a unified framework for generating general mixed-audio scenes from text. Dasheng AudioGen introduces structured multi-view captions, which explicitly decouple complex acoustic scenes into complementary description views, thereby enabling fine-grained control over audio layers. Furthermore, we employ a high-dimensional unified semantic-acoustic representation as the shared latent space. It injects semantic priors that facilitate cross-modal training convergence, while its high-dimensional feature space provides sufficient capacity to disentangle and fuse concurrent audio components effectively. With these designs, a simple flow-matching DiT achieves high-quality end-to-end audio scene generation. We also establish a comprehensive evaluation pipeline for audio scene generation. Experiments demonstrate that Dasheng AudioGen achieves performance approaching real-world recordings in mixed-audio categories, while remaining competitive with specialized models in single-type generation tasks. Demos are available at https://nieeim.github.io/Dasheng-AudioGen-Web/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 May 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generationcited by 1
- 2026AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluationcited by 0
- 2026SonicWeave: Chunk-Routed Mixture-of-Experts for Unified Audio Scene Generationcited by 0
- 2026MiDashengLM-Gen: Unified Audio Scene Generation via LLM-Driven Autoregressive Flow Matchingcited by 0
- 2026VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matchingcited by 0
- 2026VoxAudio: Vocalized Audio Synthesis via Multi-Reward Autoregressive Flow Matching13 Aug 2026
- 2026MiDashengLM-Gen: Unified Audio Scene Generation via LLM-Driven Autoregressive Flow Matching12 Aug 2026
- 2026SonicWeave: Chunk-Routed Mixture-of-Experts for Unified Audio Scene Generation10 Aug 2026
- 2026AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation5 Aug 2026
- 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026UAT: Unified Audio-Text Diffusion for Audio Generation, Editing, and Captioning
- 2026SemanticAudio: Audio Generation and Editing in Semantic Space
- 2023Align, Adapt and Inject: Sound-guided Unified Image Generation
- 2026Qwen-Audio-3.0-Gen-Preview Technical Report
- 2026AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation ↗
- 2026Soundwich: Video Generation with Layered and Controllable Audio
- 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
- 2025Seeing Sound: Assembling Sounds from Visuals for Audio-to-Image Generation