mlsanityData to 14 Oct 2026

Dasheng AudioGen: A Unified Model for Generating Coherent Audio Scenes from Text

arXiv 2605.27838 ↗First posted 27 May 2026cs.SDcited by 5

Not on the map. Why?

Abstract (arXiv)

Audio generation has long been fragmented, with speech, music, and sound effects produced by domain-specific models that fail to jointly generate coherent audio scenes from a single description. The key obstacles are insufficient fine-grained supervision for real-world mixed audio and limited acoustic representations for modeling concurrent audio components. We present Dasheng AudioGen, a unified framework for generating general mixed-audio scenes from text. Dasheng AudioGen introduces structured multi-view captions, which explicitly decouple complex acoustic scenes into complementary description views, thereby enabling fine-grained control over audio layers. Furthermore, we employ a high-dimensional unified semantic-acoustic representation as the shared latent space. It injects semantic priors that facilitate cross-modal training convergence, while its high-dimensional feature space provides sufficient capacity to disentangle and fuse concurrent audio components effectively. With these designs, a simple flow-matching DiT achieves high-quality end-to-end audio scene generation. We also establish a comprehensive evaluation pipeline for audio scene generation. Experiments demonstrate that Dasheng AudioGen achieves performance approaching real-world recordings in mixed-audio categories, while remaining competitive with specialized models in single-type generation tasks. Demos are available at https://nieeim.github.io/Dasheng-AudioGen-Web/.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 May 2026.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026UAT: Unified Audio-Text Diffusion for Audio Generation, Editing, and Captioning
  2. 2026SemanticAudio: Audio Generation and Editing in Semantic Space
  3. 2023Align, Adapt and Inject: Sound-guided Unified Image Generation
  4. 2026Qwen-Audio-3.0-Gen-Preview Technical Report
  5. 2026AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation ↗
  6. 2026Soundwich: Video Generation with Layered and Controllable Audio
  7. 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation
  8. 2025Seeing Sound: Assembling Sounds from Visuals for Audio-to-Image Generation