AudioScape-TTA: A Structured Soundscape Benchmark for Fine-Grained Text-to-Audio Evaluation
Not on the map. Why?
Abstract (arXiv)
Text-to-audio (TTA) generation has recently achieved remarkable progress in synthesizing realistic audio from natural language descriptions. However, determining whether generated audio faithfully satisfies complex textual instructions remains challenging. Existing benchmarks mainly rely on global similarity metrics, providing limited insight into fine-grained semantic failures. To address this limitation, we introduce AudioScape-TTA, a structured and complexity-aware benchmark for fine-grained TTA evaluation. AudioScape-TTA represents realistic soundscapes through modality-aware semantic structures and characterizes generation complexity using event density and structural complexity. Based on these annotations, we propose a rubric-based audio-grounded evaluation framework that verifies event realization, acoustic attributes, and speech content through fine-grained semantic criteria. The benchmark contains 2,258 audio-text pairs with 25,707 binary QA rubrics, enabling scalable and interpretable analysis of TTA systems. Experiments on 13 representative open-source TTA models reveal persistent limitations in fine-grained attribute control, speech-content preservation, and compositional soundscape generation. Human validation further demonstrates that our rubric-based evaluation achieves stronger alignment with human semantic judgments than conventional global similarity metrics.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 29 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
23 of 29 references.
References · 23
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2025Qwen3-Omni Technical Reportcited by 451
- 2019Clotho: An Audio Captioning Datasetcited by 354
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
- 2023UniAudio: An Audio Foundation Model Toward Universal Audio Generationcited by 127
- 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
- 2026Qwen3-ASR Technical Reportcited by 105
- 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generationcited by 90
- 2024TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimizationcited by 67
- 2023Natural Language Supervision for General-Purpose Audio Representationscited by 60
- 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generationcited by 54
- 2024EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformercited by 30
11 more
- 2024AudioTime: A Temporally-aligned Audio-text Benchmark Datasetcited by 19
- 2024VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generationcited by 16
- 2025MeanAudio: Fast and Faithful Text-to-Audio Generation with Mean Flowscited by 14
- 2026Omni2Sound: Towards Unified Video-Text-to-Audio Generationcited by 8
- 2026AQAScore: Evaluating Semantic Alignment in Text-to-Audio Generation via Audio Question Answeringcited by 8
- 2025TTA-Bench: A Comprehensive Benchmark for Evaluating Text-to-Audio Modelscited by 7
- 2025T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedbackcited by 6
- 2026Dasheng AudioGen: A Unified Model for Generating Coherent Audio Scenes from Textcited by 5
- 2024RiTTA: Modeling Event Relations in Text-to-Audio Generationcited by 3
- 2026AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Followingcited by 3
- 2026Foley-Omni: A Unified Multimodal Generation Model from Task-Level Audio Synthesis to Complete Video Soundtrack Generationcited by 3
Built on by
Not cited yet.