AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities
Not on the map. Why?
Abstract (arXiv)
While instruction-based video editing has advanced rapidly, real-world videos contain tightly coupled audio and visual signals, and editing one modality often requires coordinated changes in the other. Existing benchmarks primarily evaluate visual transformations on silent clips or isolated audio editing, leaving complex audio-visual editing and cross-modal consistency underexplored. We introduce AVE-Compass, a comprehensive benchmark with 145 curated source videos, 196 audio-visually coupled editing instructions, and 2,688 fine-grained checklist items. It evaluates Instruction Following, Fidelity Preserving, Realism, and Editing Intent through checklist-based MLLM judging and a dedicated realism rubric, complemented by automated cross-modal, video, and audio metrics. Extensive evaluation shows that state-of-the-art models still struggle to execute cross-modal instructions while preserving non-target content. We further propose AVE-Agent, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback. AVE-Agent improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining competitive perceptual quality.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 96 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
42 of 96 references.
References · 42
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
- 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 648
- 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
30 more
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 83
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
- 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
- 2023Separate Anything You Describecited by 43
- 2025SAM Audio: Segment Anything in Audiocited by 30
- 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 28
- 2025T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generationcited by 24
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
- 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 14
- 2025Object-AVEdit: An Object-level Audio-Visual Editing Modelcited by 14
- 2024PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scorescited by 13
- 2026UniVBench: Towards Unified Evaluation for Video Foundation Modelscited by 13
- 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Modelscited by 11
- 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
- 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
- 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Editscited by 7
- 2025UniSync: A Unified Framework for Audio-Visual Synchronizationcited by 6
- 2025Schrodinger Audio-Visual Editor: Object-Level Audiovisual Removalcited by 4
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
- 2026CoVEBench: Can Video Editing Models Handle Complex Instructions?cited by 3
- 2025Towards Automatic Evaluation and High-Quality Pseudo-Parallel Dataset Construction for Audio Editing: A Human-in-the-Loop Methodcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing
- 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation
- 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
- 2026MMAE: A Massive Multitask Audio Editing Benchmark
- 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing
- 2026AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation
- 2025Guiding Audio Editing with Audio Language Model
- 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing