mlsanityData to 14 Oct 2026

AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities

arXiv 2607.24821 ↗First posted 17 Jul 2026cs.MM cs.CV cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

While instruction-based video editing has advanced rapidly, real-world videos contain tightly coupled audio and visual signals, and editing one modality often requires coordinated changes in the other. Existing benchmarks primarily evaluate visual transformations on silent clips or isolated audio editing, leaving complex audio-visual editing and cross-modal consistency underexplored. We introduce AVE-Compass, a comprehensive benchmark with 145 curated source videos, 196 audio-visually coupled editing instructions, and 2,688 fine-grained checklist items. It evaluates Instruction Following, Fidelity Preserving, Realism, and Editing Intent through checklist-based MLLM judging and a dedicated realism rubric, complemented by automated cross-modal, video, and audio metrics. Extensive evaluation shows that state-of-the-art models still struggle to execute cross-modal instructions while preserving non-target content. We further propose AVE-Agent, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback. AVE-Agent improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining competitive perceptual quality.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 42 of its 96 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

42 of 96 references.

References · 42

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  9. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  10. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 648
  11. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  12. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
30 more
  1. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  2. 2025VACE: All-in-One Video Creation and Editingcited by 479
  3. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  4. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  5. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  6. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  7. 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
  8. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  9. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 83
  10. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  11. 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 59
  12. 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
  13. 2023Separate Anything You Describecited by 43
  14. 2025SAM Audio: Segment Anything in Audiocited by 30
  15. 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 28
  16. 2025T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generationcited by 24
  17. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Modelscited by 16
  18. 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 14
  19. 2025Object-AVEdit: An Object-level Audio-Visual Editing Modelcited by 14
  20. 2024PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scorescited by 13
  21. 2026UniVBench: Towards Unified Evaluation for Video Foundation Modelscited by 13
  22. 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Modelscited by 11
  23. 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 11
  24. 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
  25. 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Editscited by 7
  26. 2025UniSync: A Unified Framework for Audio-Visual Synchronizationcited by 6
  27. 2025Schrodinger Audio-Visual Editor: Object-Level Audiovisual Removalcited by 4
  28. 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
  29. 2026CoVEBench: Can Video Editing Models Handle Complex Instructions?cited by 3
  30. 2025Towards Automatic Evaluation and High-Quality Pseudo-Parallel Dataset Construction for Audio Editing: A Human-in-the-Loop Methodcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing
  2. 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation
  3. 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
  4. 2026MMAE: A Massive Multitask Audio Editing Benchmark
  5. 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing
  6. 2026AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation
  7. 2025Guiding Audio Editing with Audio Language Model
  8. 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing