mlsanityData to 14 Oct 2026

JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation

arXiv 2606.03168 ↗First posted 2 Jun 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

While instruction-based video editing has seen significant progress, joint audio-visual editing remains constrained by the absence of dedicated datasets and benchmarks. To bridge this gap, we present JAVEdit-100k, the first large-scale, high-quality dataset tailored for instruction-guided joint audio-visual editing. Focusing on human-centric videos, JAVEdit-100k comprises approximately 100K editing triplets spanning five distinct categories, including subject editing and speech editing. This dataset is rigorously constructed via four meticulously designed generation pipelines, seamlessly paired with an agent-in-the-loop quality control mechanism. Furthermore, to address the lack of standardized evaluation within the field, we introduce JAVEditBench, a comprehensive benchmark featuring curated source videos and human-aligned instructions across all editing categories. Finally, we propose JAVEdit, a pioneering baseline model for instruction-guided joint audio-visual editing. Experiments show that model outperforms all baselines on five of six evaluation metrics.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 38 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

37 of 38 references.

References · 37

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2025SAM 3: Segment Anything with Conceptscited by 906
  10. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 648
  11. 2025Qwen3-Omni Technical Reportcited by 497
  12. 2025HunyuanImage 3.0 Technical Reportcited by 149
25 more
  1. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  2. 2026Qwen3-TTS Technical Reportcited by 118
  3. 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 83
  4. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  5. 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
  6. 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 62
  7. 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
  8. 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 56
  9. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  10. 2025DiP: Taming Diffusion Models in Pixel Spacecited by 48
  11. 2025HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generationcited by 46
  12. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removalcited by 45
  13. 2026MetaClaw: Just Talk -- An Agent That Meta-Learns and Evolves in the Wildcited by 37
  14. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
  15. 2025SAM Audio: Segment Anything in Audiocited by 30
  16. 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 28
  17. 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 14
  18. 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
  19. 2026L2P: Unlocking Latent Potential for Pixel Generationcited by 9
  20. 2024Mel-RoFormer for Vocal Separation and Vocal Melody Transcriptioncited by 8
  21. 2026MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learningcited by 8
  22. 2024DreamVoice: Text-Guided Voice Conversioncited by 7
  23. 2026FFP-300K: Scaling First-Frame Propagation for Generalizable Video Editingcited by 5
  24. 2025ZeroSep: Separate Anything in Audio with Zero Trainingcited by 4
  25. 2025AV-Edit: Multimodal Generative Sound Effect Editing via Audio-Visual Semantic Joint Controlcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026InstructAV2AV: Instruction-Guided Audio-Video Joint Editing
  2. 2026AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities
  3. 2026Beyond Coherence: Benchmarking Professional Editing-Technique Execution in Multi-Shot Audio-Video Generation
  4. 2026MMAE: A Massive Multitask Audio Editing Benchmark
  5. 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects
  6. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
  7. 2025Audio-Guided Visual Editing with Complex Multi-Modal Prompts
  8. 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing