mlsanityData to 14 Oct 2026

AV-FlowEdit: Training-Free Prompt-Driven Audio-Visual Editing with Event-Aware Spectral Trajectory Preservation

arXiv 2610.13072 ↗First posted 9 Oct 2026cs.SD cs.CV eess.AScited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Joint audio-video diffusion models generate synchronized content, but editing existing clips requires target changes without disrupting non-target structure or cross-modal correspondence. We present AV-FlowEdit, a training-free and inversion-free framework for prompt-driven audio-video editing. Our key insight is that source--target flow differences provide both cross-modal editing directions and preservation cues. Under shared perturbations, they jointly update the video and audio branches, supporting visual-only, audio-only, and joint edits while retaining pretrained cross-modal interactions. To suppress drift accumulated during sampling, Cross-Modal Event-Aware Spectral Trajectory Preservation combines flow saliency, aligned audio activity, multiscale low-frequency displacement, and diffusion-stage scheduling. This adaptively preserves unsupported regions while allowing intended audio-visual events. AV-FlowEdit requires no model training, external masks, or optimization-based inversion. Experiments show strong prompt alignment and temporal consistency, together with competitive audio quality and cross-modal coherence.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 30 of its 37 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

30 of 37 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026LTX-2: Efficient Joint Audio-Visual Foundation Model6 Jan
  2. 2024A Simple but Strong Baseline for Sounding Video Generation: Effective Adaptation of Audio and Video Diffusion Models for Joint Generation26 Sep
  3. 2024AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation11 Jun
  4. 2024A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation22 May
  5. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion15 Feb
  6. 2022MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation19 Dec

Other references · 24

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
  8. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  9. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  10. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  11. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  12. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
12 more
  1. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  2. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  3. 2023Edit-A-Video: Single Video Editing with Object-Aware Consistencycited by 67
  4. 2025FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editingcited by 32
  5. 2025VABench: A Comprehensive Benchmark for Audio-Video Generationcited by 30
  6. 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 26
  7. 2024STA-V2A: Video-to-Audio Generation with Semantic and Temporal Alignmentcited by 21
  8. 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 14
  9. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  10. 2026Omni2Sound: Towards Unified Video-Text-to-Audio Generationcited by 11
  11. 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenescited by 8
  12. 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Audio-Guided Visual Editing with Complex Multi-Modal Prompts
  2. 2025AV-Edit: Multimodal Generative Sound Effect Editing via Audio-Visual Semantic Joint Control
  3. 2024Language-Guided Joint Audio-Visual Editing via One-Shot Adaptation
  4. 2026Sound Sparks Motion: Audio and Text Tuning for Video Editing
  5. 2023Soundini: Sound-Guided Diffusion for Natural Video Editing
  6. 2024AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation
  7. 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformers
  8. 2025Training-Free Multimodal Guidance for Video to Audio Generation