mlsanityData to 14 Oct 2026

ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment

arXiv 2509.17818 ↗First posted 22 Sep 2025cs.CVcited by 27

On the map: Diffusion models → Video generation

Abstract (arXiv)

Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion. However, it faces significant challenges in maintaining fidelity and temporal consistency. Existing methods, often designed for U-Net architectures, suffer from two primary limitations: inaccurate inversion due to first-order solvers, and contextual conflicts caused by crude "hard" feature replacement. These issues are more challenging in Diffusion Transformers (DiTs), where the unsuitability of prior layer-selection heuristics makes effective guidance challenging. To address these limitations, we introduce ContextFlow, a novel training-free framework for DiT-based video object editing. In detail, we first employ a high-order Rectified Flow solver to establish a robust editing foundation. The core of our framework is Adaptive Context Enrichment (for specifying what to edit), a mechanism that addresses contextual conflicts. Instead of replacing features, it enriches the self-attention context by concatenating Key-Value pairs from parallel reconstruction and editing paths, empowering the model to dynamically fuse information. Additionally, to determine where to apply this enrichment (for specifying where to edit), we propose a systematic, data-driven analysis to identify task-specific vital layers. Based on a novel Guidance Responsiveness Metric, our method pinpoints the most influential DiT blocks for different tasks (e.g., insertion, swapping), enabling targeted and highly effective guidance. Extensive experiments show that ContextFlow significantly outperforms existing training-free methods and even surpasses several state-of-the-art training-based approaches, delivering temporally coherent, high-fidelity results.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 85 of its 104 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

85 of 104 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025Consistent Video Editing as Flow-Driven Image-to-Video Generation9 Jun
  2. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun
  3. 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers4 Jun
  4. 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models4 Apr
  5. 2025VACE: All-in-One Video Creation and Editing10 Mar
  6. 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformers10 Feb
  7. 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
  8. 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses30 Nov
  9. 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
  10. 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
  11. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models26 May
  12. 2024ReVideo: Remake a Video with Motion and Content Control22 May
6 more
  1. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
  2. 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
  3. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
  4. 2023AnyDoor: Zero-shot Object-level Image Customization18 Jul
  5. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
  6. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec

Other references · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  8. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  9. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  10. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  11. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  12. 2022Diffusion models as plug-and-play priorscited by 231
38 more
  1. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  2. 2024Taming Rectified Flow for Inversion and Editingcited by 204
  3. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  4. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
  5. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  6. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  7. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  8. 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 105
  9. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  10. 2025Controllable Video Generation: A Surveycited by 98
  11. 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 95
  12. 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
  13. 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
  14. 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
  15. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  16. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
  17. 2025UNIC: Unified In-Context Video Editingcited by 55
  18. 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
  19. 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
  20. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  21. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  22. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
  23. 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
  24. 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
  25. 2021Boosting Fast Adversarial Training with Learnable Adversarial Initializationcited by 40
  26. 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
  27. 2024Generative Video Propagationcited by 36
  28. 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
  29. 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
  30. 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
  31. 2024SemTalk: Holistic Co-speech Motion Generation with Frame-level Semantic Emphasiscited by 32
  32. 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 31
  33. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  34. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  35. 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
  36. 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
  37. 2023HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillationcited by 22
  38. 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 22

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 21.

27 papers.

Sort:

By area:

  1. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  2. 2025Top-Down Semantic Refinement for Image Captioningcited by 16
  3. 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
  4. 2026Group Editing: Edit Multiple Images in One Gocited by 11
  5. 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
  6. 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
  7. 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
  8. 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
  9. 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
  10. 2026Embedding-perturbed Exploration Preference Optimization for Flow Modelscited by 5
  11. 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
  12. 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
15 more
  1. 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
  2. 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
  3. 2026ResWM: Residual-Action World Model for Visual RLcited by 2
  4. 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
  5. 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesiscited by 1
  6. 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoisingcited by 1
  7. 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
  8. 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytellingcited by 1
  9. 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
  10. 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
  11. 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamicscited by 0
  12. 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
  13. 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editingcited by 0
  14. 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
  15. 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  2. 2024Stable Flow: Vital Layers for Training-Free Image Editing
  3. 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models
  4. 2024Video Editing via Factorized Diffusion Distillation
  5. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer
  6. 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
  7. 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
  8. 2026Object-Aware Background-Controlled Editing via Weighted Velocity Guidance