ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment
On the map: Diffusion models → Video generation
Abstract (arXiv)
Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion. However, it faces significant challenges in maintaining fidelity and temporal consistency. Existing methods, often designed for U-Net architectures, suffer from two primary limitations: inaccurate inversion due to first-order solvers, and contextual conflicts caused by crude "hard" feature replacement. These issues are more challenging in Diffusion Transformers (DiTs), where the unsuitability of prior layer-selection heuristics makes effective guidance challenging. To address these limitations, we introduce ContextFlow, a novel training-free framework for DiT-based video object editing. In detail, we first employ a high-order Rectified Flow solver to establish a robust editing foundation. The core of our framework is Adaptive Context Enrichment (for specifying what to edit), a mechanism that addresses contextual conflicts. Instead of replacing features, it enriches the self-attention context by concatenating Key-Value pairs from parallel reconstruction and editing paths, empowering the model to dynamically fuse information. Additionally, to determine where to apply this enrichment (for specifying where to edit), we propose a systematic, data-driven analysis to identify task-specific vital layers. Based on a novel Guidance Responsiveness Metric, our method pinpoints the most influential DiT blocks for different tasks (e.g., insertion, swapping), enabling targeted and highly effective guidance. Extensive experiments show that ContextFlow significantly outperforms existing training-free methods and even surpasses several state-of-the-art training-based approaches, delivering temporally coherent, high-fidelity results.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 85 of its 104 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
85 of 104 references.
Closest ancestors · 18
Same direction, newest first
- 2025Consistent Video Editing as Flow-Driven Image-to-Video Generation9 Jun
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuning5 Jun
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers4 Jun
- 2025Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models4 Apr
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformers10 Feb
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
- 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses30 Nov
- 2024GameGen-X: Interactive Open-world Game Video Generation1 Nov
- 2024COVE: Unleashing the Diffusion Feature Correspondence for Consistent Video Editing13 Jun
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models26 May
- 2024ReVideo: Remake a Video with Motion and Content Control22 May
6 more
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models7 Dec
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence4 Dec
- 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
- 2023AnyDoor: Zero-shot Object-level Image Customization18 Jul
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation22 Dec
Other references · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2022Diffusion models as plug-and-play priorscited by 231
38 more
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2024Taming Rectified Flow for Inversion and Editingcited by 204
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 174
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2018ComDefend: An Efficient Image Compression Model to Defend Adversarial Examplescited by 105
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2025Controllable Video Generation: A Surveycited by 98
- 2022LAS-AT: Adversarial Training with Learnable Attack Strategycited by 95
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
- 2023MagicStick: Controllable Video Editing via Control Handle Transformationscited by 62
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
- 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 48
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
- 2024Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generationcited by 42
- 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
- 2021Boosting Fast Adversarial Training with Learnable Adversarial Initializationcited by 40
- 2025KABB: Knowledge-Aware Bayesian Bandits for Dynamic Expert Coordination in Multi-Agent Systemscited by 37
- 2024Generative Video Propagationcited by 36
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
- 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
- 2025DrDiff: Dynamic Routing Diffusion with Hierarchical Attention for Breaking the Efficiency-Quality Trade-offcited by 34
- 2024SemTalk: Holistic Co-speech Motion Generation with Frame-level Semantic Emphasiscited by 32
- 2024WMAdapter: Adding WaterMark Control to Latent Diffusion Modelscited by 31
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
- 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
- 2024CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Modelscited by 24
- 2023HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillationcited by 22
- 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 22
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 21.
27 papers.
Sort:
By area:
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2025Top-Down Semantic Refinement for Image Captioningcited by 16
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
- 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
- 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Modelscited by 5
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
15 more
- 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agentscited by 2
- 2026ResWM: Residual-Action World Model for Visual RLcited by 2
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesiscited by 1
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoisingcited by 1
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytellingcited by 1
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamicscited by 0
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editingcited by 0
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editingcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generationcited by 0
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Control3 Aug 2026
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation16 Jul 2026
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics4 Jul 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis27 Jun 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing25 Jun 2026
- 2026Embedding-perturbed Exploration Preference Optimization for Flow Models15 May 2026
15 more
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generation13 Apr 2026
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026ResWM: Residual-Action World Model for Visual RL11 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Mining17 Feb 2026
- 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agents17 Feb 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2025Over++: Generative Video Compositing for Layer Interaction Effects22 Dec 2025
- 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refiner11 Dec 2025
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025VideoCoF: Unified Video Editing with Temporal Reasoner8 Dec 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025Top-Down Semantic Refinement for Image Captioning25 Oct 2025
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformercited by 3
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoisingcited by 1
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generationcited by 0
- 2026MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation16 Jul 2026
- 2026PISCO: Precise Video Instance Insertion with Sparse Control9 Feb 2026
- 2025MultiMotion: Multi Subject Video Motion Transfer via Video Diffusion Transformer8 Dec 2025
- 2025Unified Long Video Inpainting and Outpainting via Overlapping High-Order Co-Denoising5 Nov 2025
- 2025Top-Down Semantic Refinement for Image Captioningcited by 16
- 2025Top-Down Semantic Refinement for Image Captioning25 Oct 2025
- 2026ResWM: Residual-Action World Model for Visual RLcited by 2
- 2026ResWM: Residual-Action World Model for Visual RL11 Mar 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2026Group Editing: Edit Multiple Images in One Gocited by 11
- 2025AVI-Edit: Audio-sync Video Instance Editing with Granularity-Aware Mask Refinercited by 9
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Controlcited by 7
- 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesiscited by 1
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoisingcited by 1
- 2026MSEditor: Toward Consistent Multi-Shot Video Editingcited by 1
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytellingcited by 1
- 2026A Scalable Curiosity-Driven Game-Theoretic Framework for Long-Tail Multi-Label Learning in Data Miningcited by 0
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRAcited by 0
12 most cited of 16 All 16 (JSON)
- 2026TripleFlow: Training-Free Video Object Removal by Bridging Residual Editing and Native Generation30 Sep 2026
- 2026SubjectAnchor: Subject-Aware Memory-to-Video for Multi-Shot Storytelling28 Sep 2026
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing18 Sep 2026
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026MSEditor: Toward Consistent Multi-Shot Video Editing18 Aug 2026
- 2026LiveLight: Real-time Streaming Video Relighting with Interactive Control3 Aug 2026
- 2026ProxyUp: Training-Free Proxy-Conditioned Video Generation for Controllable Dynamics4 Jul 2026
- 2026GeoEdit: Geometry-Aware Object Editing via Dual-Branch Denoising29 Jun 2026
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis27 Jun 2026
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing25 Jun 2026
- 2026Group Editing: Edit Multiple Images in One Go24 Mar 2026
- 2026Video2LoRA: Unified Semantic-Controlled Video Generation via Per-Reference-Video LoRA9 Mar 2026
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2024Stable Flow: Vital Layers for Training-Free Image Editing
- 2025FiVE: A Fine-grained Video Editing Benchmark for Evaluating Emerging Diffusion and Rectified Flow Models
- 2024Video Editing via Factorized Diffusion Distillation
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer
- 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
- 2025FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors
- 2026Object-Aware Background-Controlled Editing via Weighted Velocity Guidance