Object-Aware Background-Controlled Editing via Weighted Velocity Guidance
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Training-free image editing steers diffusion or flow-matching generative models at inference time by modifying prompt-conditioned denoising velocities. Existing velocity-based editors often apply prompt-induced residuals globally over the latent space and rely on the model to localize semantic changes implicitly. For object-centric edits, these residuals are rarely zero outside the target object, so small non-target components can accumulate during multi-step integration, causing background drift and unstable object boundaries. We propose Object-Aware Velocity Control (OAVC), a training-free framework that introduces object-level control into the velocity-integration process. OAVC decouples where semantic residuals are allowed to act from how they are injected into the dynamics. It constructs a background-anchored reference interface under the source prompt and then performs object-localized safe semantic injection under the target prompt. A constrained injection operator suppresses drift-inducing velocity components, while time-adaptive spatial weighting stabilizes the transition near object boundaries. OAVC requires no training or modification of pretrained model parameters. Experiments on object-centric image and video benchmarks with image and video rectified-flow backbones show improved background preservation, structural fidelity, boundary stability, and temporal consistency while retaining effective localized editability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 13 of its 33 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
13 of 33 references.
Closest ancestors · 6
Same direction, newest first
- 2025SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing29 Oct
- 2025DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editing2 Jun
- 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Models17 Apr
- 2024FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing10 Dec
- 2024Taming Rectified Flow for Inversion and Editing7 Nov
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
Other references · 7
- 2023Segment Anythingcited by 8,234
- 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2025KV-Edit: Training-Free Image Editing for Precise Background Preservationcited by 49
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
- 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editingcited by 14
- 2025ProEdit: Inversion-based Editing From Prompts Done Rightcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VeloEdit: Training-Free Consistent and Continuous Instruction-Based Image Editing via Velocity Field Decomposition
- 2026Edit2Interp: Adapting Image Foundation Models from Spatial Editing to Video Frame Interpolation with Few-Shot Learning
- 2025On Exact Editing of Flow-Based Diffusion Models
- 2026Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editing
- 2025Training-Free Reward-Guided Image Editing via Trajectory Optimal Control
- 2026Drag within Prior Distribution: Text-Conditioned Point-Based Image Editing within Distribution Constraints
- 2026SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing
- 2026Constrained Edit Fields for Training-Free Flow Editing