Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Existing video object removal methods predominantly rely on diffusion models following a noise-to-data paradigm, where generation starts from uninformative Gaussian noise. This approach discards the rich structural and contextual priors present in the original input video. Consequently, such methods often lack sufficient guidance, leading to incomplete object erasure or the synthesis of implausible content that conflicts with the scene's physical logic. In this paper, we reformulate video object removal as a video-to-video translation task via a stochastic bridge model. Unlike noise-initialized methods, our framework establishes a direct stochastic path from the source video (with objects) to the target video (objects removed). This bridge formulation effectively leverages the input video as a strong structural prior, guiding the model to perform precise removal while ensuring that the filled regions are logically consistent with the surrounding environment. To address the trade-off where strong bridge priors hinder the removal of large objects, we propose a novel adaptive mask modulation strategy. This mechanism dynamically modulates input embeddings based on mask characteristics, balancing background fidelity with generative flexibility. Extensive experiments demonstrate that our approach significantly outperforms existing methods in both visual quality and temporal consistency. The project page is https://bridgeremoval.github.io/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 45 of its 51 references that are in the map. First posted on arXiv 17 Jan 2026.
Builds on
45 of 51 references.
Closest ancestors · 1
Same direction, newest first
Other references · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
32 more
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2021Variational Diffusion Modelscited by 1,153
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 219
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023Denoising Diffusion Bridge Modelscited by 178
- 2019Deep Video Inpaintingcited by 109
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2023Non-Denoising Forward-Time Diffusionscited by 77
- 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
- 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
- 2022Flow-Guided Transformer for Video Inpaintingcited by 59
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2024Diffusion Bridge Implicit Modelscited by 49
- 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
- 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
- 2020Short-Term and Long-Term Context Aggregation Network for Video Inpaintingcited by 35
- 2021Progressive Temporal Feature Alignment Network for Video Inpaintingcited by 35
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
- 2023Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesiscited by 30
- 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
- 2024Consistency Diffusion Bridge Modelscited by 23
- 2024FrameBridge: Improving Image-to-Video Generation with Bridge Modelscited by 19
- 2025Bridge-SR: Schr"odinger Bridge for Efficient SRcited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditions
- 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videos
- 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation
- 2024Temporally Consistent Object Editing in Videos using Extended Attention
- 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
- 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing