mlsanityData to 14 Oct 2026

Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translation

arXiv 2601.12066 ↗First posted 17 Jan 2026cs.CVcited by 1

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Existing video object removal methods predominantly rely on diffusion models following a noise-to-data paradigm, where generation starts from uninformative Gaussian noise. This approach discards the rich structural and contextual priors present in the original input video. Consequently, such methods often lack sufficient guidance, leading to incomplete object erasure or the synthesis of implausible content that conflicts with the scene's physical logic. In this paper, we reformulate video object removal as a video-to-video translation task via a stochastic bridge model. Unlike noise-initialized methods, our framework establishes a direct stochastic path from the source video (with objects) to the target video (objects removed). This bridge formulation effectively leverages the input video as a strong structural prior, guiding the model to perform precise removal while ensuring that the filled regions are logically consistent with the surrounding environment. To address the trade-off where strong bridge priors hinder the removal of large objects, we propose a novel adaptive mask modulation strategy. This mechanism dynamically modulates input embeddings based on mask characteristics, balancing background fidelity with generative flexibility. Extensive experiments demonstrate that our approach significantly outperforms existing methods in both visual quality and temporal consistency. The project page is https://bridgeremoval.github.io/.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 45 of its 51 references that are in the map. First posted on arXiv 17 Jan 2026.

Builds on

45 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025MiniMax-Remover: Taming Bad Noise Helps Video Object Removal30 May

Other references · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2025Qwen3-VL Technical Reportcited by 2,793
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
32 more
  1. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2021Variational Diffusion Modelscited by 1,153
  6. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 939
  7. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  10. 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 219
  11. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  12. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  13. 2023Denoising Diffusion Bridge Modelscited by 178
  14. 2019Deep Video Inpaintingcited by 109
  15. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  16. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  17. 2023Non-Denoising Forward-Time Diffusionscited by 77
  18. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  19. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  20. 2022Flow-Guided Transformer for Video Inpaintingcited by 59
  21. 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
  22. 2024Diffusion Bridge Implicit Modelscited by 49
  23. 2024Generative Omnimatte: Learning to Decompose Video into Layerscited by 38
  24. 2025ROSE: Remove Objects with Side Effects in Videoscited by 38
  25. 2020Short-Term and Long-Term Context Aggregation Network for Video Inpaintingcited by 35
  26. 2021Progressive Temporal Feature Alignment Network for Video Inpaintingcited by 35
  27. 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 35
  28. 2023Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesiscited by 30
  29. 2025LoRA-Edit: Controllable First-Frame-Guided Video Editing via Mask-Aware LoRA Fine-Tuningcited by 28
  30. 2024Consistency Diffusion Bridge Modelscited by 23
  31. 2024FrameBridge: Improving Image-to-Video Generation with Bridge Modelscited by 19
  32. 2025Bridge-SR: Schr"odinger Bridge for Efficient SRcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal
  2. 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditions
  3. 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videos
  4. 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
  5. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation
  6. 2024Temporally Consistent Object Editing in Videos using Extended Attention
  7. 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removal
  8. 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing