mlsanityData to 14 Oct 2026

MiniMax-Remover: Taming Bad Noise Helps Video Object Removal

arXiv 2505.24873 ↗First posted 30 May 2025cs.CVcited by 45

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Recent advances in video diffusion models have driven rapid progress in video editing techniques. However, video object removal, a critical subtask of video editing, remains challenging due to issues such as hallucinated objects and visual artifacts. Furthermore, existing methods often rely on computationally expensive sampling procedures and classifier-free guidance (CFG), resulting in slow inference. To address these limitations, we propose MiniMax-Remover, a novel two-stage video object removal approach. Motivated by the observation that text condition is not best suited for this task, we simplify the pretrained video generation model by removing textual input and cross-attention layers, resulting in a more lightweight and efficient model architecture in the first stage. In the second stage, we distilled our remover on successful videos produced by the stage-1 model and curated by human annotators, using a minimax optimization strategy to further improve editing quality and inference speed. Specifically, the inner maximization identifies adversarial input noise ("bad noise") that makes failure removals, while the outer minimization step trains the model to generate high-quality removal results even under such challenging conditions. As a result, our method achieves a state-of-the-art video object removal results with as few as 6 sampling steps and doesn't rely on CFG, significantly improving inference efficiency. Extensive experiments demonstrate the effectiveness and superiority of MiniMax-Remover compared to existing methods. Codes and Videos are available at: https://minimax-remover.github.io.

Key facts. Cited by 45 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 47 of its 57 references that are in the map. First posted on arXiv 30 May 2025.

Builds on

47 of 57 references.

References · 47

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2021Convex optimizationcited by 2,515
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
35 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  4. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  5. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  6. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
  7. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  9. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  10. 2025VACE: All-in-One Video Creation and Editingcited by 479
  11. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  12. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  13. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  14. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  15. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  16. 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
  17. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  18. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
  19. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 168
  20. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  21. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
  22. 2024Phased Consistency Modelscited by 85
  23. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  24. 2023AVID: Any-Length Video Inpainting with Diffusion Modelcited by 82
  25. 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 81
  26. 2024ReVideo: Remake a Video with Motion and Content Controlcited by 74
  27. 2025DiffuEraser: A Diffusion Model for Video Inpaintingcited by 72
  28. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  29. 2024CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibilitycited by 50
  30. 2024Generative Video Propagationcited by 36
  31. 2024StableV2V: Stablizing Shape Consistency in Video-to-Video Editingcited by 26
  32. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
  33. 2024Video Diffusion Models are Strong Video Inpaintercited by 21
  34. 2025MTV-Inpaint: Multi-Task Long Video Inpaintingcited by 14
  35. 2024ReMOVE: A Reference-free Metric for Object Erasurecited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 12; 2026: 33.

45 papers.

Sort:

By area:

  1. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  2. 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
  3. 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasingcited by 15
  4. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  5. 2025O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editingcited by 10
  6. 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
  7. 2025H2R-Grounder: A Paired-Data-Free Paradigm for Translating Human Interaction Videos into Physically Grounded Robot Videoscited by 9
  8. 2026VOID: Video Object and Interaction Deletioncited by 9
  9. 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
  10. 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
  11. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editingcited by 8
  12. 2026Goku: A Million-Scale Universal Dataset and Benchmark for Instruction-Based Video Editingcited by 6
33 more
  1. 2025EraserDiT: Fast Video Inpainting with Diffusion Transformer Modelcited by 5
  2. 2025LoVoRA: Text-guided and Mask-free Video Object Removal and Addition with Learnable Object-aware Localizationcited by 5
  3. 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditionscited by 5
  4. 2026NOVA: Sparse Control, Dense Synthesis for Pair-Free Video Editingcited by 4
  5. 2026LIVEditor-14B: Lightning Unified Video Editing via In-Context Sparse Attentioncited by 4
  6. 2026Ctrl&Shift: High-Quality Geometry-Aware Object Manipulation in Visual Generationcited by 3
  7. 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removalcited by 3
  8. 2026Smart-Insertion-V: Photorealistic Video Insertion via a Closed-Loop Feedback Dual-Stream Frameworkcited by 3
  9. 2026Robot-Factored World Models via Robot Renderingcited by 3
  10. 2026ViFeEdit: A Video-Free Tuner of Your Video Diffusion Transformercited by 2
  11. 2026CLEAR: Context-Aware Learning with End-to-End Mask-Free Inference for Adaptive Video Subtitle Removalcited by 2
  12. 2026TAG: Target-Agnostic Guidance for Stable Object-Centric Inference in Vision-Language-Action Modelscited by 2
  13. 2026YOSE: You Only Select Essential Tokens for Efficient DiT-based Video Object Removalcited by 2
  14. 2026PROVE: A Perceptual RemOVal cohErence Benchmark for Visual Mediacited by 2
  15. 2026JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curationcited by 2
  16. 2025Refaccade: Editing Object with Given Reference Texturecited by 1
  17. 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decompositioncited by 1
  18. 2026Learning Stochastic Bridges for Video Object Removal via Video-to-Video Translationcited by 1
  19. 2026SEDiT: Mask-Free Video Subtitle Erasure via One-step Diffusion Transformercited by 1
  20. 2026DualEraser: Joint Video Object and Effect Removal via Balanced Text-Mask Guidance and Decoupled Locator-Preservercited by 1
  21. 2026From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Plantingcited by 1
  22. 2026BeyondMasks: Evaluating Causal and Physical Consistency in Video Object Removalcited by 1
  23. 2025Layer-Aware Video Composition via Split-then-Mergecited by 0
  24. 2026Tuning-free Instruction-based Video Editing Via Structural Noise Initialization and Guidancecited by 0
  25. 2026SimInsert: Seamless Video Object Insertion via Regional Sparse Attention Fusioncited by 0
  26. 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
  27. 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
  28. 2026ScaleVid: Geometry-Aware Video Object Scaling with Mesh-Free Inferencecited by 0
  29. 2026RefVideo-6M: A Reliable Reference-Based Dataset for Instructional Video Editingcited by 0
  30. 2026VOR-Bench: A Human Perception-Driven Benchmark for Video Object Removalcited by 0
  31. 2026VideoX-Qwen: Data-Centric Instruction-Based Video Editingcited by 0
  32. 2026MFVSR: A Multi-Style and Fine-Grained Benchmark for Video Subtitle Removalcited by 0
  33. 2026StreamErase: Towards Ultra-Fast Streaming Video Erasingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videos
  2. 2026FlashClear: Ultra-Fast Image Content Removal via Efficient Step Distillation and Feature Caching
  3. 2025VideoEraser: Concept Erasure in Text-to-Video Diffusion Models
  4. 2025RORem: Training a Robust Object Remover with Human-in-the-Loop
  5. 2026ClickRemoval: An Interactive Open-Source Tool for Object Removal in Diffusion Models
  6. 2026PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removal
  7. 2026You Only Erase Once: Erasing Anything without Bringing Unexpected Content
  8. 2026CleanVideo: Adaptive Concept Erasure for Text-to-Video Diffusion Models