mlsanityData to 14 Oct 2026

MatAnyone: Stable Video Matting with Consistent Memory Propagation

arXiv 2501.14677 ↗First posted 24 Jan 2025cs.CVcited by 24

Not on the map. Why?

Abstract (arXiv)

Auxiliary-free human video matting methods, which rely solely on input frames, often struggle with complex or ambiguous backgrounds. To address this, we propose MatAnyone, a robust framework tailored for target-assigned video matting. Specifically, building on a memory-based paradigm, we introduce a consistent memory propagation module via region-adaptive memory fusion, which adaptively integrates memory from the previous frame. This ensures semantic stability in core regions while preserving fine-grained details along object boundaries. For robust training, we present a larger, high-quality, and diverse dataset for video matting. Additionally, we incorporate a novel training strategy that efficiently leverages large-scale segmentation data, boosting matting stability. With this new network design, dataset, and training strategy, MatAnyone delivers robust and accurate video matting results in diverse real-world scenarios, outperforming existing methods.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 24 Jan 2025.

Builds on

50 of 60 references.

References · 50

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2023Segment Anythingcited by 8,234
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  6. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  7. 2023Segment Everything Everywhere All at Oncecited by 548
  8. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  9. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
  10. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  11. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  12. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
38 more
  1. 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
  2. 2019Video Instance Segmentationcited by 393
  3. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
  4. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  5. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  6. 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
  7. 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
  8. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  9. 2023Putting the Object Back into Video Object Segmentationcited by 188
  10. 2020Real-Time High-Resolution Background Mattingcited by 173
  11. 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
  12. 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
  13. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
  14. 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
  15. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
  16. 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
  17. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  18. 2020Kernelized Memory Network for Video Object Segmentationcited by 111
  19. 2019Spatio-Temporal Filter Adaptive Network for Video Deblurringcited by 106
  20. 2021Efficient Regional Memory Network for Video Object Segmentationcited by 86
  21. 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
  22. 2021SwiftNet: Real-time Video Object Segmentationcited by 67
  23. 2017Learning Video Object Segmentation with Visual Memorycited by 66
  24. 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
  25. 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
  26. 2021Deep Automatic Natural Image Mattingcited by 59
  27. 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
  28. 2018MaskRNN: Instance Level Video Object Segmentationcited by 48
  29. 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
  30. 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 41
  31. 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
  32. 2017Fast Deep Matting for Portrait Animation on Mobile Phonecited by 30
  33. 2023Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentationcited by 23
  34. 2022VMFormer: End-to-End Video Matting with Transformercited by 20
  35. 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
  36. 2023Adaptive Human Matting for Dynamic Videoscited by 7
  37. 2023Video Instance Mattingcited by 4
  38. 2024Training Matting Models without Alpha Labelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 10; 2026: 14.

24 papers.

Sort:

By area:

  1. 2026Video Generation Models are General-Purpose Vision Learnerscited by 14
  2. 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
  3. 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
  4. 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 7
  5. 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
  6. 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluatorcited by 7
  7. 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
  8. 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 5
  9. 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
  10. 2025BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videoscited by 4
  11. 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 4
  12. 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priorscited by 3
12 more
  1. 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
  2. 2025LayerT2V: A Unified Multi-Layer Video Generation Frameworkcited by 2
  3. 2025BiVM: Accurate Binarized Neural Network for Efficient Video Mattingcited by 1
  4. 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decompositioncited by 1
  5. 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligencecited by 1
  6. 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversioncited by 0
  7. 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Modelscited by 0
  8. 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
  9. 2026SAM2Matting: Generalized Image and Video Mattingcited by 0
  10. 2026Parallax Portrait Mattingcited by 0
  11. 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decompositioncited by 0
  12. 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintingscited by 0