MatAnyone: Stable Video Matting with Consistent Memory Propagation
Not on the map. Why?
Abstract (arXiv)
Auxiliary-free human video matting methods, which rely solely on input frames, often struggle with complex or ambiguous backgrounds. To address this, we propose MatAnyone, a robust framework tailored for target-assigned video matting. Specifically, building on a memory-based paradigm, we introduce a consistent memory propagation module via region-adaptive memory fusion, which adaptively integrates memory from the previous frame. This ensures semantic stability in core regions while preserving fine-grained details along object boundaries. For robust training, we present a larger, high-quality, and diverse dataset for video matting. Additionally, we incorporate a novel training strategy that efficiently leverages large-scale segmentation data, boosting matting stability. With this new network design, dataset, and training strategy, MatAnyone delivers robust and accurate video matting results in diverse real-world scenarios, outperforming existing methods.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 50 of its 60 references that are in the map. First posted on arXiv 24 Jan 2025.
Builds on
50 of 60 references.
References · 50
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Segment Anythingcited by 8,234
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
38 more
- 2019Video Object Segmentation using Space-Time Memory Networkscited by 438
- 2019Video Instance Segmentationcited by 393
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2021Associating Objects with Transformers for Video Object Segmentationcited by 226
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2020Real-Time High-Resolution Background Mattingcited by 173
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 167
- 2015Delving Deeper into Convolutional Networks for Learning Video Representationscited by 148
- 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 137
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 132
- 2021Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusioncited by 129
- 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
- 2020Kernelized Memory Network for Video Object Segmentationcited by 111
- 2019Spatio-Temporal Filter Adaptive Network for Video Deblurringcited by 106
- 2021Efficient Regional Memory Network for Video Object Segmentationcited by 86
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2021SwiftNet: Real-time Video Object Segmentationcited by 67
- 2017Learning Video Object Segmentation with Visual Memorycited by 66
- 2021Learning Position and Target Consistency for Memory-based Video Object Segmentationcited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2018MaskRNN: Instance Level Video Object Segmentationcited by 48
- 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
- 2023EdgeSAM: Prompt-In-the-Loop Distillation for SAMcited by 41
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2017Fast Deep Matting for Portrait Animation on Mobile Phonecited by 30
- 2023Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentationcited by 23
- 2022VMFormer: End-to-End Video Matting with Transformercited by 20
- 2024MaGGIe: Masked Guided Gradual Human Instance Mattingcited by 18
- 2023Adaptive Human Matting for Dynamic Videoscited by 7
- 2023Video Instance Mattingcited by 4
- 2024Training Matting Models without Alpha Labelscited by 4
Built on by
Citing papers per year: 2025: 10; 2026: 14.
24 papers.
Sort:
By area:
- 2026Video Generation Models are General-Purpose Vision Learnerscited by 14
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 7
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluatorcited by 7
- 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
- 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 5
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
- 2025BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videoscited by 4
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 4
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priorscited by 3
12 more
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2025LayerT2V: A Unified Multi-Layer Video Generation Frameworkcited by 2
- 2025BiVM: Accurate Binarized Neural Network for Efficient Video Mattingcited by 1
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decompositioncited by 1
- 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligencecited by 1
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversioncited by 0
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Modelscited by 0
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
- 2026SAM2Matting: Generalized Image and Video Mattingcited by 0
- 2026Parallax Portrait Mattingcited by 0
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decompositioncited by 0
- 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintingscited by 0
- 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintings17 Sep 2026
- 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence27 Aug 2026
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decomposition28 Jul 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Video Generation Models are General-Purpose Vision Learners10 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing22 Jun 2026
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models17 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors1 May 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
12 more
- 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editing16 Feb 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition26 Dec 2025
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluator12 Dec 2025
- 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacement23 Nov 2025
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learner29 Sep 2025
- 2025LayerT2V: A Unified Multi-Layer Video Generation Framework6 Aug 2025
- 2025BiVM: Accurate Binarized Neural Network for Efficient Video Matting6 Jul 2025
- 2025BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videos25 Jun 2025
- 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation3 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyondcited by 5
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priorscited by 3
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decompositioncited by 1
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editingcited by 0
- 2026Vera: A Layered Diffusion Model for Content-Preserving Video Editing22 Jun 2026
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors1 May 2026
- 2026THFM: A Unified Video Foundation Model for 4D Human Perception and Beyond26 Mar 2026
- 2025EasyOmnimatte: Taming Pretrained Inpainting Diffusion Models for End-to-End Video Layered Decomposition26 Dec 2025
- 2026Video Generation Models are General-Purpose Vision Learnerscited by 14
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervisioncited by 10
- 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 7
- 2025Video Generation with Stable Transparency via Shiftable RGB-A Distribution Learnercited by 7
- 2025MatAnyone 2: Scaling Video Matting via a Learned Quality Evaluatorcited by 7
- 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6
- 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 5
- 2025BrokenVideos: A Benchmark Dataset for Fine-Grained Artifact Localization in AI-Generated Videoscited by 4
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Priorcited by 4
- 2026CineMatte: Background Matting for Virtual Production and Beyondcited by 3
- 2025LayerT2V: A Unified Multi-Layer Video Generation Frameworkcited by 2
12 most cited of 20 All 20 (JSON)
- 2026Printing the Underdetermined: Materializing Multi-solutionness in Figurative Paintings17 Sep 2026
- 2026HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence27 Aug 2026
- 2026Explicit Layer Modeling for Video Object Insertion and Video Layer Decomposition28 Jul 2026
- 2026Parallax Portrait Matting13 Jul 2026
- 2026Video Generation Models are General-Purpose Vision Learners10 Jul 2026
- 2026SAM2Matting: Generalized Image and Video Matting25 Jun 2026
- 2026Cinematic Compositing Using Character-Environment-Harmonized Video Generation Models17 Jun 2026
- 2026αDepth: Learning Single-Pass Soft Boundary Decomposition for Stereo Conversion29 May 2026
- 2026CineMatte: Background Matting for Virtual Production and Beyond18 May 2026
- 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editing16 Feb 2026
- 2026VideoMaMa: Mask-Guided Video Matting via Generative Prior20 Jan 2026
- 2025FlexAvatar: Learning Complete 3D Head Avatars with Partial Supervision17 Dec 2025
12 newest of 20 All 20 (JSON)