mlsanityData to 7 Oct 2026

POBEVM: Real-time Video Matting via Progressively Optimize the Target Body and Edge

arXiv 2402.09731 ↗First posted 15 Feb 2024cs.CV cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep convolutional neural networks (CNNs) based approaches have achieved great performance in video matting. Many of these methods can produce accurate alpha estimation for the target body but typically yield fuzzy or incorrect target edges. This is usually caused by the following reasons: 1) The current methods always treat the target body and edge indiscriminately; 2) Target body dominates the whole target with only a tiny proportion target edge. For the first problem, we propose a CNN-based module that separately optimizes the matting target body and edge (SOBE). And on this basis, we introduce a real-time, trimap-free video matting method via progressively optimizing the matting target body and edge (POBEVM) that is much lighter than previous approaches and achieves significant improvements in the predicted target edge. For the second problem, we propose an Edge-L1-Loss (ELL) function that enforces our network on the matting target edge. Experiments demonstrate our method outperforms prior trimap-free matting methods on both Distinctions-646 (D646) and VideoMatte240K(VM) dataset, especially in edge optimization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 32 references that are in the map. First posted on arXiv 15 Feb 2024.

Builds on

21 of 32 references.

References · 21

  1. 2019Searching for MobileNetV3cited by 1,984
  2. 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
  3. 2020Real-Time High-Resolution Background Mattingcited by 172
  4. 2021Camouflaged Object Segmentation with Distraction Miningcited by 151
  5. 2017Deep Image Mattingcited by 150
  6. 2021Robust High-Resolution Video Matting with Temporal Guidancecited by 136
  7. 2020MODNet: Real-Time Trimap-Free Portrait Matting via Objective Decompositioncited by 127
  8. 2020Background Matting: The World is Your Green Screencited by 104
  9. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  10. 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
  11. 2018Fast End-to-End Trainable Guided Filtercited by 50
  12. 2022MatteFormer: Transformer-Based Image Matting via Prior-Tokenscited by 48
9 more
  1. 2021Deep Video Matting via Spatio-Temporal Alignment and Aggregationcited by 41
  2. 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
  3. 2022PP-Matting: High-Accuracy Natural Image Mattingcited by 23
  4. 2022Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentationcited by 22
  5. 2022VMFormer: End-to-End Video Matting with Transformercited by 20
  6. 2021Trimap-guided Feature Mining and Fusion Network for Natural Image Mattingcited by 2
  7. 2021Improving Deep Image Matting via Local Smoothness Assumptioncited by 2
  8. 2022Adaptive Background Matting Using Background Matchingcited by 1
  9. 2022SGM-Net: Semantic Guided Matting Netcited by 1

Built on by

Not cited yet.