mlsanityData to 7 Oct 2026

Learning Trimaps via Clicks for Image Matting

arXiv 2404.00335 ↗First posted 30 Mar 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Despite significant advancements in image matting, existing models heavily depend on manually-drawn trimaps for accurate results in natural image scenarios. However, the process of obtaining trimaps is time-consuming, lacking user-friendliness and device compatibility. This reliance greatly limits the practical application of all trimap-based matting methods. To address this issue, we introduce Click2Trimap, an interactive model capable of predicting high-quality trimaps and alpha mattes with minimal user click inputs. Through analyzing real users' behavioral logic and characteristics of trimaps, we successfully propose a powerful iterative three-class training strategy and a dedicated simulation function, making Click2Trimap exhibit versatility across various scenarios. Quantitative and qualitative assessments on synthetic and real-world matting datasets demonstrate Click2Trimap's superior performance compared to all existing trimap-free matting methods. Especially, in the user study, Click2Trimap achieves high-quality trimap and matting predictions in just an average of 5 seconds per image, demonstrating its substantial practical value in real-world applications.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 30 Mar 2024.

Builds on

33 of 60 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2023Segment Anythingcited by 8,158
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2020Real-Time High-Resolution Background Mattingcited by 172
  8. 2016Deep Interactive Object Selectioncited by 160
  9. 2017Deep Image Mattingcited by 150
  10. 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
  11. 2020Background Matting: The World is Your Green Screencited by 104
  12. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
21 more
  1. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  2. 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
  3. 2020Natural Image Matting via Guided Contextual Attentioncited by 78
  4. 2018Semantic Human Mattingcited by 67
  5. 2021Privacy-Preserving Portrait Mattingcited by 60
  6. 2021Deep Automatic Natural Image Mattingcited by 59
  7. 2021Semantic Image Mattingcited by 55
  8. 2018Iteratively Trained Interactive Segmentationcited by 52
  9. 2020F, B, Alpha Mattingcited by 50
  10. 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
  11. 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
  12. 2023Matting Anythingcited by 30
  13. 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
  14. 2020Improved Image Matting via Real-time User Clicks and Uncertainty Estimationcited by 22
  15. 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentationcited by 17
  16. 2022One-Trimap Video Mattingcited by 12
  17. 2021Smart Scribbles for Image Matingcited by 11
  18. 2023Diffusion for Natural Image Mattingcited by 11
  19. 2023Revisiting Context Aggregation for Image Mattingcited by 5
  20. 2023dugMatting: Decomposed-Uncertainty-Guided Mattingcited by 4
  21. 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.