Learning Trimaps via Clicks for Image Matting
Not on the map. Why?
Abstract (arXiv)
Despite significant advancements in image matting, existing models heavily depend on manually-drawn trimaps for accurate results in natural image scenarios. However, the process of obtaining trimaps is time-consuming, lacking user-friendliness and device compatibility. This reliance greatly limits the practical application of all trimap-based matting methods. To address this issue, we introduce Click2Trimap, an interactive model capable of predicting high-quality trimaps and alpha mattes with minimal user click inputs. Through analyzing real users' behavioral logic and characteristics of trimaps, we successfully propose a powerful iterative three-class training strategy and a dedicated simulation function, making Click2Trimap exhibit versatility across various scenarios. Quantitative and qualitative assessments on synthetic and real-world matting datasets demonstrate Click2Trimap's superior performance compared to all existing trimap-free matting methods. Especially, in the user study, Click2Trimap achieves high-quality trimap and matting predictions in just an average of 5 seconds per image, demonstrating its substantial practical value in real-world applications.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 30 Mar 2024.
Builds on
33 of 60 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2020Real-Time High-Resolution Background Mattingcited by 172
- 2016Deep Interactive Object Selectioncited by 160
- 2017Deep Image Mattingcited by 150
- 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
- 2020Background Matting: The World is Your Green Screencited by 104
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
21 more
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2020Mask Guided Matting via Progressive Refinement Networkcited by 84
- 2020Natural Image Matting via Guided Contextual Attentioncited by 78
- 2018Semantic Human Mattingcited by 67
- 2021Privacy-Preserving Portrait Mattingcited by 60
- 2021Deep Automatic Natural Image Mattingcited by 59
- 2021Semantic Image Mattingcited by 55
- 2018Iteratively Trained Interactive Segmentationcited by 52
- 2020F, B, Alpha Mattingcited by 50
- 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
- 2023Matte Anything: Interactive Natural Image Matting with Segment Anything Modelscited by 39
- 2023Matting Anythingcited by 30
- 2021Attention-guided Temporally Coherent Video Object Mattingcited by 25
- 2020Improved Image Matting via Real-time User Clicks and Uncertainty Estimationcited by 22
- 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentationcited by 17
- 2022One-Trimap Video Mattingcited by 12
- 2021Smart Scribbles for Image Matingcited by 11
- 2023Diffusion for Natural Image Mattingcited by 11
- 2023Revisiting Context Aggregation for Image Mattingcited by 5
- 2023dugMatting: Decomposed-Uncertainty-Guided Mattingcited by 4
- 2023DiffusionMat: Alpha Matting as Sequential Refinement Learningcited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.