FocalClick-XL: Towards Unified and High-quality Interactive Segmentation
Not on the map. Why?
Abstract (arXiv)
Interactive segmentation enables users to extract binary masks of target objects through simple interactions such as clicks, scribbles, and boxes. However, existing methods often support only limited interaction forms and struggle to capture fine details. In this paper, we revisit the classical coarse-to-fine design of FocalClick and introduce significant extensions. Inspired by its multi-stage strategy, we propose a novel pipeline, FocalClick-XL, to address these challenges simultaneously. Following the emerging trend of large-scale pretraining, we decompose interactive segmentation into meta-tasks that capture different levels of information -- context, object, and detail -- assigning a dedicated subnet to each level.This decomposition allows each subnet to undergo scaled pretraining with independent data and supervision, maximizing its effectiveness. To enhance flexibility, we share context- and detail-level information across different interaction forms as common knowledge while introducing a prompting layer at the object level to encode specific interaction types. As a result, FocalClick-XL achieves state-of-the-art performance on click-based benchmarks and demonstrates remarkable adaptability to diverse interaction formats, including boxes, scribbles, and coarse masks. Beyond binary mask generation, it is also capable of predicting alpha mattes with fine-grained details, making it a versatile and powerful tool for interactive segmentation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 89 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
54 of 89 references.
References · 54
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Segment Anythingcited by 8,234
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
38 more
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
- 2023Segment Everything Everywhere All at Oncecited by 548
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
- 2023Segment Anything in High Qualitycited by 376
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 331
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
- 2023Segment and Track Anythingcited by 193
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 163
- 2016Deep Interactive Object Selectioncited by 160
- 2023SAM3D: Segment Anything in 3D Scenescited by 157
- 2017Deep Image Mattingcited by 150
- 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 135
- 2021Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentationcited by 133
- 2015Salient Object Detection: A Benchmarkcited by 131
- 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
- 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 111
- 2017DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentationcited by 110
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 102
- 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
- 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
- 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
- 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
- 2018Semantic Human Mattingcited by 67
- 2018Iteratively Trained Interactive Segmentationcited by 52
- 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
- 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
- 2023SAM3D: Zero-Shot 3D Object Detection via Segment Anything Modelcited by 40
- 2018Interactive Full Image Segmentation by Considering All Regions Jointlycited by 34
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.