mlsanityData to 14 Oct 2026

FocalClick-XL: Towards Unified and High-quality Interactive Segmentation

arXiv 2506.14686 ↗First posted 17 Jun 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Interactive segmentation enables users to extract binary masks of target objects through simple interactions such as clicks, scribbles, and boxes. However, existing methods often support only limited interaction forms and struggle to capture fine details. In this paper, we revisit the classical coarse-to-fine design of FocalClick and introduce significant extensions. Inspired by its multi-stage strategy, we propose a novel pipeline, FocalClick-XL, to address these challenges simultaneously. Following the emerging trend of large-scale pretraining, we decompose interactive segmentation into meta-tasks that capture different levels of information -- context, object, and detail -- assigning a dedicated subnet to each level.This decomposition allows each subnet to undergo scaled pretraining with independent data and supervision, maximizing its effectiveness. To enhance flexibility, we share context- and detail-level information across different interaction forms as common knowledge while introducing a prompting layer at the object level to encode specific interaction types. As a result, FocalClick-XL achieves state-of-the-art performance on click-based benchmarks and demonstrates remarkable adaptability to diverse interaction formats, including boxes, scribbles, and coarse masks. Beyond binary mask generation, it is also capable of predicting alpha mattes with fine-grained details, making it a versatile and powerful tool for interactive segmentation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 89 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

54 of 89 references.

References · 54

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023Segment Anythingcited by 8,234
  3. 2017Mask R-CNNcited by 7,277
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  8. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  9. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2016Pyramid Scene Parsing Networkcited by 2,479
  12. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
38 more
  1. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  2. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  3. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  4. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
  5. 2023Segment Everything Everywhere All at Oncecited by 548
  6. 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 518
  7. 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
  8. 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 383
  9. 2023Segment Anything in High Qualitycited by 376
  10. 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 331
  11. 2023Track Anything: Segment Anything Meets Videoscited by 234
  12. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  13. 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
  14. 2023Segment and Track Anythingcited by 193
  15. 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
  16. 2021Reviving Iterative Training with Mask Guidance for Interactive Segmentationcited by 163
  17. 2016Deep Interactive Object Selectioncited by 160
  18. 2023SAM3D: Segment Anything in 3D Scenescited by 157
  19. 2017Deep Image Mattingcited by 150
  20. 2019DoveNet: Deep Image Harmonization via Domain Verificationcited by 135
  21. 2021Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentationcited by 133
  22. 2015Salient Object Detection: A Benchmarkcited by 131
  23. 2020f-BRS: Rethinking Backpropagating Refinement for Interactive Segmentationcited by 117
  24. 2020CascadePSP: Toward Class-Agnostic and Very High-Resolution Segmentation via Global and Local Refinementcited by 113
  25. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 111
  26. 2017DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentationcited by 110
  27. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 102
  28. 2023Caption Anything: Interactive Image Description with Diverse Multimodal Controlscited by 99
  29. 2020Bridging Composite and Real: Towards End-to-end Deep Image Mattingcited by 89
  30. 2023MA-SAM: Modality-agnostic SAM Adaptation for 3D Medical Image Segmentationcited by 82
  31. 2019Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimationcited by 79
  32. 2018Semantic Human Mattingcited by 67
  33. 2018Iteratively Trained Interactive Segmentationcited by 52
  34. 2020Boosting Semantic Human Matting with Coarse Annotationscited by 48
  35. 2022PseudoClick: Interactive Image Segmentation with Click Imitationcited by 42
  36. 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
  37. 2023SAM3D: Zero-Shot 3D Object Detection via Segment Anything Modelcited by 40
  38. 2018Interactive Full Image Segmentation by Considering All Regions Jointlycited by 34

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.