Towards PerSense++: Advancing Training-Free Personalized Instance Segmentation in Dense Images
Not on the map. Why?
Abstract (arXiv)
Segmentation in dense visual scenes poses significant challenges due to occlusions, background clutter, and scale variations. To address this, we introduce PerSense, an end-to-end, training-free, and model-agnostic one-shot framework for Personalized instance Segmentation in dense images. PerSense employs a novel Instance Detection Module (IDM) that leverages density maps (DMs) to generate instance-level candidate point prompts, followed by a Point Prompt Selection Module (PPSM) that filters false positives via adaptive thresholding and spatial gating. A feedback mechanism further enhances segmentation by automatically selecting effective exemplars to improve DM quality. We additionally present PerSense++, an enhanced variant that incorporates three additional components to improve robustness in cluttered scenes: (i) a diversity-aware exemplar selection strategy that leverages feature and scale diversity for better DM generation; (ii) a hybrid IDM combining contour and peak-based prompt generation for improved instance separation within complex density patterns; and (iii) an Irrelevant Mask Rejection Module (IMRM) that discards spatially inconsistent masks using outlier analysis. Finally, to support this underexplored task, we introduce PerSense-D, a dedicated benchmark for personalized segmentation in dense images. Extensive experiments across multiple benchmarks demonstrate that PerSense++ outperforms existing methods in dense settings.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
36 of 45 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,028
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2023Segment Everything Everywhere All at Oncecited by 548
24 more
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2019Feature Weighting and Boosting for Few-Shot Segmentationcited by 189
- 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 161
- 2019FSS-1000: A 1000-Class Dataset for Few-Shot Segmentationcited by 160
- 2021Learning To Count Everythingcited by 150
- 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
- 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
- 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2023LLaFS: When Large Language Models Meet Few-Shot Segmentationcited by 48
- 2023Point, Segment and Count: A Generalized Framework for Object Countingcited by 39
- 2023Training-free Object Counting with Promptscited by 34
- 2023SLiMe: Segment Like Mecited by 34
- 2017Count-ception: Counting by Fully Convolutional Redundant Countingcited by 30
- 2023MIANet: Aggregating Unbiased Instance and General Information for Few-Shot Semantic Segmentationcited by 25
- 2024A Novel Unified Architecture for Low-Shot Counting by Detection and Segmentationcited by 21
- 2023InterFormer: Real-time Interactive Image Segmentationcited by 20
- 2022Interactive Multi-Class Tiny-Object Detectioncited by 14
- 2023Multi-granularity Interaction Simulation for Unsupervised Interactive Segmentationcited by 9
- 2021Oriented Bounding Boxes for Small and Freely Rotated Objectscited by 8
Built on by
Citing papers per year: 2026: 2.
2 papers.