mlsanityData to 14 Oct 2026

SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation

arXiv 2608.15295 ↗First posted 15 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Foundation segmentation models excel at generating high-quality, class-agnostic masks, but they struggle to associate these proposals with specific target objects. This semantic gap severely hinders their deployment in downstream applications like robotic manipulation, which demand precise unseen objects segmentation. Existing approaches attempt to resolve this by relying on exhaustive 3D object model priors, inherently introducing prohibitive computational overhead and complex, multi-stage pipelines. To address these limitations, we propose SOS (Streamlined Object-conditional Transformer for model-free Segmentation). SOS completely eliminates the reliance on 3D models, requiring only a single reference image per target object. Central to our framework is a novel Object-Conditional Transformer that learns identity-anchored queries, unifying mask generation and target identification into a single feed-forward pass. This streamlined design drastically improves both structural and computational efficiency. Extensive evaluations across multiple benchmarks demonstrate that SOS establishes a new state-of-the-art for model-free unseen objects segmentation, delivering accurate and high-efficiency performance. The project page and code are available at https://sos-seg.github.io/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 50 references that are in the map. First posted on arXiv 15 Aug 2026.

Builds on

45 of 50 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2023Segment Anythingcited by 8,234
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2017Mask R-CNNcited by 7,277
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  9. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  10. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  11. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  12. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
33 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  2. 2025DINOv3cited by 1,414
  3. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  4. 2025SAM 3: Segment Anything with Conceptscited by 906
  5. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
  6. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  7. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  8. 2021Conditional DETR for Fast Training Convergencecited by 424
  9. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
  10. 2023Fast Segment Anythingcited by 290
  11. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  12. 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 242
  13. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
  14. 2023SegGPT: Segmenting Everything In Contextcited by 194
  15. 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
  16. 2023Matcher: Segment Anything with One Shot Using All-Purpose Feature Matchingcited by 142
  17. 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
  18. 2022Cost Aggregation with 4D Convolutional Swin Transformer for Few-Shot Segmentationcited by 114
  19. 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 114
  20. 2019HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objectscited by 110
  21. 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
  22. 2023CNOS: A Strong Baseline for CAD-based Novel Object Segmentationcited by 87
  23. 2023Hierarchical Dense Correlation Distillation for Few-Shot Segmentationcited by 84
  24. 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
  25. 2024Bridge the Points: Graph-based Few-shot Segment Anything Semanticallycited by 35
  26. 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
  27. 2024Adapting Pre-Trained Vision Models for Novel Instance Detection and Segmentationcited by 17
  28. 2024Visual Prompting for Generalized Few-shot Segmentation: A Multi-scale Approachcited by 15
  29. 2024Visual Prompt Selection for In-Context Learning Segmentationcited by 13
  30. 2025Conditional Latent Diffusion Models for Zero-Shot Instance Segmentationcited by 4
  31. 2025RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimationcited by 4
  32. 2025FUNCanon: Learning Pose-Aware Action Primitives via Functional Object Canonicalization for Generalizable Robotic Manipulationcited by 3
  33. 2025MUSE: Model-based Uncertainty-aware Similarity Estimation for zero-shot 2D Object Detection and Segmentationcited by 3

Built on by

Not cited yet.