LawDIS: Language-Window-based Controllable Dichotomous Image Segmentation
Not on the map. Why?
Abstract (arXiv)
We present LawDIS, a language-window-based controllable dichotomous image segmentation (DIS) framework that produces high-quality object masks. Our framework recasts DIS as an image-conditioned mask generation task within a latent diffusion model, enabling seamless integration of user controls. LawDIS is enhanced with macro-to-micro control modes. Specifically, in macro mode, we introduce a language-controlled segmentation strategy (LS) to generate an initial mask based on user-provided language prompts. In micro mode, a window-controlled refinement strategy (WR) allows flexible refinement of user-defined regions (i.e., size-adjustable windows) within the initial mask. Coordinated by a mode switcher, these modes can operate independently or jointly, making the framework well-suited for high-accuracy, personalised applications. Extensive experiments on the DIS5K benchmark reveal that our LawDIS significantly outperforms 11 cutting-edge methods across all metrics. Notably, compared to the second-best model MVANet, we achieve Fβω gains of 4.6% with both the LS and WR strategies and 3.6% gains with only the LS strategy on DIS-TE. Codes will be made available at https://github.com/XinyuYanTJU/LawDIS.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 2 Aug 2025.
Builds on
39 of 52 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 412
27 more
- 2021Concealed Object Detectioncited by 212
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 188
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 154
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
- 2022Highly Accurate Dichotomous Image Segmentationcited by 110
- 2019Towards High-Resolution Salient Object Detectioncited by 92
- 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2022Deep Gradient Learning for Efficient Camouflaged Object Detectioncited by 65
- 2022Pyramid Grafting Network for One-Stage High Resolution Saliency Detectioncited by 63
- 2024Trajectory Consistency Distillation: Improved Latent Consistency Distillation by Semi-Linear Consistency Function with Trajectory Mappingcited by 46
- 2021Boundary-Aware Segmentation Network for Mobile and Web Applicationscited by 42
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 38
- 2022Revisiting Image Pyramid Structure for High Resolution Salient Object Detectioncited by 36
- 2021Vision Transformers with Hierarchical Attentioncited by 31
- 2023SegRefiner: Towards Model-Agnostic Segmentation Refinement with Discrete Diffusion Processcited by 29
- 2024Multi-view Aggregation Network for Dichotomous Image Segmentationcited by 28
- 2021Salient Objects in Cluttercited by 19
- 2023Unite-Divide-Unite: Joint Boosting Trunk and Structure for High-accuracy Dichotomous Image Segmentationcited by 17
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
- 2024ViTGaze: Gaze Following with Interaction Features in Vision Transformerscited by 15
- 2024Mask Factory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentationcited by 15
- 2024Frontiers in Intelligent Colonoscopycited by 14
- 2024Matting by Generationcited by 13
- 2024High-Precision Dichotomous Image Segmentation via Probing Diffusion Capacitycited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024MaskDiffusion: Exploiting Pre-trained Diffusion Models for Semantic Segmentation
- 2024Free-Mask: A Novel Paradigm of Integration Between the Segmentation Diffusion Model and Image Editing
- 2023MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation
- 2023DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models
- 2024Explore In-Context Segmentation via Latent Diffusion Models
- 2023CM-MaskSD: Cross-Modality Masked Self-Distillation for Referring Image Segmentation
- 2026D3S2: Diffusion-Guided Dataset Distillation for Semantic Segmentation
- 2025HiMTok: Learning Hierarchical Mask Tokens for Image Segmentation with Large Multimodal Model