Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation
Not on the map. Why?
Abstract (arXiv)
Amodal segmentation aims to recover complete object shapes, including occluded regions, serving as an essential technique for user-centric multimedia authoring and object-level visual manipulation. Existing methods typically rely on informative prompts, such as bounding boxes or dense visible masks, which heavily degrade the user experience and interaction efficiency in real-world multimedia applications. While recent interactive paradigms (e.g., the Segment Anything Model) support lightweight point-based interactions, they often perform direct mask regression. Crucially, the opaque nature of these direct-regression models offers no visual explainability regarding how occluded structures are inferred, conflicting with the growing demand for interpretable multimedia systems. To address these limitations, we propose VELA, an end-to-end VElocity-driven Level-set Amodal segmentation method that enables explicit and transparent contour evolution driven by simple point clicks. VELA constructs an initial level set function from visual features and the user's point input, which then progressively evolves into the final amodal mask under the guidance of a shape-specific motion field predicted by a fully differentiable network. This mechanism learns to generate evolution dynamics at each step, ensuring that the spatial reasoning process is geometrically grounded, topologically flexible, and visually explainable to the user. Extensive experiments on COCOA-cls, D2SA, and KINS benchmarks demonstrate that VELA outperforms existing methods that use bounding-box or dense visible-mask prompts while requiring only a single-point prompt, validating the effectiveness of explainable geometric modeling for interactive multimedia tasks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 78 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
37 of 78 references.
References · 37
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Segment Anythingcited by 8,234
- 2017Mask R-CNNcited by 7,277
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Segment Anything in High Qualitycited by 376
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Modelscited by 67
25 more
- 2016Amodal Instance Segmentationcited by 63
- 2023OBJECT 3DIT: Language-guided 3D-aware Image Editingcited by 63
- 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
- 2023Amodal Ground Truth and Completion in the Wildcited by 45
- 2020Amodal Segmentation Based on Visible Region Segmentation and Shape Priorcited by 43
- 2022Box-supervised Instance Segmentation with Level Set Evolutioncited by 41
- 2024LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptorscited by 40
- 2019Mumford-Shah Loss Functional for Image Segmentation with Deep Learningcited by 35
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2019Devil is in the Edges: Learning Semantic Boundaries from Noisy Annotationscited by 32
- 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
- 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2023Domain Generalization via Balancing Training Difficulty and Model Capabilitycited by 20
- 2019Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentationcited by 16
- 2020LevelSet R-CNN: A Deep Variational Method for Instance Segmentationcited by 13
- 2023Black-box Unsupervised Domain Adaptation with Bi-directional Atkinson-Shiffrin Memorycited by 11
- 2024Weakly Supervised Monocular 3D Detection with a Single-View Imagecited by 10
- 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansioncited by 9
- 2018Semantic Segmentation for Urban Planning Maps based on U-Netcited by 8
- 2024Multimodal 3D Reasoning Segmentation with Complex Scenescited by 8
- 2024CARE Transformer: Mobile-Friendly Linear Visual Transformer via Decoupled Dual Interactioncited by 5
- 2017A deep level set method for image segmentationcited by 4
- 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAcited by 3
- 2025Exploring 3D Reasoning-Driven Planning: From Implicit Human Intentions to Route-Aware Activity Planningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Using Diffusion Priors for Video Amodal Segmentation
- 2025Shape Distribution Matters: Shape-specific Mixture-of-Experts for Amodal Segmentation under Diverse Occlusions
- 2024Sequential Amodal Segmentation via Cumulative Occlusion Learning
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimation
- 2026Integrating Multimodal Large Language Model Knowledge into Amodal Completion
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation
- 2025SynergyAmodal: Deocclude Anything with Text Control
- 2026ContourVLA: A Closed-Loop Perception-Action Contour Policy for Generalized Referring Expression Segmentation