SemLayer: Semantic-aware Generative Segmentation and Layer Construction for Abstract Icons
Not on the map. Why?
Abstract (arXiv)
Graphic icons are a cornerstone of modern design workflows, yet they are often distributed as flattened single-path or compound-path graphics, where the original semantic layering is lost. This absence of semantic decomposition hinders downstream tasks such as editing, restyling, and animation. We formalize this problem as semantic layer construction for flattened vector art and introduce SemLayer, a visual generation empowered pipeline that restores editable layered structures. Given an abstract icon, SemLayer first generates a chromatically differentiated representation in which distinct semantic components become visually separable. To recover the complete geometry of each part, including occluded regions, we then perform a semantic completion step that reconstructs coherent object-level shapes. Finally, the recovered parts are assembled into a layered vector representation with inferred occlusion relationships. Extensive qualitative comparisons and quantitative evaluations demonstrate the effectiveness of SemLayer, enabling editing workflows previously inapplicable to flattened vector graphics and establishing semantic layer reconstruction as a practical and valuable task. Project page: https://xxuhaiyang.github.io/SemLayer/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 44 of its 71 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
44 of 71 references.
References · 44
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2023Segment Anythingcited by 8,158
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021Segmenter: Transformer for Semantic Segmentationcited by 855
- 2018Panoptic Segmentationcited by 796
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 485
- 2023Segment Anything Model for Medical Image Analysis: an Experimental Studycited by 291
- 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
32 more
- 2022MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Modelcited by 180
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2023Segment Anything Model (SAM) for Digital Pathology: Assess Zero-shot Segmentation on Whole Slide Imagingcited by 161
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2021Im2Vec: Synthesizing Vector Graphics without Vector Supervisioncited by 114
- 2023Can SAM Segment Anything? When SAM Meets Camouflaged Object Detectioncited by 99
- 2022Towards Layer-wise Image Vectorizationcited by 77
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformercited by 43
- 2023Segment anything, from space?cited by 42
- 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2024Moving Object Segmentation: All You Need Is SAM (and Flow)cited by 30
- 2019Object-Driven Multi-Layer Scene Decomposition From a Single Imagecited by 26
- 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
- 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
- 2021ClipGen: A Deep Generative Model for Clipart Vectorization and Synthesiscited by 23
- 2023VecFusion: Vector Font Generation with Diffusioncited by 20
- 2022Image Amodal Completion: A Surveycited by 18
- 2024Layered Image Vectorization via Semantic Simplificationcited by 18
- 2024NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generationcited by 17
- 2024Object-level Scene Deocclusioncited by 17
- 2016Inverse Diffusion Curves using Shape Optimizationcited by 12
- 2016Effective Clipart Image Vectorization Through Direct Optimization of Bezigonscited by 11
- 2024Segmentation-guided Layer-wise Image Vectorization with Gradient Fillscited by 11
- 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 9
- 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animationscited by 8
- 2025LayerPeeler: Autoregressive Peeling for Layer-wise Image Vectorizationcited by 8
- 2024Image Vectorization with Depth: convexified shape layers with depth orderingcited by 4
Built on by
Not cited yet.