TACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation
Not on the map. Why?
Abstract (arXiv)
The precise pixel-level localization of 2D material flakes is crucial for high-throughput screening. However, traditional fully supervised methods rely on dense annotations, which are costly and time-consuming, severely limiting the practical deployment of segmentation models. This paper proposes TACoS, a specialized scribble segmentation framework tailored for 2D materials. First, we design a unified framework that integrates semi-supervised consistency learning with structured tree energy constraints. This framework comprises two core components: an unlabeled weak-strong distribution alignment module and a tree energy regularization module. The former employs cosine consistency constraints to enhance prediction alignment across views. Meanwhile, the latter utilizes minimum spanning trees to establish pixel affinity relationships and generate structure-aware soft pseudo labels for online semantic guidance. Next, we introduce asymmetric regional contrast learning. This approach fuses high-confidence predictions from the weak augmentation branch with scribbles to form augmented labels, and construct category prototypes in the representation space. Simultaneously, we prioritize contrastive constraints on challenging pixels in boundary-unlabeled regions. This strategy enhances intra-class cohesion and inter-class separation at the representation level, effectively reducing category confusion in low-contrast edges and complex backgrounds. Experiments conducted on the constructed graphene and MoS2 datasets demonstrate that our method TACoS achieves over 96% of fully supervised performance using less than 0.6% annotated data. Furthermore, it exhibits superior structural coherence and boundary stability in scenarios with weakly contrasting edges and complex backgrounds, providing an efficient and scalable solution for automated high-throughput screening of 2D material flakes.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
20 of 34 references.
References · 20
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
- 2021Semi-Supervised Semantic Segmentation with Cross Pseudo Supervisioncited by 462
- 2020Semi-Supervised Semantic Segmentation with Cross-Consistency Trainingcited by 375
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 330
- 2021Exploring Cross-Image Pixel Contrast for Semantic Segmentationcited by 242
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2021Boundary IoU: Improving Object-Centric Image Segmentation Evaluationcited by 186
- 2021Bootstrapping Semantic Segmentation with Regional Contrastcited by 80
8 more
- 2024UniMatch V2: Pushing the Limit of Semi-Supervised Semantic Segmentationcited by 53
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 49
- 2022Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentationcited by 47
- 2021Scribble-Supervised Semantic Segmentation by Uncertainty Reduction on Neural Representation and Self-Supervision on Neural Eigenspacecited by 19
- 2019Deep-Learning-Based Image Segmentation Integrated with Optical Microscopy for Automatically Searching for Two-Dimensional Materialscited by 17
- 2024Modeling the Label Distributions for Weakly-Supervised Semantic Segmentationcited by 7
- 2022SASFormer: Transformers for Sparsely Annotated Semantic Segmentationcited by 6
- 2024Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasetscited by 4
Built on by
Not cited yet.