# Unsupervised Semantic Aggregation and Deformable Template Matching for Semi-Supervised Learning

arXiv: https://arxiv.org/abs/2010.05517 · HTML: https://mlsanity.com/paper/2010.05517/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Oct 2020.

## Built on by (most cited first, 14 of 14)

- [DASO: Distribution-Aware Semantics-Oriented Pseudo-label for Imbalanced Semi-Supervised Learning](https://mlsanity.com/paper/2106.05682/) (2021)
- [Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization](https://mlsanity.com/paper/2108.02183/) (2021)
- [PiCO+: Contrastive Label Disambiguation for Robust Partial Label Learning](https://mlsanity.com/paper/2201.08984/) (2022)
- [DP-SSL: Towards Robust Semi-supervised Learning with A Few Labeled Samples](https://mlsanity.com/paper/2110.13740/) (2021)
- [Barely-Supervised Learning: Semi-Supervised Learning with very few labeled images](https://mlsanity.com/paper/2112.12004/) (2021)
- [ScanMix: Learning from Severe Label Noise via Semantic Clustering and Semi-Supervised Learning](https://mlsanity.com/paper/2103.11395/) (2021)
- [Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Data](https://mlsanity.com/paper/2208.11870/) (2022)
- [Towards Effective Visual Representations for Partial-Label Learning](https://mlsanity.com/paper/2305.06080/) (2023)
- [MaxMatch: Semi-Supervised Learning with Worst-Case Consistency](https://mlsanity.com/paper/2209.12611/) (2022)
- [DoubleMatch: Improving Semi-Supervised Learning with Self-Supervision](https://mlsanity.com/paper/2205.05575/) (2022)
- [OwMatch: Conditional Self-Labeling with Consistency for Open-World Semi-Supervised Learning](https://mlsanity.com/paper/2411.01833/) (2024)
- [Mixed Semi-Supervised Generalized-Linear-Regression with Applications to Deep-Learning and Interpolators](https://mlsanity.com/paper/2302.09526/) (2023)
- [Taming Overconfident Prediction on Unlabeled Data from Hindsight](https://mlsanity.com/paper/2112.08200/) (2021)
- [Imbalanced Aircraft Data Anomaly Detection](https://mlsanity.com/paper/2305.10082/) (2023)

## Abstract (arXiv)

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL) demonstrates a promising future in leveraging few samples. In this paper, we combine both to propose an Unsupervised Semantic Aggregation and Deformable Template Matching (USADTM) framework for SSL, which strives to improve the classification performance with few labeled data and then reduce the cost in data annotating. Specifically, unsupervised semantic aggregation based on Triplet Mutual Information (T-MI) loss is explored to generate semantic labels for unlabeled data. Then the semantic labels are aligned to the actual class by the supervision of labeled data. Furthermore, a feature pool that stores the labeled samples is dynamically updated to assign proxy labels for unlabeled data, which are used as targets for cross-entropy minimization. Extensive experiments and analysis across four standard semi-supervised learning benchmarks validate that USADTM achieves top performance (e.g., 90.46% accuracy on CIFAR-10 with 40 labels and 95.20% accuracy with 250 labels). The code is released at https://github.com/taohan10200/USADTM.
