mlsanityData to 14 Oct 2026

JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning

arXiv 2604.21046 ↗First posted 22 Apr 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Semi-supervised learning has emerged as a powerful paradigm for leveraging large amounts of unlabeled data to improve the performance of machine learning models when labeled data are scarce. Among existing approaches, methods derived from FixMatch have achieved state-of-the-art results in image classification by combining weak and strong data augmentations with confidence-based pseudo-labeling. Despite their strong empirical performance, these methods typically struggle with two critical bottlenecks: majority classes tend to dominate the learning process, which is amplified by incorrect pseudo-labels, leading to biased models. Furthermore, noisy early pseudo-labels prevent the model from forming clear decision boundaries, requiring prolonged training to learn informative representation. In this paper, we introduce a paradigm shift from conventional logical output threshold base, toward an explicit shaping of geometric representations. Our approach is inspired by the recently proposed Latent-Euclidean Joint-Embedding Predictive Architectures (LeJEPA), a theoretically grounded framework asserting that meaningful representations should exhibit an isotropic Gaussian structure in latent space. Building on this principle, we propose a new training objective that combines the classical semi-supervised loss used in FlexMatch, an adaptive extension of FixMatch, with a latent-space regularization term derived from LeJEPA. Our proposed approach, encourages well-structured representations while preserving the advantages of pseudo-labeling strategies. Through extensive experiments on CIFAR-100, STL-10 and Tiny-ImageNet, we demonstrate that the proposed method consistently outperforms existing baselines. In addition, our method significantly accelerates the convergence, drastically reducing the overall computational cost compared to standard FixMatch-based pipelines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 38 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

27 of 38 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2016Wide Residual Networkscited by 3,070
  4. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
  5. 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
  6. 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
  7. 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,060
  8. 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
  9. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
  10. 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
  11. 2019ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoringcited by 349
  12. 2021In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learningcited by 301
15 more
  1. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
  2. 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
  3. 2020MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classificationcited by 187
  4. 2020CoMatch: Semi-supervised Learning with Contrastive Graph Regularizationcited by 167
  5. 2022Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methodscited by 149
  6. 2021Dash: Semi-Supervised Learning with Dynamic Thresholdingcited by 148
  7. 2023SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learningcited by 133
  8. 2022SimMatch: Semi-supervised Learning with Similarity Matchingcited by 118
  9. 2021AdaMatch: A Unified Approach to Semi-Supervised Learning and Domain Adaptationcited by 104
  10. 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
  11. 2021Graph-based Semi-supervised Learning: A Comprehensive Reviewcited by 79
  12. 2021Revisiting Consistency Regularization for Semi-Supervised Learningcited by 34
  13. 2023Semi-supervised learning made simple with self-supervised clusteringcited by 20
  14. 2023FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learningcited by 20
  15. 2024RegMixMatch: Optimizing Mixup Utilization in Semi-Supervised Learningcited by 5

Built on by

Not cited yet.