mlsanityData to 7 Oct 2026

JetParticle-JEPA: An Efficient Self-Supervised Representation Learning method for Jet Tagging in High-Energy Physics

arXiv 2606.14813 ↗First posted 12 Jun 2026hep-ph cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Jet tagging at the Large Hadron Collider increasingly relies on deep learning models trained on massive simulated datasets, leading to high computational costs and limited robustness to detector mismodeling. We introduce JetParticle-JEPA (JP-JEPA), a self-supervised Joint-Embedding Predictive Architecture that learns physically meaningful jet representations directly from continuous particle clouds without tokenization or reconstruction of raw inputs. Built on a Particle Transformer backbone, JP-JEPA predicts latent representations of masked particles while preserving fine-grained kinematic correlations. On the JetClass benchmark, JP-JEPA achieves performance comparable to fully supervised state-of-the-art methods on the full dataset, surpasses supervised baselines in low-label regimes, and significantly outperforms existing SSL approaches. On Top Quark and Quark-Gluon Tagging benchmarks, it remains on par with supervised methods. The learned representations also exhibit strong robustness to missing detector information and improved uncertainty behavior, highlighting JP-JEPA as a promising foundation-model framework for robust and data-efficient jet physics at the LHC.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 51 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

30 of 51 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  7. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  8. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  9. 2017On Calibration of Modern Neural Networkscited by 4,860
  10. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  11. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  12. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
18 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  2. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 227
  3. 2018Spreading vectors for similarity searchcited by 114
  4. 2022Particle Transformer for Jet Taggingcited by 95
  5. 2018Energy Flow Networks: Deep Sets for Particle Jetscited by 83
  6. 2021Machine Learning in the Search for New Fundamental Physicscited by 50
  7. 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
  8. 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 41
  9. 2024Lorentz-Equivariant Geometric Algebra Transformers for High-Energy Physicscited by 36
  10. 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 33
  11. 2023Learning Efficient Coding of Natural Images with Maximum Manifold Capacity Representationscited by 31
  12. 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
  13. 2024Is Tokenization Needed for Masked Particle Modelling?cited by 20
  14. 2025Lorentz Local Canonicalization: How to Make Any Network Lorentz-Equivariantcited by 12
  15. 2024Learning Symmetry-Independent Jet Representations via Jet-Based Joint Embedding Predictive Architecturecited by 11
  16. 2025HEP-JEPA: A foundation model for collider physics using joint embedding predictive architecturecited by 11
  17. 2024Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representationscited by 8
  18. 2024Learning to Compress: Local Rank and Information Compression in Deep Neural Networkscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.