mlsanityData to 7 Oct 2026

Panda Diplomacy: Foundation Model Pre-training across Particle Imaging Detectors for High Energy and Nuclear Physics

arXiv 2609.00611 ↗First posted 1 Sep 2026hep-ex cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Foundation models are increasingly being pursued in particle and nuclear physics, but existing approaches remain strongly tied to individual experiments through detector-specific architectures or pre-training objectives, limiting their reuse across sensing modalities. We show that a point cloud self-distillation framework yields a substantially more general sensor-level pre-training recipe. We show that the same refined architecture and objective can be independently pre-trained with minimal changes on three qualitatively different detector modalities: liquid argon time projection chamber (LArTPC), collider TPC, and water Cherenkov. Using 1,000 labeled images for downstream task adaptation, Panda V2 matches or exceeds specialized foundation-model baselines trained with orders of magnitude more supervision, matching state-of-the-art particle-clustering performance with 70x fewer labeled events on sPHENIX while substantially improving particle identification, and on LArTPC data matching Panda (arXiv:2512.01324) particle reconstruction with up to 1,000x fewer labels. Beyond reconstruction, simple linear probes reveal physically meaningful latent structure associated with particle causality and track curvature.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

27 of 40 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  4. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  5. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  6. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  7. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
  8. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
  9. 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
  10. 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
  11. 2023Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learningcited by 55
  12. 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
15 more
  1. 2025Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representationscited by 42
  2. 2023Point2Vec for Self-Supervised Representation Learning on Point Cloudscited by 28
  3. 2024Is Tokenization Needed for Masked Particle Modelling?cited by 20
  4. 2026Utonia: Toward One Encoder for All Point Cloudscited by 18
  5. 2025LitePT: Lighter Yet Stronger Point Transformercited by 17
  6. 2019Scalable Deep Convolutional Neural Networks for Sparse, Locally Dense Liquid Argon Time Projection Chamber Datacited by 16
  7. 2021Scalable, End-to-End, Deep-Learning-Based Data Reconstruction Chain for Particle Imaging Detectorscited by 11
  8. 2025Particle Trajectory Representation Learning with Masked Point Modelingcited by 8
  9. 2025RINO: Renormalization Group Invariance with No Labelscited by 6
  10. 2025FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physicscited by 5
  11. 2025Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene Understandingcited by 4
  12. 2026Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactionscited by 3
  13. 2026End-to-end Differentiable Calibration and Reconstruction for Optical Particle Detectorscited by 2
  14. 2026Towards foundation-style models for energy-frontier heterogeneous neutrino detectors via self-supervised pre-trainingcited by 2
  15. 2026GhostPoint: Self-Supervised Representation Learning by Hallucinating Occluded LiDAR Structurecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.