Panda Diplomacy: Foundation Model Pre-training across Particle Imaging Detectors for High Energy and Nuclear Physics
Not on the map. Why?
Abstract (arXiv)
Foundation models are increasingly being pursued in particle and nuclear physics, but existing approaches remain strongly tied to individual experiments through detector-specific architectures or pre-training objectives, limiting their reuse across sensing modalities. We show that a point cloud self-distillation framework yields a substantially more general sensor-level pre-training recipe. We show that the same refined architecture and objective can be independently pre-trained with minimal changes on three qualitatively different detector modalities: liquid argon time projection chamber (LArTPC), collider TPC, and water Cherenkov. Using 1,000 labeled images for downstream task adaptation, Panda V2 matches or exceeds specialized foundation-model baselines trained with orders of magnitude more supervision, matching state-of-the-art particle-clustering performance with 70x fewer labeled events on sPHENIX while substantially improving particle identification, and on LArTPC data matching Panda (arXiv:2512.01324) particle reconstruction with up to 1,000x fewer labels. Beyond reconstruction, simple linear probes reveal physically meaningful latent structure associated with particle causality and track curvature.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 40 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
27 of 40 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 456
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 108
- 2023Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learningcited by 55
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
15 more
- 2025Concerto: Joint 2D-3D Self-Supervised Learning Emerges Spatial Representationscited by 42
- 2023Point2Vec for Self-Supervised Representation Learning on Point Cloudscited by 28
- 2024Is Tokenization Needed for Masked Particle Modelling?cited by 20
- 2026Utonia: Toward One Encoder for All Point Cloudscited by 18
- 2025LitePT: Lighter Yet Stronger Point Transformercited by 17
- 2019Scalable Deep Convolutional Neural Networks for Sparse, Locally Dense Liquid Argon Time Projection Chamber Datacited by 16
- 2021Scalable, End-to-End, Deep-Learning-Based Data Reconstruction Chain for Particle Imaging Detectorscited by 11
- 2025Particle Trajectory Representation Learning with Masked Point Modelingcited by 8
- 2025RINO: Renormalization Group Invariance with No Labelscited by 6
- 2025FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physicscited by 5
- 2025Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene Understandingcited by 4
- 2026Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactionscited by 3
- 2026End-to-end Differentiable Calibration and Reconstruction for Optical Particle Detectorscited by 2
- 2026Towards foundation-style models for energy-frontier heterogeneous neutrino detectors via self-supervised pre-trainingcited by 2
- 2026GhostPoint: Self-Supervised Representation Learning by Hallucinating Occluded LiDAR Structurecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.