Application of a Mixture of Experts-based Foundation Model to the GlueX DIRC Detector
On the map: Mixture-of-experts → Efficient MoE training and inference systems
Abstract (arXiv)
We present a Mixture-of-Experts-based foundation model applied to the GlueX DIRC detector at Jefferson Lab, demonstrating its utility as a unified framework for fast simulation, particle identification, and hit-level noise filtering of Cherenkov photons. By leveraging a single shared transformer backbone across all tasks, the approach eliminates the fragmentation of task-specific pipelines while maintaining competitive-and in several cases superior-performance relative to established methods. The model operates directly on low-level detector inputs, performing hit-by-hit autoregressive generation over split spatial and temporal vocabularies with continuous kinematic conditioning, and supports class-conditional generation of pions and kaons through its Mixture-of-Experts architecture. We benchmark against the standard geometrical reconstruction and prior deep learning methods across the full kinematic phase space of the GlueX DIRC, demonstrating that the foundation model framework transfers effectively to this detector without architectural modification. This work positions the foundation model as a practical and scalable alternative to the suite of task-specific models currently proposed for GlueX DIRC analysis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Efficient MoE training and inference systems, one of 12 directions in Mixture-of-experts. Builds on 15 of its 33 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
15 of 33 references.
References · 15
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 46
- 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 43
- 2024Finetuning Foundation Models for Joint Analysis Optimizationcited by 18
- 2025OmniJet-αC: Learning point cloud calorimeter simulations using generative transformerscited by 14
- 2025HEP-JEPA: A foundation model for collider physics using joint embedding predictive architecturecited by 13
- 2024Bumblebee: Foundation Model for Particle Physics Discoverycited by 12
3 more
- 2025Towards Foundation Models for Experimental Readout Systems Combining Discrete and Continuous Datacited by 5
- 2025Generative Models for Fast Simulation of Cherenkov Detectors at the Electron-Ion Collidercited by 3
- 2024Deep(er) Reconstruction of Imaging Cherenkov Detectors with Swin Transformers and Normalizing Flow Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Panda Diplomacy: Foundation Model Pre-training across Particle Imaging Detectors for High Energy and Nuclear Physics
- 2025Mixture-of-Experts Graph Transformers for Interpretable Particle Collision Detection
- 2026Conditional Capacity and Routing in Mixture-of-Experts Particle Transformers
- 2026Generalizable Foundation Models for Calorimetry via Mixtures-of-Experts and Parameter Efficient Fine Tuning
- 2025Panda: Self-distillation of Reusable Sensor-level Representations for High Energy Physics
- 2025Even Faster Simulations with Flow Matching: A Study of Zero Degree Calorimeter Responses
- 2025Scalable Multi-Task Learning for Particle Collision Event Reconstruction with Heterogeneous Graph Neural Networks
- 2026Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts