Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers
Not on the map. Why?
Abstract (arXiv)
The complex events observed at the NOvA long-baseline neutrino oscillation experiment contain vital information for understanding the most elusive particles in the standard model. The NOvA detectors observe interactions of neutrinos from the NuMI beam at Fermilab. Associating the particles produced in these interaction events to their source particles, a process known as reconstruction, is critical for accurately measuring key parameters of the standard model. Events may contain several particles, each producing sparse high-dimensional spatial observations, and current methods are limited to evaluating individual particles. To accurately label these numerous, high-dimensional observations, we present a novel neural network architecture that combines the spatial learning enabled by convolutions with the contextual learning enabled by attention. This joint approach, TransformerCVN, simultaneously classifies each event and reconstructs every individual particle's identity. TransformerCVN classifies events with 90% accuracy and improves the reconstruction of individual particles by 6% over baseline methods which lack the integrated architecture of TransformerCVN. In addition, this architecture enables us to perform several interpretability studies which provide insights into the network's predictions and show that TransformerCVN discovers several fundamental principles that stem from the standard model.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 10 Mar 2023.
Builds on
19 of 36 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
7 more
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 430
- 2016A Convolutional Neural Network Neutrino Event Classifiercited by 26
- 2021SPANet: Generalized Permutationless Set Assignment for Particle Physics using Symmetry Preserving Attentioncited by 18
- 2020Sherpa: Robust Hyperparameter Optimization for Machine Learningcited by 14
- 2022The Quarks of Attentioncited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2.
3 papers.
- 2023Efficient and Robust Jet Tagging at the LHC with Knowledge Distillationcited by 3
- 2025Adapting Vision-Language Models for Neutrino Event Classification in High-Energy Physicscited by 3
- 2025Particle Hit Clustering and Identification Using Point Set Transformers in Liquid Argon Time Projection Chamberscited by 2
- 2025Adapting Vision-Language Models for Neutrino Event Classification in High-Energy Physics10 Sep 2025
- 2025Particle Hit Clustering and Identification Using Point Set Transformers in Liquid Argon Time Projection Chambers11 Apr 2025
- 2023Efficient and Robust Jet Tagging at the LHC with Knowledge Distillation23 Nov 2023