HEPTv2: End-to-End Efficient Point Transformer for Charged Particle Reconstruction
Not on the map. Why?
Abstract (arXiv)
Charged-particle tracking -- reconstructing trajectories from sparse detector measurements -- is a fundamental high-energy-physics inference problem and a canonical example of learning under extreme combinatorial ambiguity. At the High-Luminosity Large Hadron Collider (HL-LHC), tracking must remain accurate and efficient despite unprecedented collision densities. Graph neural networks perform strongly, but incur substantial costs from graph construction and processing, while transformer-based approaches rely on auxiliary stages that prevent end-to-end optimization. To address this, we present HEPTv2, an end-to-end point-transformer architecture that reconstructs tracks from detector hits in one trainable pipeline. HEPTv2 combines a locality-aware point encoder with a track decoder that predicts complete trajectories without graph-building, clustering, or filtering. The encoder uses locality-sensitive hashing in detector coordinate space to preserve tracking-relevant geometry while enabling efficient local attention. The decoder resolves ambiguities through sectorized decoding and direct hit-to-track prediction under joint encoder-decoder supervision, allowing the full pipeline to be optimized end-to-end. On TrackML, HEPTv2 achieves 98.6% double-majority tracking efficiency at a 0.8% fake rate, while requiring only ~15~ms inference time and 0.4~GB peak memory per event on a NVIDIA A100 GPU. Latency and memory scale approximately linearly for events with up to 5×105 hits. HEPTv2 establishes a new state of the art in the accuracy-latency trade-off, improving efficiency by 4.5% over the strongest prior transformer and by 1.1--2.2% over optimized graph-based pipelines, while reducing latency by factors of 7 and 38--52, respectively. These results show end-to-end transformers can deliver the accuracy and efficiency required for real-time particle reconstruction at the HL-LHC.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
24 of 43 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
- 2025Muon is Scalable for LLM Trainingcited by 381
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2024QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Servingcited by 200
- 2024FlatQuant: Flatness Matters for LLM Quantizationcited by 116
12 more
- 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 72
- 2019Learning representations of irregular particle-detector geometry with distance-weighted graph networkscited by 43
- 2021MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networkscited by 36
- 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
- 2021Performance of a Geometric Deep Learning Pipeline for HL-LHC Particle Trackingcited by 29
- 2021Charged particle tracking via edge-classifying interaction networkscited by 19
- 2021Graph Neural Networks for Charged Particle Tracking on FPGAscited by 17
- 2019Scalable Deep Convolutional Neural Networks for Sparse, Locally Dense Liquid Argon Time Projection Chamber Datacited by 16
- 2024Locality-Sensitive Hashing-Based Efficient Point Transformer with Applications in High-Energy Physicscited by 12
- 2023Hierarchical Graph Neural Networks for Particle Track Reconstructioncited by 7
- 2023High Pileup Particle Tracking with Object Condensationcited by 7
- 2022GraphNeT: Graph neural networks for neutrino telescope event reconstructioncited by 3
Built on by
Not cited yet.