mlsanityData to 7 Oct 2026

HEPTv2: End-to-End Efficient Point Transformer for Charged Particle Reconstruction

arXiv 2606.20437 ↗First posted 18 Jun 2026hep-ex cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Charged-particle tracking -- reconstructing trajectories from sparse detector measurements -- is a fundamental high-energy-physics inference problem and a canonical example of learning under extreme combinatorial ambiguity. At the High-Luminosity Large Hadron Collider (HL-LHC), tracking must remain accurate and efficient despite unprecedented collision densities. Graph neural networks perform strongly, but incur substantial costs from graph construction and processing, while transformer-based approaches rely on auxiliary stages that prevent end-to-end optimization. To address this, we present HEPTv2, an end-to-end point-transformer architecture that reconstructs tracks from detector hits in one trainable pipeline. HEPTv2 combines a locality-aware point encoder with a track decoder that predicts complete trajectories without graph-building, clustering, or filtering. The encoder uses locality-sensitive hashing in detector coordinate space to preserve tracking-relevant geometry while enabling efficient local attention. The decoder resolves ambiguities through sectorized decoding and direct hit-to-track prediction under joint encoder-decoder supervision, allowing the full pipeline to be optimized end-to-end. On TrackML, HEPTv2 achieves 98.6% double-majority tracking efficiency at a 0.8% fake rate, while requiring only ~15~ms inference time and 0.4~GB peak memory per event on a NVIDIA A100 GPU. Latency and memory scale approximately linearly for events with up to 5×105 hits. HEPTv2 establishes a new state of the art in the accuracy-latency trade-off, improving efficiency by 4.5% over the strongest prior transformer and by 1.1--2.2% over optimized graph-based pipelines, while reducing latency by factors of 7 and 38--52, respectively. These results show end-to-end transformers can deliver the accuracy and efficiency required for real-time particle reconstruction at the HL-LHC.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 43 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

24 of 43 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  7. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  8. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  9. 2025Muon is Scalable for LLM Trainingcited by 381
  10. 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
  11. 2024QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Servingcited by 200
  12. 2024FlatQuant: Flatness Matters for LLM Quantizationcited by 116
12 more
  1. 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 72
  2. 2019Learning representations of irregular particle-detector geometry with distance-weighted graph networkscited by 43
  3. 2021MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networkscited by 36
  4. 2022ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputscited by 32
  5. 2021Performance of a Geometric Deep Learning Pipeline for HL-LHC Particle Trackingcited by 29
  6. 2021Charged particle tracking via edge-classifying interaction networkscited by 19
  7. 2021Graph Neural Networks for Charged Particle Tracking on FPGAscited by 17
  8. 2019Scalable Deep Convolutional Neural Networks for Sparse, Locally Dense Liquid Argon Time Projection Chamber Datacited by 16
  9. 2024Locality-Sensitive Hashing-Based Efficient Point Transformer with Applications in High-Energy Physicscited by 12
  10. 2023Hierarchical Graph Neural Networks for Particle Track Reconstructioncited by 7
  11. 2023High Pileup Particle Tracking with Object Condensationcited by 7
  12. 2022GraphNeT: Graph neural networks for neutrino telescope event reconstructioncited by 3

Built on by

Not cited yet.