mlsanityData to 14 Oct 2026

Graph Structure from Point Clouds: Geometric Attention is All You Need

arXiv 2307.16662 ↗First posted 31 Jul 2023cs.LG hep-ex hep-phcited by 2

Not on the map. Why?

Abstract (arXiv)

The use of graph neural networks has produced significant advances in point cloud problems, such as those found in high energy physics. The question of how to produce a graph structure in these problems is usually treated as a matter of heuristics, employing fully connected graphs or K-nearest neighbors. In this work, we elevate this question to utmost importance as the Topology Problem. We propose an attention mechanism that allows a graph to be constructed in a learned space that handles geometrically the flow of relevance, providing one solution to the Topology Problem. We test this architecture, called GravNetNorm, on the task of top jet tagging, and show that it is competitive in tagging accuracy, and uses far fewer computational resources than all other comparable models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 36 references that are in the map. First posted on arXiv 31 Jul 2023.

Builds on

15 of 36 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2022Graph Neural Networks for Graphs with Heterophily: A Surveycited by 175
  5. 2022Particle Transformer for Jet Taggingcited by 98
  6. 2018Energy Flow Networks: Deep Sets for Particle Jetscited by 84
  7. 2019Learning representations of irregular particle-detector geometry with distance-weighted graph networkscited by 43
  8. 2021MLPF: Efficient machine-learned particle-flow reconstruction using graph neural networkscited by 36
  9. 2020Distance-Weighted Graph Neural Networks on FPGAs for Real-Time Particle Reconstruction in High Energy Physicscited by 34
  10. 2021Performance of a Geometric Deep Learning Pipeline for HL-LHC Particle Trackingcited by 30
  11. 2019Point Attention Network for Semantic Segmentation of 3D Point Cloudscited by 29
  12. 2021Explaining machine-learned particle-flow reconstructioncited by 12
3 more
  1. 2021Investigating Attention Mechanism in 3D Point Cloud Object Detectioncited by 10
  2. 2021Attention Models for Point Clouds in Deep Learning: A Surveycited by 6
  3. 2022End-to-end multi-particle reconstruction in high occupancy imaging calorimeters with graph neural networkscited by 6

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.