mlsanityData to 14 Oct 2026

Attention to Mean-Fields for Particle Cloud Generation

arXiv 2305.15254 ↗First posted 24 May 2023hep-ex cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

The generation of collider data using machine learning has emerged as a prominent research topic in particle physics due to the increasing computational challenges associated with traditional Monte Carlo simulation methods, particularly for future colliders with higher luminosity. Although generating particle clouds is analogous to generating point clouds, accurately modelling the complex correlations between the particles presents a considerable challenge. Additionally, variable particle cloud sizes further exacerbate these difficulties, necessitating more sophisticated models. In this work, we propose a novel model that utilizes an attention-based aggregation mechanism to address these challenges. The model is trained in an adversarial training paradigm, ensuring that both the generator and critic exhibit permutation equivariance/invariance with respect to their input. A novel feature matching loss in the critic is introduced to stabilize the training. The proposed model performs competitively to the state-of-art whilst having significantly fewer parameters.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 24 May 2023.

Builds on

15 of 25 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2016Layer Normalizationcited by 5,669
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2017Improved Training of Wasserstein GANscited by 2,235
  9. 2016Language Modeling with Gated Convolutional Networkscited by 702
  10. 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 132
  11. 2021A Living Review of Machine Learning for Particle Physicscited by 78
  12. 2021Particle Cloud Generation with Message Passing Generative Adversarial Networkscited by 46
3 more
  1. 2023PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physicscited by 27
  2. 2023EPiC-GAN: Equivariant Point Cloud Generation for Particle Jetscited by 23
  3. 2017On the Effects of Batch and Weight Normalization in Generative Adversarial Networkscited by 13

Built on by

Cited by year

Citing papers per year: 2023: 7; 2024: 5.

12 papers.