Attention to Mean-Fields for Particle Cloud Generation
Not on the map. Why?
Abstract (arXiv)
The generation of collider data using machine learning has emerged as a prominent research topic in particle physics due to the increasing computational challenges associated with traditional Monte Carlo simulation methods, particularly for future colliders with higher luminosity. Although generating particle clouds is analogous to generating point clouds, accurately modelling the complex correlations between the particles presents a considerable challenge. Additionally, variable particle cloud sizes further exacerbate these difficulties, necessitating more sophisticated models. In this work, we propose a novel model that utilizes an attention-based aggregation mechanism to address these challenges. The model is trained in an adversarial training paradigm, ensuring that both the generator and critic exhibit permutation equivariance/invariance with respect to their input. A novel feature matching loss in the critic is introduced to stabilize the training. The proposed model performs competitively to the state-of-art whilst having significantly fewer parameters.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
15 of 25 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Layer Normalizationcited by 5,669
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2016Improved Techniques for Training GANscited by 2,970
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 132
- 2021A Living Review of Machine Learning for Particle Physicscited by 78
- 2021Particle Cloud Generation with Message Passing Generative Adversarial Networkscited by 46
Built on by
Citing papers per year: 2023: 7; 2024: 5.
12 papers.
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 46
- 2023CaloClouds II: Ultra-Fast Geometry-Independent Highly-Granular Calorimeter Simulationcited by 20
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2023EPiC-ly Fast Particle Cloud Generation with Flow-Matching and Diffusioncited by 17
- 2024Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flowscited by 13
- 2023PC-Droid: Faster diffusion and improved quality for particle cloud generationcited by 8
- 2023Flow Matching Beyond Kinematics: Generating Jets with Particle-ID and Trajectory Displacement Informationcited by 7
- 2024PIPPIN: Generating variable length full events from partonscited by 6
- 2024Scaling Up Diffusion and Flow-based XGBoost Modelscited by 5
- 2023Induced Generative Adversarial Particle Transformerscited by 3
- 2024Jet Discrimination with Quantum Complete Graph Neural Networkcited by 3
- 2023DeepTreeGANv2: Iterative Pooling of Point Cloudscited by 2
- 2024Scaling Up Diffusion and Flow-based XGBoost Models28 Aug 2024
- 2024PIPPIN: Generating variable length full events from partons18 Jun 2024
- 2024Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flows30 May 2024
- 2024Jet Discrimination with Quantum Complete Graph Neural Network8 Mar 2024
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models24 Jan 2024
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
- 2023Induced Generative Adversarial Particle Transformers8 Dec 2023
- 2023Flow Matching Beyond Kinematics: Generating Jets with Particle-ID and Trajectory Displacement Information30 Nov 2023
- 2023DeepTreeGANv2: Iterative Pooling of Point Clouds24 Nov 2023
- 2023EPiC-ly Fast Particle Cloud Generation with Flow-Matching and Diffusion29 Sep 2023
- 2023CaloClouds II: Ultra-Fast Geometry-Independent Highly-Granular Calorimeter Simulation11 Sep 2023
- 2023PC-Droid: Faster diffusion and improved quality for particle cloud generation13 Jul 2023