Conditional Set Generation with Transformers
Not on the map. Why?
Abstract (arXiv)
A set is an unordered collection of unique elements--and yet many machine learning models that generate sets impose an implicit or explicit ordering. Since model performance can depend on the choice of order, any particular ordering can lead to sub-optimal results. An alternative solution is to use a permutation-equivariant set generator, which does not specify an order-ing. An example of such a generator is the DeepSet Prediction Network (DSPN). We introduce the Transformer Set Prediction Network (TSPN), a flexible permutation-equivariant model for set prediction based on the transformer, that builds upon and outperforms DSPN in the quality of predicted set elements and in the accuracy of their predicted sizes. We test our model on MNIST-as-point-clouds (SET-MNIST) for point-cloud generation and on CLEVR for object detection.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 10; 2024: 1; 2025: 4; 2026: 1.
32 papers.
Sort:
By area:
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2022Complex-Valued Autoencoders for Object Discoverycited by 40
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2023CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulationcited by 33
- 2023Rotating Features for Object Discoverycited by 29
- 2021A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learningcited by 27
- 2023EPiC-GAN: Equivariant Point Cloud Generation for Particle Jetscited by 23
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
- 2023Prefix-Tree Decoding for Predicting Mass Spectra from Moleculescited by 16
20 more
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoningcited by 15
- 2023Object-Centric Learning with Slot Mixture Modulecited by 11
- 2022Learning Neural Set Functions Under the Optimal Subset Oraclecited by 10
- 2022Conditional set generation using Seq2seq modelscited by 7
- 2022Robust and Controllable Object-Centric Learning through Energy-based Modelscited by 7
- 2023Let There Be Order: Rethinking Ordering in Autoregressive Graph Generationcited by 7
- 2021Set-to-Sequence Methods in Machine Learning: a Reviewcited by 6
- 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matchingcited by 6
- 2024Binding Dynamics in Rotating Featurescited by 5
- 2021Set Representation Learning with Generalized Sliced-Wasserstein Embeddingscited by 4
- 2023Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learningcited by 4
- 2023AudioSlots: A slot-centric generative model for audio separationcited by 4
- 2025Advances in Set Function Learning: A Survey of Techniques and Applicationscited by 3
- 2022Search for Concepts: Discovering Visual Concepts Using Direct Optimizationcited by 2
- 2022Sequence-to-Set Generative Modelscited by 1
- 2023Image To Tree with Recursive Promptingcited by 1
- 2023Outfit Completion via Conditional Set Transformationcited by 0
- 2025Tokenize Image as a Setcited by 0
- 2025Compressive Meta-Learningcited by 0
- 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generationcited by 0
- 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generation29 Sep 2026
- 2025Compressive Meta-Learning14 Aug 2025
- 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matching8 Jun 2025
- 2025Tokenize Image as a Set20 Mar 2025
- 2025Advances in Set Function Learning: A Survey of Techniques and Applications24 Jan 2025
- 2024Binding Dynamics in Rotating Features8 Feb 2024
- 2023Outfit Completion via Conditional Set Transformation28 Nov 2023
- 2023Object-Centric Learning with Slot Mixture Module8 Nov 2023
- 2023Rotating Features for Object Discovery1 Jun 2023
- 2023Let There Be Order: Rethinking Ordering in Autoregressive Graph Generation24 May 2023
- 2023AudioSlots: A slot-centric generative model for audio separation9 May 2023
- 2023CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulation8 May 2023
20 more
- 2023Prefix-Tree Decoding for Predicting Mass Spectra from Molecules11 Mar 2023
- 2023Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning24 Feb 2023
- 2023EPiC-GAN: Equivariant Point Cloud Generation for Particle Jets17 Jan 2023
- 2023Image To Tree with Recursive Prompting1 Jan 2023
- 2022Search for Concepts: Discovering Visual Concepts Using Direct Optimization25 Oct 2022
- 2022Robust and Controllable Object-Centric Learning through Energy-based Models11 Oct 2022
- 2022Sequence-to-Set Generative Models19 Sep 2022
- 2022Conditional set generation using Seq2seq models25 May 2022
- 2022Complex-Valued Autoencoders for Object Discovery5 Apr 2022
- 2022Equivariant Diffusion for Molecule Generation in 3D31 Mar 2022
- 2022Learning Neural Set Functions Under the Optimal Subset Oracle3 Mar 2022
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation23 Nov 2021
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesis7 Oct 2021
- 2021Top-N: Equivariant set and graph generation without exchangeability5 Oct 2021
- 2021A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learning3 Jun 2021
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning2 Jun 2021
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation2 Apr 2021
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data29 Mar 2021
- 2021Set-to-Sequence Methods in Machine Learning: a Review17 Mar 2021
- 2021Set Representation Learning with Generalized Sliced-Wasserstein Embeddings5 Mar 2021
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2022Complex-Valued Autoencoders for Object Discoverycited by 40
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2023CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulationcited by 33
- 2023Rotating Features for Object Discoverycited by 29
- 2021A Consciousness-Inspired Planning Agent for Model-Based Reinforcement Learningcited by 27
- 2023EPiC-GAN: Equivariant Point Cloud Generation for Particle Jetscited by 23
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
- 2023Prefix-Tree Decoding for Predicting Mass Spectra from Moleculescited by 16
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoningcited by 15
12 most cited of 29 All 29 (JSON)
- 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generation29 Sep 2026
- 2025Compressive Meta-Learning14 Aug 2025
- 2025Tokenize Image as a Set20 Mar 2025
- 2025Advances in Set Function Learning: A Survey of Techniques and Applications24 Jan 2025
- 2024Binding Dynamics in Rotating Features8 Feb 2024
- 2023Outfit Completion via Conditional Set Transformation28 Nov 2023
- 2023Object-Centric Learning with Slot Mixture Module8 Nov 2023
- 2023Rotating Features for Object Discovery1 Jun 2023
- 2023Let There Be Order: Rethinking Ordering in Autoregressive Graph Generation24 May 2023
- 2023AudioSlots: A slot-centric generative model for audio separation9 May 2023
- 2023CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulation8 May 2023
- 2023Prefix-Tree Decoding for Predicting Mass Spectra from Molecules11 Mar 2023
12 newest of 29 All 29 (JSON)