FSPool: Learning Set Representations with Featurewise Sort Pooling
Not on the map. Why?
Abstract (arXiv)
Traditional set prediction models can struggle with simple datasets due to an issue we call the responsibility problem. We introduce a pooling method for sets of feature vectors based on sorting features across elements of the set. This can be used to construct a permutation-equivariant auto-encoder that avoids this responsibility problem. On a toy dataset of polygons and a set version of MNIST, we show that such an auto-encoder produces considerably better reconstructions and representations. Replacing the pooling function in existing set encoders with FSPool improves accuracy and convergence speed on a variety of datasets.
Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 6; 2023: 8; 2024: 8; 2025: 11; 2026: 3.
53 papers.
Sort:
By area:
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalizationcited by 41
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learningcited by 38
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2023Neural Injective Functions for Multisets, Measures and Graphs via a Finite Witness Theoremcited by 33
- 2021Neural Auction: End-to-End Learning of Auction Mechanisms for E-Commerce Advertisingcited by 31
- 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collidercited by 28
- 2023Object-centric architectures enable efficient causal representation learningcited by 21
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoningcited by 15
- 2022Lorentz group equivariant autoencoderscited by 15
38 more
- 2021Particle Graph Autoencoders and Differentiable, Learned Energy Mover's Distancecited by 10
- 2023Complete Neural Networks for Complete Euclidean Graphscited by 10
- 2024PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesiscited by 10
- 2024On permutation-invariant neural networkscited by 10
- 2025ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Planscited by 10
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddingscited by 9
- 2021Multimodal Fusion Refiner Networkscited by 8
- 2025Fourier Sliced-Wasserstein Embedding for Multisets and Measurescited by 8
- 2021Contextualized Scene Imagination for Generative Commonsense Reasoningcited by 7
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networkscited by 7
- 2021Mini-Batch Consistent Slot Set Encoder for Scalable Set Encodingcited by 6
- 2021Set-to-Sequence Methods in Machine Learning: a Reviewcited by 6
- 2022Conditional Permutation Invariant Flowscited by 6
- 2023Polynomial Width is Sufficient for Set Representation with High-dimensional Featurescited by 6
- 2024On the H"older Stability of Multiset and Graph Neural Networkscited by 6
- 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matchingcited by 6
- 2021USCO-Solver: Solving Undetermined Stochastic Combinatorial Optimization Problemscited by 5
- 2021Set Representation Learning with Generalized Sliced-Wasserstein Embeddingscited by 4
- 2022Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximationcited by 4
- 2023Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learningcited by 4
- 2023The Responsibility Problem in Neural Networks with Unordered Targetscited by 4
- 2024Generalization Bounds via Meta-Learned Model Representations: PAC-Bayes and Sample Compression Hypernetworkscited by 3
- 2025Advances in Set Function Learning: A Survey of Techniques and Applicationscited by 3
- 2025Mechanistic Independence: A Principle for Identifiable Disentangled Representationscited by 3
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networkscited by 3
- 2023Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classificationcited by 2
- 2025CheMixHub: Datasets and Benchmarks for Chemical Mixture Property Predictioncited by 2
- 2021Investigating transformers in the decomposition of polygonal shapes as point collectionscited by 1
- 2021The CAT SET on the MAT: Cross Attention for Set Matching in Bipartite Hypergraphscited by 1
- 2024Linear optimal transport subspaces for point set classificationcited by 1
- 2022GausSetExpander: A Simple Approach for Entity Set Expansioncited by 0
- 2022Effective and Interpretable Information Aggregation with Capacity Networkscited by 0
- 2024Approximating invariant functions with the sorting trick is theoretically justifiedcited by 0
- 2024Fourier Sliced-Wasserstein Embedding for Multisets and Measurescited by 0
- 2025Permutation-Invariant Transformer Neural Architectures for Set-Based Indoor Localization Using Learned RSSI Embeddingscited by 0
- 2025Wasserstein Hypergraph Neural Networkcited by 0
- 2025EMPEROR: Efficient Moment-Preserving Representation of Distributionscited by 0
- 2025Convolutional Set Transformercited by 0
50 most cited of 53 All 53 (JSON)
- 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generation29 Sep 2026
- 2026Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption28 May 2026
- 2026Improving Set Function Approximation with Quasi-Arithmetic Neural Networks4 Feb 2026
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Convolutional Set Transformer26 Sep 2025
- 2025Mechanistic Independence: A Principle for Identifiable Disentangled Representations26 Sep 2025
- 2025EMPEROR: Efficient Moment-Preserving Representation of Distributions19 Sep 2025
- 2025CheMixHub: Datasets and Benchmarks for Chemical Mixture Property Prediction13 Jun 2025
- 2025Wasserstein Hypergraph Neural Network11 Jun 2025
- 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matching8 Jun 2025
- 2025Permutation-Invariant Transformer Neural Architectures for Set-Based Indoor Localization Using Learned RSSI Embeddings31 May 2025
- 2025Fourier Sliced-Wasserstein Embedding for Multisets and Measures3 Apr 2025
38 more
- 2025ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Plans11 Feb 2025
- 2025Advances in Set Function Learning: A Survey of Techniques and Applications24 Jan 2025
- 2024Generalization Bounds via Meta-Learned Model Representations: PAC-Bayes and Sample Compression Hypernetworks17 Oct 2024
- 2024On the H"older Stability of Multiset and Graph Neural Networks11 Jun 2024
- 2024Fourier Sliced-Wasserstein Embedding for Multisets and Measures26 May 2024
- 2024On permutation-invariant neural networks26 Mar 2024
- 2024Linear optimal transport subspaces for point set classification15 Mar 2024
- 2024Approximating invariant functions with the sorting trick is theoretically justified4 Mar 2024
- 2024PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis28 Feb 2024
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalization25 Feb 2024
- 2023Object-centric architectures enable efficient causal representation learning29 Oct 2023
- 2023Postprocessing of Ensemble Weather Forecasts Using Permutation-invariant Neural Networks8 Sep 2023
- 2023Polynomial Width is Sufficient for Set Representation with High-dimensional Features8 Jul 2023
- 2023Neural Injective Functions for Multisets, Measures and Graphs via a Finite Witness Theorem10 Jun 2023
- 2023Equivariant vs. Invariant Layers: A Comparison of Backbone and Pooling for Point Cloud Classification8 Jun 2023
- 2023The Responsibility Problem in Neural Networks with Unordered Targets19 Apr 2023
- 2023Permutation-Invariant Set Autoencoders with Fixed-Size Embeddings for Multi-Agent Learning24 Feb 2023
- 2023Complete Neural Networks for Complete Euclidean Graphs31 Jan 2023
- 2022Lorentz group equivariant autoencoders14 Dec 2022
- 2022Scalable Set Encoding with Universal Mini-Batch Consistency and Unbiased Full Set Gradient Approximation26 Aug 2022
- 2022Effective and Interpretable Information Aggregation with Capacity Networks25 Jul 2022
- 2022Conditional Permutation Invariant Flows17 Jun 2022
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learning5 May 2022
- 2022GausSetExpander: A Simple Approach for Entity Set Expansion28 Feb 2022
- 2021Contextualized Scene Imagination for Generative Commonsense Reasoning12 Dec 2021
- 2021SLOSH: Set LOcality Sensitive Hashing via Sliced-Wasserstein Embeddings11 Dec 2021
- 2021Particle Graph Autoencoders and Differentiable, Learned Energy Mover's Distance24 Nov 2021
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiation23 Nov 2021
- 2021The CAT SET on the MAT: Cross Attention for Set Matching in Bipartite Hypergraphs30 Oct 2021
- 2021Top-N: Equivariant set and graph generation without exchangeability5 Oct 2021
- 2021Investigating transformers in the decomposition of polygonal shapes as point collections17 Aug 2021
- 2021USCO-Solver: Solving Undetermined Stochastic Combinatorial Optimization Problems15 Jul 2021
- 2021Neural Auction: End-to-End Learning of Auction Mechanisms for E-Commerce Advertising7 Jun 2021
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning2 Jun 2021
- 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider28 May 2021
- 2021Multimodal Fusion Refiner Networks8 Apr 2021
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentation2 Apr 2021
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Data29 Mar 2021
50 newest of 53 All 53 (JSON)
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021SetVAE: Learning Hierarchical Composition for Generative Modeling of Set-Structured Datacited by 78
- 2024Equivariant Frames and the Impossibility of Continuous Canonicalizationcited by 41
- 2022Low Dimensional Invariant Embeddings for Universal Geometric Learningcited by 38
- 2021Top-N: Equivariant set and graph generation without exchangeabilitycited by 36
- 2023Neural Injective Functions for Multisets, Measures and Graphs via a Finite Witness Theoremcited by 33
- 2021Neural Auction: End-to-End Learning of Auction Mechanisms for E-Commerce Advertisingcited by 31
- 2021The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collidercited by 28
- 2023Object-centric architectures enable efficient causal representation learningcited by 21
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
- 2021multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoningcited by 15
- 2022Lorentz group equivariant autoencoderscited by 15
12 most cited of 52 All 52 (JSON)
- 2026GLASS: Global Latent Aggregation with Slot-based Set Decoding for Scalable All-Atom Crystal Generation29 Sep 2026
- 2026Distributionally Robust Set Representation Learning Under Inference-Time Element Corruption28 May 2026
- 2026Improving Set Function Approximation with Quasi-Arithmetic Neural Networks4 Feb 2026
- 2025Adaptive Canonicalization with Application to Invariant Anisotropic Geometric Networks29 Sep 2025
- 2025Convolutional Set Transformer26 Sep 2025
- 2025Mechanistic Independence: A Principle for Identifiable Disentangled Representations26 Sep 2025
- 2025EMPEROR: Efficient Moment-Preserving Representation of Distributions19 Sep 2025
- 2025CheMixHub: Datasets and Benchmarks for Chemical Mixture Property Prediction13 Jun 2025
- 2025Wasserstein Hypergraph Neural Network11 Jun 2025
- 2025Permutation-Invariant Transformer Neural Architectures for Set-Based Indoor Localization Using Learned RSSI Embeddings31 May 2025
- 2025Fourier Sliced-Wasserstein Embedding for Multisets and Measures3 Apr 2025
- 2025ESPFormer: Doubly-Stochastic Attention with Expected Sliced Transport Plans11 Feb 2025
12 newest of 52 All 52 (JSON)