mlsanityData to 14 Oct 2026

Geometric Mean Pooling for Equal-Weight Multiplicative Coarse-Graining

arXiv 2609.21876 ↗First posted 18 Sep 2026cs.LG stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

As an alternative to the additive and extremal biases of average and max pooling, we introduce Geometric Mean Pooling (GMP), a signed pooling operator that combines the product of feature signs with the geometric mean of feature magnitudes. Motivated by local-to-global composition in quantum many-body physics, GMP retains both joint sign information and a characteristic multiplicative scale without introducing learnable pooling parameters. We show that non-overlapping hierarchical GMP preserves the corresponding global multiplicative statistic and evaluate it on synthetic sequence tasks, iterative coarse-graining, image classification, and molecular lipophilicity regression. On the synthetic tasks, GMP recovers product-based signals more accurately than average and max pooling and maintains predictive performance under the tested levels of multiplicative input noise. On image and molecular data, however, its effectiveness depends on the representation, target parameterization, and placement of local and global pooling. These results position GMP as a complementary, regime-dependent inductive bias for tasks in which equal-weight multiplicative composition is plausible, rather than as a universal replacement for standard pooling operators.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

26 of 56 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  6. 2017Deep Setscited by 1,421
  7. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
  8. 2013Network In Networkcited by 605
  9. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  10. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
  11. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 375
  12. 2017Deep Complex Networkscited by 217
14 more
  1. 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 200
  2. 2020Primal-Dual Mesh Convolutional Neural Networkscited by 44
  3. 2013Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networkscited by 32
  4. 2022Ab-initio quantum chemistry with neural-network wavefunctionscited by 29
  5. 2020Neural Arithmetic Unitscited by 28
  6. 2016Learning scale-variant and scale-invariant features for deep image classificationcited by 20
  7. 2018Attention-Aware Generalized Mean Pooling for Image Retrievalcited by 12
  8. 2017Geometric Convolutional Neural Network for Analyzing Surface-Based Neuroimaging Datacited by 8
  9. 2020Neural Power Unitscited by 7
  10. 2023Generalised f-Mean Aggregation for Graph Neural Networkscited by 5
  11. 2022Group Generalized Mean Pooling for Vision Transformercited by 4
  12. 2017Compact Neural Networks based on the Multiscale Entanglement Renormalization Ansatzcited by 3
  13. 2018Alpha-Integration Pooling for Convolutional Neural Networkscited by 2
  14. 2025Torch Geometric Pool: the PyTorch library for pooling in Graph Neural Networkscited by 2

Built on by

Not cited yet.