Neural Operators Can Discover Functional Clusters
Not on the map. Why?
Abstract (arXiv)
Operator learning is reshaping scientific computing by amortizing inference across infinite families of problems. While neural operators (NOs) are increasingly well understood for regression, far less is known for classification and its unsupervised analogue: clustering. We prove that sample-based neural operators can learn any finite collection of classes in an infinite-dimensional reproducing kernel Hilbert space, even when the classes are neither convex nor connected, under mild kernel sampling assumptions. Our universal clustering theorem shows that any K closed classes can be approximated to arbitrary precision by NO-parameterized classes in the upper Kuratowski topology on closed sets, a notion that can be interpreted as disallowing false-positive misclassifications. Building on this, we develop an NO-powered clustering pipeline for functional data and apply it to unlabeled families of ordinary differential equation (ODE) trajectories. Discretized trajectories are lifted by a fixed pre-trained encoder into a continuous feature map and mapped to soft assignments by a lightweight trainable head. Experiments on diverse synthetic ODE benchmarks show that the resulting practical SNO recovers latent dynamical structure in regimes where classical methods fail, providing evidence consistent with our universal clustering theory.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 42 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
21 of 42 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2018Deep Clustering for Unsupervised Learning of Visual Featurescited by 1,020
- 2015Unsupervised Deep Embedding for Clustering Analysiscited by 763
- 2018Invariant Information Clustering for Unsupervised Image Classification and Segmentationcited by 454
- 2024VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasterscited by 87
- 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
- 2023Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equationcited by 32
9 more
- 2020Non-Euclidean Universal Approximationcited by 29
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2023Leveraging Vision-Language Models for Granular Market Change Predictioncited by 22
- 2023Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Modelscited by 22
- 2015Functional Data Analysis of Amplitude and Phase Variationcited by 16
- 2024Mixtures of Neural Operators Reduce Active Complexity in Operator Learningcited by 16
- 2022Review of Clustering Methods for Functional Datacited by 6
- 2025Shape-Informed Clustering of Multi-Dimensional Functional Data via Deep Functional Autoencoderscited by 4
- 2021Shape Analysis of Functional Data with Elastic Partial Matchingcited by 3
Built on by
Not cited yet.