METRO: Metric-Enhanced Token Routing Operator
Not on the map. Why?
Abstract (arXiv)
State-of-the-art neural operators scale to complex meshes via slice-and-process architectures, yet many rely on linear compatibility scores for latent tokenization. Under common feature normalization, such scores are equivalent to isotropic Euclidean clustering, while without normalization they induce unbounded linear decision regions. In both cases, they lack slice-specific anisotropic locality, which can lead to redundant and entangled latent slices. To address this, we propose Metric-Enhanced Token Routing Operator (METRO), a geometry-aware routing mechanism that replaces linear projection with a learnable Mahalanobis metric. By enabling each latent slice to learn a local anisotropic tensor, METRO shapes receptive fields into exponentially localized, oriented ellipsoids that naturally align with flow features like boundary layers and wakes. As a drop-in replacement, METRO yields consistent improvements across both Transformer and Mamba backbones. Empirically, our method achieves substantial performance gains on irregular domains, outperforming baselines on both standard PDE benchmarks and complex industrial design tasks. Finally, METRO exhibits enhanced robustness in out-of-distribution regimes across varying Reynolds numbers and geometric configurations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 43 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
39 of 43 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2016Layer Normalizationcited by 5,669
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2019Graph U-Netscited by 492
27 more
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2021Choose a Transformer: Fourier or Galerkincited by 343
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
- 2021Factorized Fourier Neural Operatorscited by 249
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 221
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 128
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
- 2022Learning Operators with Coupled Attentioncited by 90
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 89
- 2023Operator Learning with Neural Fields: Tackling PDEs on General Geometriescited by 84
- 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 83
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 73
- 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 62
- 2023Improved Operator Learning by Orthogonal Attentioncited by 61
- 2023Beyond Regular Grids: Fourier-Based Neural Operators on Arbitrary Domainscited by 21
- 2024DIMON: Learning Solution Operators of Partial Differential Equations on a Diffeomorphic Family of Domainscited by 16
- 2025Geometric Operator Learning with Optimal Transportcited by 16
- 2025Transolver is a Linear Transformer: Revisiting Physics-Attention through the Lens of Linear Attentioncited by 13
- 2025Latent Mamba Operator for Partial Differential Equationscited by 10
- 2024FUSE: Fast Unified Simulation and Estimation for PDEscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains
- 2026Distance-Aware Attention and Wall-Distance Expert Routing for Transformer-Based 3D Flow Prediction
- 20243D Shape Tokenization via Latent Flow Matching
- 2025CLR-Wire: Towards Continuous Latent Representations for 3D Curve Wireframe Generation
- 2026SeamFlow: Structure-Aware Flow Matching on Edge Probabilities for Artist-Like UV Unwrapping
- 2026TORA: Topological Representation Alignment for 3D Shape Assembly
- 2026Geometry-Preserving Neural Architectures on Manifolds with Boundary
- 2026Geometric Asymmetry in MoE Specialization: Functional Decorrelation and Representational Overlap