mlsanityData to 14 Oct 2026

When Does Equivariance Help? Canonical Alignment in Neural Fluid Surrogates

arXiv 2605.18816 ↗First posted 12 May 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural surrogates can accelerate computational fluid dynamics (CFD) simulations by orders of magnitude, but practical deployment in engineering and healthcare applications requires architectures that scale to high-resolution meshes and learn effectively from limited data. Explicit equivariance offers a principled inductive bias, yet its accuracy benefits may depend on the prediction task and the distribution of anatomical orientations. We investigate this dependence across three hemodynamic benchmarks with different degrees of natural canonical alignment. To support this study, we introduce the Anchored-Branched Geometric Algebra Transformer (AB-GATr), an E(3)-equivariant surrogate that efficiently predicts coupled surface and volume quantities. Across these benchmarks, AB-GATr consistently outperforms the evaluated non-equivariant models, including variants trained with rotational augmentation, while achieving accuracy competitive with E(3)-equivariant LaB-GATr at substantially lower training cost. In comparison, rotational augmentation provides inconsistent benefits across architectures and can reduce accuracy. A controlled experiment on ShapeNet-Car shows that strong canonical alignment can favor non-equivariant models, but their accuracy generally deteriorates as training orientations broaden and can decline sharply under broader test rotations. We further investigate these patterns using extended symmetry-breaking diagnostics and probes of the predictive information associated with canonical alignment across all benchmarks. Together, these results support explicit equivariance for the evaluated hemodynamic tasks with natural orientation variation, while showing that its accuracy benefits depend on the task and orientation distribution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 49 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

32 of 49 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  6. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  7. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  8. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  9. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  10. 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
  11. 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
  12. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
20 more
  1. 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 92
  2. 2022Clifford Neural Layers for PDE Modelingcited by 92
  3. 2023Swallowing the Bitter Pill: Simplified Scalable Conformer Generationcited by 56
  4. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 53
  5. 2024Does equivariance matter at scale?cited by 52
  6. 2023Geometric Algebra Transformercited by 48
  7. 2023Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Spacecited by 41
  8. 2022Mesh Neural Networks for SE(3)-Equivariant Hemodynamics Estimation on the Artery Wallcited by 29
  9. 2025Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systemscited by 22
  10. 2024Grounding Continuous Representations in Geometry: Equivariant Neural Fieldscited by 19
  11. 2023On genuine invariance learning without weight-tyingcited by 14
  12. 2024LaB-GATr: geometric algebra transformers for large biomedical surface and volume meshescited by 12
  13. 2025Probing Equivariance and Symmetry Breaking in Convolutional Networkscited by 12
  14. 2023SE(3) symmetry lets graph neural networks learn arterial velocity estimation from small datasetscited by 11
  15. 2025Platonic Transformers: A Solid Choice For Equivariancecited by 10
  16. 2024Physics-informed graph neural networks for flow field estimation in carotid arteriescited by 6
  17. 2024Deep vectorised operators for pulsatile hemodynamics estimation in coronary arteries from a steady-state priorcited by 6
  18. 2025Geometry aware inference of steady state PDEs using Equivariant Neural Fields representationscited by 6
  19. 2025Active Learning for Deep Learning-Based Hemodynamic Parameter Estimationcited by 2
  20. 2025To Augment or Not to Augment? Diagnosing Distributional Symmetry Breakingcited by 1

Built on by

Not cited yet.