mlsanityData to 7 Oct 2026

AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformers

arXiv 2502.09692 ↗First posted 13 Feb 2025cs.LG cs.AIcited by 49

Not on the map. Why?

Abstract (arXiv)

Recent advances in neural surrogate modeling offer the potential for transformative innovations in applications such as automotive aerodynamics. Yet, industrial-scale problems often involve volumetric meshes with cell counts reaching 100 million, presenting major scalability challenges. Complex geometries further complicate modeling through intricate surface-volume interactions, while quantities such as vorticity are highly nonlinear and must satisfy strict divergence-free constraints. To address these requirements, we introduce AB-UPT as a novel modeling scheme for building neural surrogates for CFD simulations. AB-UPT is designed to: (i) decouple geometry encoding and prediction tasks via multi-branch operators; (ii) enable scalability to high-resolution outputs via neural simulation in a low-dimensional latent space, coupled with anchored neural field decoders to predict high-fidelity outputs; (iii) enforce physics consistency by a divergence-free formulation. We show that AB-UPT yields state-of-the-art predictive accuracy of surface and volume fields on automotive CFD simulations ranging from 33 thousand up to 150 million mesh cells. Furthermore, our anchored neural field architecture enables the enforcement of hard physical constraints on the physics predictions without degradation in performance, exemplified by modeling divergence-free vorticity fields. Notably, the proposed models can be trained on a single GPU in less than a day and predict industry-standard surface and volume fields within seconds. Additionally, we show that the flexible design of our method enables neural simulation from a CAD geometry alone, thereby eliminating the need for costly CFD meshing procedures for inference.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). Builds on 57 of its 93 references that are in the map. First posted on arXiv 13 Feb 2025.

Builds on

57 of 93 references.

References · 57

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  8. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  9. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  10. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  12. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
38 more
  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  5. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  6. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  7. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  8. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  9. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  10. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  11. 2019Graph U-Netscited by 489
  12. 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 448
  13. 2023Symbolic Discovery of Optimization Algorithmscited by 423
  14. 2019Machine Learning for Fluid Mechanicscited by 380
  15. 2021Choose a Transformer: Fourier or Galerkincited by 333
  16. 2023ClimaX: A foundation model for weather and climatecited by 325
  17. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  18. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  19. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  20. 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
  21. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  22. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  23. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 118
  24. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
  25. 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
  26. 2024Latent Neural Operator for Solving Forward and Inverse PDE Problemscited by 76
  27. 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 74
  28. 2021Physics-based Deep Learningcited by 67
  29. 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
  30. 2023Learning Physical Models that Can Respect Conservation Lawscited by 58
  31. 2023Improved Operator Learning by Orthogonal Attentioncited by 58
  32. 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
  33. 2024AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fieldscited by 38
  34. 2022Learning differentiable solvers for systems with hard constraintscited by 34
  35. 2024DrivAerNet: A Parametric Car Dataset for Data-Driven Aerodynamic Design and Predictioncited by 33
  36. 2024DrivAerML: High-Fidelity Computational Fluid Dynamics Dataset for Road-Car External Aerodynamicscited by 33
  37. 2024Recent Advances on Machine Learning for Computational Fluid Dynamics: A Surveycited by 27
  38. 2022Latent Bottlenecked Attentive Neural Processescited by 26

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 11; 2026: 38.

49 papers.

Sort:

By area:

  1. 2025Erwin: A Tree-based Hierarchical Transformer for Large-scale Physical Systemscited by 21
  2. 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 20
  3. 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
  4. 2025CarBench: A Comprehensive Benchmark for Neural Surrogates on High-Fidelity 3D Car Aerodynamicscited by 10
  5. 2026MeshGraphNet-Transformer: Scalable Mesh-based Learned Simulation for Solid Mechanicscited by 8
  6. 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
  7. 2025Going with the Speed of Sound: Pushing Neural Surrogates into Highly-turbulent Transonic Regimescited by 5
  8. 2026Structure-Preserving Learning Improves Geometry Generalization in Neural PDEscited by 5
  9. 2025AB-UPT for Automotive and Aerospace Applicationscited by 4
  10. 2025MSPT: Efficient Large-Scale Physical Modeling via Parallelized Multi-Scale Attentioncited by 3
  11. 2026SMART: Scalable Mesh-free Aerodynamic Simulations from Raw Geometries using a Transformer-based Surrogate Modelcited by 3
  12. 2026ArGEnT: Arbitrary Geometry-encoded Transformer for Operator Learningcited by 3
37 more
  1. 2025PAINT: Parallel-in-time Neural Twins for Dynamical System Reconstructioncited by 2
  2. 2026Topological Neural Operatorscited by 2
  3. 2025Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operatorscited by 1
  4. 2026Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systemscited by 1
  5. 2026RETO: A Rotary-Enhanced Transformer Operator for High-Fidelity Prediction of Automotive Aerodynamicscited by 1
  6. 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point cloudscited by 1
  7. 2026ShardTensor: Domain Parallelism for Scientific Machine Learningcited by 1
  8. 2026Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learningcited by 1
  9. 2026A Geometry-Aware Triplane Field Network for Vehicle Aerodynamic Predictioncited by 1
  10. 2026Zero-shot generalization of transformer neural operators to larger domainscited by 1
  11. 2025PMRT: A Training Recipe for Fast, 3D High-Resolution Aerodynamic Predictioncited by 0
  12. 2025PIBNet: a Physics-Inspired Boundary Network for Multiple Scattering Simulationscited by 0
  13. 2025A Multi-fidelity Double-Delta Wing Dataset and Empirical Scaling Laws for GNN-based Aerodynamic Field Surrogatecited by 0
  14. 2026Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgerycited by 0
  15. 2026Generalization Bounds for Physics-Informed Neural Networks for the Incompressible Navier-Stokes Equationscited by 0
  16. 2026One Scale at a Time: Scale-Autoregressive Modeling for Fluid Flow Distributionscited by 0
  17. 2026Mesh Based Simulations with Spatial and Temporal awarenesscited by 0
  18. 2026Inpainting physics: self-supervised learning for context-driven fluid simulationcited by 0
  19. 2026M3: Reframing Training Measures for Discretized Physical Simulationscited by 0
  20. 2026Neural Statistical Functionscited by 0
  21. 2026When Does Equivariance Help? Canonical Alignment in Neural Fluid Surrogatescited by 0
  22. 2026Geometry-Aware Anisotropic Boundary Correction for Aerodynamic Simulationcited by 0
  23. 2026A fully GPU-based workflow for building physics emulators of hypersonic flowscited by 0
  24. 2026Attention mechanism for scalable mesh-based neural surrogates of free-surface fluidscited by 0
  25. 2026PGD-NO: A Neural Operator with Precomputed Geometry Decomposition for 3D Million-scale Physics Simulationscited by 0
  26. 2026Physics Transformer: Tailoring Transformer for General PDE Predictioncited by 0
  27. 2026FLARE++: Low-rank attention with dynamic attention routingcited by 0
  28. 2026HI-MeshGraphNets: Efficient and Accurate Mesh-based Physics Learning with Hierarchical Multi-scale Graph Neural Networkscited by 0
  29. 2026PhysicsBench: A Unified Leaderboard for Generative and Predictive Models in Engineering Design and Simulationcited by 0
  30. 2026Learnable composition for neural operatorscited by 0
  31. 2026FSAN: Flow State Attention Network for Aerodynamic Predictioncited by 0
  32. 2026Distance-Aware Attention and Wall-Distance Expert Routing for Transformer-Based 3D Flow Predictioncited by 0
  33. 2026MENO: Memory-Efficient Neural Operatorcited by 0
  34. 2026D-JEPA: Design-Recoverable JEPA Representation with Swappable Physics Decoderscited by 0
  35. 2026ScaGNN: a Graph Neural Network for Multiple Scattering Simulationscited by 0
  36. 2026Function-Space Transformer with Adaptive Anchorscited by 0
  37. 2026Cross-Domain Pretraining for Steady-State Neural CFD Surrogatescited by 0