mlsanityData to 14 Oct 2026

RETO: A Rotary-Enhanced Transformer Operator for High-Fidelity Prediction of Automotive Aerodynamics

arXiv 2605.00062 ↗First posted 30 Apr 2026eess.IV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Rapid aerodynamic evaluation is crucial for modern vehicle design, yet existing neural operators struggle to capture intricate spatial correlations. We propose the rotary-enhanced transformer operator (RETO), a novel neural solver featuring a dual-stage spatial awareness mechanism: sinusoidal-cosine encodings for global referencing and rotary positional encodings (RoPE) for relative displacements. RoPE encodes spatial relations via unitary rotations, enforcing translation invariance and enhancing local gradient resolution. RETO is validated on ShapeNet and the high-fidelity DrivAerML benchmark. On ShapeNet, RETO achieves a relative L2 error of 0.063, outperforming RegDGCNN at 0.125 and representing a 16% improvement over the Transolver baseline, which yields an error of 0.075. These performance gains are further amplified on the DrivAerML dataset, where RETO achieves relative L2 errors of 0.089 for surface pressure and 0.097 for velocity. In comparison, Transolver results in errors of 0.116 and 0.121 for the same metrics, indicating that RETO achieves precision enhancements of 23% and 19%, respectively. For comprehensive comparison, the surface pressure and velocity errors for AB-UBT are 0.102 and 0.124, while RegDGCNN yields 0.235 and 0.312, respectively. Information-theoretical analysis shows that the entropy peak of RETO at 0.35 is significantly lower than that of Transolver at 0.75 under 104 resolution, indicating a focused attentional mechanism capable of preserving localized gradients against global diffusion.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 73 references that are in the map. First posted on arXiv 30 Apr 2026.

Builds on

24 of 73 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  4. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  5. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  8. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  10. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  11. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  12. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
12 more
  1. 2021Factorized Fourier Neural Operatorscited by 249
  2. 2019Transformer Dissection: A Unified Understanding of Transformer's Attention via the Lens of Kernelcited by 213
  3. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
  4. 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 75
  5. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 53
  6. 2024DrivAerML: High-Fidelity Computational Fluid Dynamics Dataset for Road-Car External Aerodynamicscited by 35
  7. 2019Calibration, Entropy Rates, and Memory in Language Modelscited by 32
  8. 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 23
  9. 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
  10. 2025CarBench: A Comprehensive Benchmark for Neural Surrogates on High-Fidelity 3D Car Aerodynamicscited by 10
  11. 2025MSPT: Efficient Large-Scale Physical Modeling via Parallelized Multi-Scale Attentioncited by 3
  12. 2025Integrating Locality-Aware Attention with Transformers for General Geometry PDEscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.