mlsanityData to 14 Oct 2026

Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learning

arXiv 2605.27968 ↗First posted 27 May 2026cs.CE cs.LG physics.comp-phcited by 1

Not on the map. Why?

Abstract (arXiv)

Deploying Scientific Machine Learning surrogates in industrial CFD workflows requires adapting pretrained models to new vehicle families without large datasets; yet whether geometric representations learned by a geometry encoder transfer to topologically distinct shapes remains unvalidated. We address this through leave-one-family-out experiments on a 61.47M-parameter Transformer surrogate (AB-UPT) pretrained on four vehicle families (411 external aerodynamics cases) and adapted to the held-out fifth with only 20 samples. Three strategies are compared: Full Fine-Tuning (FFT), Lightweight Fine-Tuning (LFT), and Low-Rank Adaptation (LoRA). The central finding is that pretrained geometry encoders learn transferable representations, but the adaptation mechanism determines whether they can be exploited. FFT destabilizes as 61.47M unconstrained parameters overfit to 20 samples (R^2=0.40); LFT fails because the frozen encoder cannot represent unseen shapes (R^2<0). LoRA resolves both: rank-constrained adapters injected into all layers regularize the loss landscape while preserving pretrained features, achieving R^2=0.85+/-0.02 across all five families with 50% lower force RMSE than FFT and 28% lower pointwise field errors. LoRA also outperforms from-scratch training using 3x more target-family data, eliminating the need for large per-family datasets. These results recast LoRA from a memory-saving convenience into a convergence enabler for geometry transfer: a shared backbone paired with lightweight per-family adapters trainable in hours from minimal data.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

36 of 53 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2017Graph Attention Networkscited by 8,923
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  6. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  7. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  8. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  9. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  10. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  11. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
  12. 2014How transferable are features in deep neural networks?cited by 1,225
24 more
  1. 2019A Comprehensive Survey on Transfer Learningcited by 1,160
  2. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  3. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  4. 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
  5. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  6. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  7. 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 173
  8. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
  9. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
  10. 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
  11. 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 75
  12. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 53
  13. 2024X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Designcited by 42
  14. 2025DoMINO: A Decomposable Multi-scale Iterative Neural Operator for Modeling Large Scale Engineering Simulationscited by 27
  15. 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 23
  16. 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
  17. 2025Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptationcited by 15
  18. 2025CarBench: A Comprehensive Benchmark for Neural Surrogates on High-Fidelity 3D Car Aerodynamicscited by 10
  19. 2026GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Trainingcited by 10
  20. 2024Deep Operator Learning for High-Fidelity Fluid Flow Field Reconstruction from Sparse Sensor Measurementscited by 9
  21. 2023Challenges and opportunities for machine learning in multiscale computational modelingcited by 6
  22. 2023HyperLoRA for PDEscited by 4
  23. 2025Continual Learning Strategies for 3D Engineering Regression Problems: A Benchmarking Studycited by 3
  24. 2025F-Adapter: Frequency-Adaptive Parameter-Efficient Fine-Tuning in Scientific Machine Learningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.