Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learning
Not on the map. Why?
Abstract (arXiv)
Deploying Scientific Machine Learning surrogates in industrial CFD workflows requires adapting pretrained models to new vehicle families without large datasets; yet whether geometric representations learned by a geometry encoder transfer to topologically distinct shapes remains unvalidated. We address this through leave-one-family-out experiments on a 61.47M-parameter Transformer surrogate (AB-UPT) pretrained on four vehicle families (411 external aerodynamics cases) and adapted to the held-out fifth with only 20 samples. Three strategies are compared: Full Fine-Tuning (FFT), Lightweight Fine-Tuning (LFT), and Low-Rank Adaptation (LoRA). The central finding is that pretrained geometry encoders learn transferable representations, but the adaptation mechanism determines whether they can be exploited. FFT destabilizes as 61.47M unconstrained parameters overfit to 20 samples (R^2=0.40); LFT fails because the frozen encoder cannot represent unseen shapes (R^2<0). LoRA resolves both: rank-constrained adapters injected into all layers regularize the loss landscape while preserving pretrained features, achieving R^2=0.85+/-0.02 across all five families with 50% lower force RMSE than FFT and 28% lower pointwise field errors. LoRA also outperforms from-scratch training using 3x more target-family data, eliminating the need for large per-family datasets. These results recast LoRA from a memory-saving convenience into a convergence enabler for geometry transfer: a shared backbone paired with lightweight per-family adapters trainable in hours from minimal data.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
36 of 53 references.
References · 36
- 2017Attention Is All You Needcited by 60,361
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2017Graph Attention Networkscited by 8,923
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2014How transferable are features in deep neural networks?cited by 1,225
24 more
- 2019A Comprehensive Survey on Transfer Learningcited by 1,160
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuningcited by 173
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 97
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 75
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 53
- 2024X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Designcited by 42
- 2025DoMINO: A Decomposable Multi-scale Iterative Neural Operator for Modeling Large Scale Engineering Simulationscited by 27
- 2025GeoTransolver: Learning Physics on Irregular Domains Using Multi-scale Geometry Aware Physics Attention Transformercited by 23
- 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
- 2025Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptationcited by 15
- 2025CarBench: A Comprehensive Benchmark for Neural Surrogates on High-Fidelity 3D Car Aerodynamicscited by 10
- 2026GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Trainingcited by 10
- 2024Deep Operator Learning for High-Fidelity Fluid Flow Field Reconstruction from Sparse Sensor Measurementscited by 9
- 2023Challenges and opportunities for machine learning in multiscale computational modelingcited by 6
- 2023HyperLoRA for PDEscited by 4
- 2025Continual Learning Strategies for 3D Engineering Regression Problems: A Benchmarking Studycited by 3
- 2025F-Adapter: Frequency-Adaptive Parameter-Efficient Fine-Tuning in Scientific Machine Learningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.