SIMSHIFT: A Benchmark for Adapting Neural Surrogates to Distribution Shifts
Not on the map. Why?
Abstract (arXiv)
Neural surrogates for Partial Differential Equations (PDEs) often suffer significant performance degradation when evaluated on problem configurations outside their training distribution, such as new initial conditions or structural dimensions. While Unsupervised Domain Adaptation (UDA) techniques have been widely used in vision and language to generalize across domains without additional labeled data, their application to complex engineering simulations remains largely unexplored. In this work, we address this gap through two focused contributions. First, we introduce SIMSHIFT, a novel benchmark dataset and evaluation suite composed of four industrial simulation tasks spanning diverse processes and physics: hot rolling, sheet metal forming, electric motor design and heatsink design. Second, we extend established UDA methods to state-of-the-art neural surrogates and systematically evaluate them. Extensive experiments on SIMSHIFT highlight the challenges of out-of-distribution neural surrogate modeling, demonstrate the potential of UDA in simulation, and reveal open problems in achieving robust neural surrogates under distribution shifts in industrially relevant scenarios. Our codebase is available at https://github.com/psetinek/simshift
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 68 of its 129 references that are in the map. First posted on arXiv 13 Jun 2025.
Builds on
68 of 129 references.
References · 68
- 2017Attention Is All You Needcited by 60,361
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2019Invariant Risk Minimizationcited by 1,854
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
38 more
- 2017Adversarial Discriminative Domain Adaptationcited by 1,311
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
- 2020A Survey of Deep Active Learningcited by 554
- 2015Optimal Transport for Domain Adaptationcited by 463
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 434
- 2021Neural Operator: Learning Maps Between Function Spacescited by 414
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 341
- 2023ClimaX: A foundation model for weather and climatecited by 337
- 2019Bridging Theory and Algorithm for Domain Adaptationcited by 332
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
- 2018A DIRT-T Approach to Unsupervised Domain Adaptationcited by 215
- 2024Poseidon: Efficient Foundation Models for PDEscited by 200
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 197
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2019Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathologycited by 173
- 2019A review of domain adaptation without target labelscited by 156
- 2016Correlation Alignment for Unsupervised Domain Adaptationcited by 147
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
- 2021Deep Subdomain Adaptation Network for Image Classificationcited by 119
- 2019HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptationcited by 89
- 2019Support and Invertibility in Domain-Invariant Representationscited by 87
- 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
- 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 75
- 2019Significance-aware Information Bottleneck for Domain Adaptive Semantic Segmentationcited by 74
- 2023Benchmarking Distribution Shift in Tabular Data with TableShiftcited by 66
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulationscited by 7
- 2026Diagnosing Failure Modes of Neural Operators Across Diverse PDE Familiescited by 6
- 2026Semigroup Consistency as a Diagnostic for Learned Physics Simulatorscited by 4
- 2025Generalization vs. Memorization in Autoregressive Deep Learning: Or, Examining Temporal Decay of Gradient Coherencecited by 1
- 2026Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statisticscited by 0
- 2026How Does Distribution Shift Shape Pretraining Gains in Neural PDE Surrogates?cited by 0
- 2026Into the danger zone: stable extrapolation in high-dimensional function and operator learningcited by 0
- 2026Into the danger zone: stable extrapolation in high-dimensional function and operator learning29 Sep 2026
- 2026How Does Distribution Shift Shape Pretraining Gains in Neural PDE Surrogates?17 Sep 2026
- 2026Semigroup Consistency as a Diagnostic for Learned Physics Simulators25 May 2026
- 2026Stabilizing Test-Time Adaptation of High-Dimensional Simulation Surrogates via D-Optimal Statistics17 Feb 2026
- 2026Diagnosing Failure Modes of Neural Operators Across Diverse PDE Families16 Jan 2026
- 2025GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulations8 Oct 2025
- 2025Generalization vs. Memorization in Autoregressive Deep Learning: Or, Examining Temporal Decay of Gradient Coherence18 Aug 2025