mlsanityData to 14 Oct 2026

SIMSHIFT: A Benchmark for Adapting Neural Surrogates to Distribution Shifts

arXiv 2506.12007 ↗First posted 13 Jun 2025cs.LG cs.CV physics.comp-phcited by 7

Not on the map. Why?

Abstract (arXiv)

Neural surrogates for Partial Differential Equations (PDEs) often suffer significant performance degradation when evaluated on problem configurations outside their training distribution, such as new initial conditions or structural dimensions. While Unsupervised Domain Adaptation (UDA) techniques have been widely used in vision and language to generalize across domains without additional labeled data, their application to complex engineering simulations remains largely unexplored. In this work, we address this gap through two focused contributions. First, we introduce SIMSHIFT, a novel benchmark dataset and evaluation suite composed of four industrial simulation tasks spanning diverse processes and physics: hot rolling, sheet metal forming, electric motor design and heatsink design. Second, we extend established UDA methods to state-of-the-art neural surrogates and systematically evaluate them. Extensive experiments on SIMSHIFT highlight the challenges of out-of-distribution neural surrogate modeling, demonstrate the potential of UDA in simulation, and reveal open problems in achieving robust neural surrogates under distribution shifts in industrially relevant scenarios. Our codebase is available at https://github.com/psetinek/simshift

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 68 of its 129 references that are in the map. First posted on arXiv 13 Jun 2025.

Builds on

68 of 129 references.

References · 68

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Inductive Representation Learning on Large Graphscited by 6,320
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  8. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  9. 2019Invariant Risk Minimizationcited by 1,854
  10. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
  11. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  12. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
38 more
  1. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  2. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,200
  3. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,188
  4. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  5. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  6. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
  7. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  8. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
  9. 2020A Survey of Deep Active Learningcited by 554
  10. 2015Optimal Transport for Domain Adaptationcited by 463
  11. 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 434
  12. 2021Neural Operator: Learning Maps Between Function Spacescited by 414
  13. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
  14. 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
  15. 2016Unsupervised Domain Adaptation with Residual Transfer Networkscited by 341
  16. 2023ClimaX: A foundation model for weather and climatecited by 337
  17. 2019Bridging Theory and Algorithm for Domain Adaptationcited by 332
  18. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  19. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  20. 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
  21. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
  22. 2018A DIRT-T Approach to Unsupervised Domain Adaptationcited by 215
  23. 2024Poseidon: Efficient Foundation Models for PDEscited by 200
  24. 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 197
  25. 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
  26. 2019Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathologycited by 173
  27. 2019A review of domain adaptation without target labelscited by 156
  28. 2016Correlation Alignment for Unsupervised Domain Adaptationcited by 147
  29. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 145
  30. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
  31. 2021Deep Subdomain Adaptation Network for Image Classificationcited by 119
  32. 2019HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptationcited by 89
  33. 2019Support and Invertibility in Domain-Invariant Representationscited by 87
  34. 2020Multi-Source Deep Domain Adaptation with Weak Supervision for Time-Series Sensor Datacited by 82
  35. 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 82
  36. 2024DrivAerNet++: A Large-Scale Multimodal Car Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarkscited by 75
  37. 2019Significance-aware Information Bottleneck for Domain Adaptive Semantic Segmentationcited by 74
  38. 2023Benchmarking Distribution Shift in Tabular Data with TableShiftcited by 66

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.