mlsanityData to 7 Oct 2026

GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training

arXiv 2602.20399 ↗First posted 23 Feb 2026cs.LGcited by 8

Not on the map. Why?

Abstract (arXiv)

Neural simulators promise efficient surrogates for physics simulation, but scaling them is bottlenecked by the prohibitive cost of generating high-fidelity training data. Pre-training on abundant off-the-shelf geometries offers a natural alternative, yet faces a fundamental gap: supervision on static geometry alone ignores dynamics and can lead to negative transfer on physics tasks. We present GeoPT, a unified pre-trained model for general physics simulation based on lifted geometric pre-training. The core idea is to augment geometry with synthetic dynamics, enabling dynamics-aware self-supervision without physics labels. Pre-trained on over one million samples, GeoPT consistently improves industrial-fidelity benchmarks spanning fluid mechanics for cars, aircraft, and ships, and solid mechanics in crash simulation, reducing labeled data requirements by 20-60% and accelerating convergence by 2×. These results show that lifting with synthetic dynamics bridges the geometry-physics gap, unlocking a scalable path for neural simulation and potentially beyond. Code is available at https://github.com/Physics-Scaling/GeoPT.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 64 references that are in the map. First posted on arXiv 23 Feb 2026.

Builds on

40 of 64 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  9. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  10. 2020Rethinking Attention with Performerscited by 1,584
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
28 more
  1. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  2. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  3. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  4. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  5. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  6. 2021Choose a Transformer: Fourier or Galerkincited by 333
  7. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  8. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
  9. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
  10. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  11. 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
  12. 2024Poseidon: Efficient Foundation Models for PDEscited by 186
  13. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
  14. 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
  15. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  16. 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
  17. 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
  18. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  19. 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 56
  20. 2024DrivAerML: High-Fidelity Computational Fluid Dynamics Dataset for Road-Car External Aerodynamicscited by 33
  21. 2024Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solverscited by 31
  22. 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
  23. 2023Ship-D: Ship Hull Dataset for Design Optimization using Machine Learningcited by 12
  24. 2026HY3D-Bench: Generation of 3D Assetscited by 11
  25. 2025Automotive Crash Dynamics Modeling Accelerated with Machine Learningcited by 10
  26. 2025P3D: Scalable Neural Surrogates for High-Resolution 3D Physics Simulations with Global Contextcited by 4
  27. 2025From Cheap Geometry to Expensive Physics: Elevating Neural Operators via Latent Shape Pretrainingcited by 1
  28. 2025Neural Modular Physics for Elastic Simulationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 8.

8 papers.