GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training
Not on the map. Why?
Abstract (arXiv)
Neural simulators promise efficient surrogates for physics simulation, but scaling them is bottlenecked by the prohibitive cost of generating high-fidelity training data. Pre-training on abundant off-the-shelf geometries offers a natural alternative, yet faces a fundamental gap: supervision on static geometry alone ignores dynamics and can lead to negative transfer on physics tasks. We present GeoPT, a unified pre-trained model for general physics simulation based on lifted geometric pre-training. The core idea is to augment geometry with synthetic dynamics, enabling dynamics-aware self-supervision without physics labels. Pre-trained on over one million samples, GeoPT consistently improves industrial-fidelity benchmarks spanning fluid mechanics for cars, aircraft, and ships, and solid mechanics in crash simulation, reducing labeled data requirements by 20-60% and accelerating convergence by 2×. These results show that lifting with synthetic dynamics bridges the geometry-physics gap, unlocking a scalable path for neural simulation and potentially beyond. Code is available at https://github.com/Physics-Scaling/GeoPT.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 64 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
40 of 64 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2020Rethinking Attention with Performerscited by 1,584
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
28 more
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2016Training Deep Nets with Sublinear Memory Costcited by 825
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 299
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2023Neural Operators for Accelerating Scientific Simulations and Designcited by 218
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2023Scalable Transformer for PDE Surrogate Modelingcited by 123
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2023In-Context Operator Learning with Data Prompts for Differential Equation Problemscited by 98
- 2025Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometriescited by 89
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
- 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 56
- 2024DrivAerML: High-Fidelity Computational Fluid Dynamics Dataset for Road-Car External Aerodynamicscited by 33
- 2024Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE Solverscited by 31
- 2026Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometriescited by 20
- 2023Ship-D: Ship Hull Dataset for Design Optimization using Machine Learningcited by 12
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2025Automotive Crash Dynamics Modeling Accelerated with Machine Learningcited by 10
- 2025P3D: Scalable Neural Surrogates for High-Resolution 3D Physics Simulations with Global Contextcited by 4
- 2025From Cheap Geometry to Expensive Physics: Elevating Neural Operators via Latent Shape Pretrainingcited by 1
- 2025Neural Modular Physics for Elastic Simulationcited by 1
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learningcited by 1
- 2026Neural Statistical Functionscited by 0
- 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospectscited by 0
- 2026LEIA: Learned Environment for Interactive Architected Materialscited by 0
- 2026The Kuramoto Neural Operator: Learning to Solve PDEs via Coupled Oscillator Dynamicscited by 0
- 2026Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domainscited by 0
- 2026Learnable composition for neural operatorscited by 0
- 2026Neural Harmonic Measure Operatorcited by 0
- 2026Neural Harmonic Measure Operator28 Sep 2026
- 2026Learnable composition for neural operators2 Sep 2026
- 2026Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains31 Aug 2026
- 2026The Kuramoto Neural Operator: Learning to Solve PDEs via Coupled Oscillator Dynamics10 Aug 2026
- 2026LEIA: Learned Environment for Interactive Architected Materials27 May 2026
- 2026Adapting Automotive Aerodynamics Surrogates to New Vehicle Families via Transfer Learning27 May 2026
- 2026Harnessing AI for Inverse Partial Differential Equation Problems: Past, Present, and Prospects16 May 2026
- 2026Neural Statistical Functions11 May 2026