PhysicsBench: A Unified Leaderboard for Generative and Predictive Models in Engineering Design and Simulation
Not on the map. Why?
Abstract (arXiv)
Generative and predictive artificial intelligence models are increasingly used to generate geometry and to predict physical fields and scalar quantities in engineering design and simulation. Yet these models are typically evaluated in isolation, on academic datasets at unconstrained scales, with inconsistent metrics and procedures. We present PhysicsBench, a unified benchmark and leaderboard that evaluates generative and predictive models under one standardized procedure. PhysicsBench spans seven generation and prediction tasks across 1D, 2D, and 3D domains and ranks 66 models on nine datasets, comprising industrial-scale CAD/CFD/FEA simulations and public references, expanded into 28 configurations. One procedure and ranking apply to both families, each ranked within its own tasks. Evaluation spans realistic, limited data scales from S to XL rather than the unlimited training sets common in academic benchmarks. A common metric suite captures geometric fidelity with distributional distances, physical-field and scalar accuracy, and engineering-specific field- and shape-validity. BenchRank debiases correlated metrics and ranks by PageRank over a head-to-head dominance graph, so every reported quality metric is also ranked, with computational cost in a separate efficiency view. Across tasks, an architecture's large-scale academic standing weakly predicts its small-data ranking. The top model changes with data scale in six of the seven tasks, and no model leads more than one task. PhysicsBench turns "state-of-the-art" from a self-reported claim into an openly published foundation for model selection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 91 of its 122 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
91 of 122 references.
References · 91
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
38 more
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2022A ConvNet for the 2020scited by 3,579
- 2016Improved Techniques for Training GANscited by 2,970
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systemscited by 1,729
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2020Point Transformercited by 1,470
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Least Squares Generative Adversarial Networkscited by 1,001
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2020PCT: Point cloud transformercited by 732
- 2018Which Training Methods for GANs do actually Converge?cited by 679
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 648
- 2019Panoptic Feature Pyramid Networkscited by 645
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 413
50 most cited of 91 All 91 (JSON)
Built on by
Not cited yet.