# NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysis

arXiv: https://arxiv.org/abs/2506.08516 · HTML: https://mlsanity.com/paper/2506.08516/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 30 of its 49 references that are in the map.
- First posted on arXiv 10 Jun 2025.

## Builds on (most cited first, 30 of 30)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Neural Message Passing for Quantum Chemistry](https://mlsanity.com/paper/1704.01212/) (2017)
- [Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains](https://mlsanity.com/paper/2006.10739/) (2020)
- [Relational inductive biases, deep learning, and graph networks](https://mlsanity.com/paper/1806.01261/) (2018)
- [Learning to Simulate Complex Physics with Graph Networks](https://mlsanity.com/paper/2002.09405/) (2020)
- [Learning Mesh-Based Simulation with Graph Networks](https://mlsanity.com/paper/2010.03409/) (2020)
- [PointConv: Deep Convolutional Networks on 3D Point Clouds](https://mlsanity.com/paper/1811.07246/) (2018)
- [Directional Message Passing for Molecular Graphs](https://mlsanity.com/paper/2003.03123/) (2020)
- [Machine learning accelerated computational fluid dynamics](https://mlsanity.com/paper/2102.01010/) (2021)
- [PDEBENCH: An Extensive Benchmark for Scientific Machine Learning](https://mlsanity.com/paper/2210.07182/) (2022)
- [Message Passing Neural PDE Solvers](https://mlsanity.com/paper/2202.03376/) (2022)
- [Spherical Message Passing for 3D Graph Networks](https://mlsanity.com/paper/2102.05013/) (2021)
- [Frame Averaging for Invariant and Equivariant Network Design](https://mlsanity.com/paper/2110.03336/) (2021)
- [Deep learning to represent sub-grid processes in climate models](https://mlsanity.com/paper/1806.04731/) (2018)
- [Accelerating Eulerian Fluid Simulation With Convolutional Networks](https://mlsanity.com/paper/1607.03597/) (2016)
- [Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations](https://mlsanity.com/paper/2407.07218/) (2024)
- [AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutions](https://mlsanity.com/paper/2212.07564/) (2022)
- [Building high accuracy emulators for scientific simulations with deep neural architecture search](https://mlsanity.com/paper/2001.08055/) (2020)
- [Aero-Nef: Neural Fields for Rapid Aircraft Aerodynamics Simulations](https://mlsanity.com/paper/2407.19916/) (2024)
- [Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency](https://mlsanity.com/paper/2406.07598/) (2024)
- [MMGP: a Mesh Morphing Gaussian Process-based machine learning method for regression of physical problems under non-parameterized geometrical variability](https://mlsanity.com/paper/2305.12871/) (2023)
- [AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamics](https://mlsanity.com/paper/2407.20801/) (2024)
- [Multi-Scale Message Passing Neural PDE Solvers](https://mlsanity.com/paper/2302.03580/) (2023)
- [Interpretable learning of effective dynamics for multiscale systems](https://mlsanity.com/paper/2309.05812/) (2023)
- [Towards scalable surrogate models based on Neural Fields for large scale aerodynamic simulations](https://mlsanity.com/paper/2505.14704/) (2025)
- [CD-ROM: Complemented Deep-Reduced Order Model](https://mlsanity.com/paper/2202.10746/) (2022)
- [NeurIPS 2024 ML4CFD Competition: Harnessing Machine Learning for Computational Fluid Dynamics in Airfoil Design](https://mlsanity.com/paper/2407.01641/) (2024)
- [Geometry aware inference of steady state PDEs using Equivariant Neural Fields representations](https://mlsanity.com/paper/2504.18591/) (2025)
- [ML4PhySim : Machine Learning for Physical Simulations Challenge (The airfoil design)](https://mlsanity.com/paper/2403.01623/) (2024)
- [A Geometry-Aware Message Passing Neural Network for Modeling Aerodynamics over Airfoils](https://mlsanity.com/paper/2412.09399/) (2024)

## Built on by (most cited first, 1 of 1)

- [Interactive 4D Volumetric Liquid Forecasting under Moving-Solid Interaction](https://mlsanity.com/paper/2610.16167/) (2026)

## Abstract (arXiv)

The integration of machine learning (ML) into the physical sciences is reshaping computational paradigms, offering the potential to accelerate demanding simulations such as computational fluid dynamics (CFD). Yet, persistent challenges in accuracy, generalization, and physical consistency hinder the practical deployment of ML models in scientific domains. To address these limitations and systematically benchmark progress, we organized the ML4CFD competition, centered on surrogate modeling for aerodynamic simulations over two-dimensional airfoils. The competition attracted over 240 teams, who were provided with a curated dataset generated via OpenFOAM and evaluated through a multi-criteria framework encompassing predictive accuracy, physical fidelity, computational efficiency, and out-of-distribution generalization. This retrospective analysis reviews the competition outcomes, highlighting several approaches that outperformed baselines under our global evaluation score. Notably, the top entry exceeded the performance of the original OpenFOAM solver on aggregate metrics, illustrating the promise of ML-based surrogates to outperform traditional solvers under tailored criteria. Drawing from these results, we analyze the key design principles of top submissions, assess the robustness of our evaluation framework, and offer guidance for future scientific ML challenges.
