mlsanityData to 7 Oct 2026

FLUID-LLM: Learning Computational Fluid Dynamics with Spatiotemporal-aware Large Language Models

arXiv 2406.04501 ↗First posted 6 Jun 2024cs.LG cs.AI cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Learning computational fluid dynamics (CFD) traditionally relies on computationally intensive simulations of the Navier-Stokes equations. Recently, large language models (LLMs) have shown remarkable pattern recognition and reasoning abilities in natural language processing (NLP) and computer vision (CV). However, these models struggle with the complex geometries inherent in fluid dynamics. We introduce FLUID-LLM, a novel framework combining pre-trained LLMs with spatiotemporal-aware encoding to predict unsteady fluid dynamics. Our approach leverages the temporal autoregressive abilities of LLMs alongside spatial-aware layers, bridging the gap between previous CFD prediction methods. Evaluations on standard benchmarks reveal significant performance improvements across various fluid datasets. Our results demonstrate that FLUID-LLM effectively integrates spatiotemporal information into pre-trained LLMs, enhancing CFD task performance.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 6 Jun 2024.

Builds on

15 of 28 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2017Graph Attention Networkscited by 8,854
  5. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  6. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  7. 2021How Attentive are Graph Attention Networks?cited by 818
  8. 2019Machine Learning for Fluid Mechanicscited by 380
  9. 2023Generating Images with Multimodal Language Modelscited by 259
  10. 2022PromptCast: A New Prompt-based Learning Paradigm for Time Series Forecastingcited by 170
  11. 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
  12. 2024Large Language Models for Time Series: A Surveycited by 113
3 more
  1. 2024LSTPrompt: Large Language Models as Zero-Shot Time Series Forecasters by Long-Short-Term Promptingcited by 56
  2. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  3. 2024Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Datacited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 2; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Fine-tuning a Large Language Model for Automating Computational Fluid Dynamics Simulations
  2. 2025CFD-copilot: leveraging domain-adapted large language model and model context protocol to enhance simulation automation
  3. 2025Autoregressive regularized score-based diffusion models for multi-scenarios fluid flow prediction
  4. 2026FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshes
  5. 2025MetaOpenFOAM 2.0: Large Language Model Driven Chain of Thought for Automating CFD Simulation and Post-Processing
  6. 2025Foam-Agent: A Large Language Model-Based Multi-Agent Framework for Automating Computational Fluid Dynamics Workflows
  7. 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inference
  8. 2026OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoning