GPUPhysBench: Benchmarking Coding Agents for Correct and Efficient GPU Physics Simulation
Not on the map. Why?
Abstract (arXiv)
Writing fast GPU code for physical simulation is difficult: implementations must preserve numerical accuracy while handling irregular data access, synchronization, and iterative solvers. We introduce GPUPhysBench, a benchmark of 50 tasks testing whether coding agents can meet these demands. Tasks cover fluids, deformable solids, and granular materials, from individual simulation operators to complete simulators. Agents write, compile, test, and optimize GPU code with access to a NVIDIA GPU under fixed time budgets. We report pass rates and runtime performance relative to expert-optimized reference implementations. In a single-attempt evaluation of six frontier model-harness pairs, the two strongest pass all 50 tasks, but even the fastest reaches at least 0.9 the reference speed on only 22% of them, and no submission is more than 5% faster than the reference. The largest gaps arise in collision detection, constraint solving, and iterative solvers. GPUPhysBench brings physical simulation workloads to coding-agent evaluation, testing both the ability to implement numerical methods correctly and the ability to make them run efficiently.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 43 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
21 of 43 references.
References · 21
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2025KernelBench: Can LLMs Write Efficient GPU Kernels?cited by 206
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 172
- 2025TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operatorscited by 68
- 2025Astra: A Multi-Agent System for GPU Kernel Performance Optimizationcited by 46
- 2025CodePDE: An Inference Framework for LLM-driven PDE Solver Generationcited by 37
- 2025MultiKernelBench: A Multi-Platform Benchmark for Kernel Generationcited by 35
- 2025Geak: Introducing Triton Kernel AI Agent & Evaluation Benchmarkscited by 31
- 2025PDE-Controller: LLMs for Autoformalization and Reasoning of PDEscited by 23
- 2025STARK: Strategic Team of Agents for Refining Kernelscited by 23
- 2025AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimizationcited by 21
- 2026AVO: Agentic Variation Operators for Autonomous Evolutionary Searchcited by 19
9 more
- 2026K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Modelcited by 17
- 2025Foam-Agent 2.0: An End-to-End Composable Multi-Agent Framework for Automating CFD Simulation in OpenFOAMcited by 15
- 2026CUDABench: Benchmarking LLMs for Text-to-CUDA Generationcited by 10
- 2025Foam-Agent: A Large Language Model-Based Multi-Agent Framework for Automating Computational Fluid Dynamics Workflowscited by 9
- 2026KernelSkill: A Multi-Agent Framework for GPU Kernel Optimizationcited by 9
- 2026OpInf-LLM: Parametric PDE Solving with LLMs via Operator Inferencecited by 4
- 2026PDEAgent-Bench: A Multi-Metric, Multi-Library Benchmark for PDE Solver Generationcited by 4
- 2026AutoPDE: Reliable Agentic PDE Solving via Explicitly Represented Solver Strategiescited by 2
- 2026MKEvolve: A Modular Multi-Agent Framework for Kernel Code Generationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents
- 2026Agentic Kernel Optimization: Generating State-of-the-Art GPU Kernels Without Hand-Written CUDA
- 2026D2K-Bench: Can LLM Agents Turn Expert Designs into Efficient GPU Kernels?
- 2026ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation
- 2026StitchCUDA: An Automated Multi-Agents End-to-End GPU Programing Framework with Rubric-based Agentic Reinforcement Learning
- 2026PhysCodeBench: Benchmarking Physics-Aware Symbolic Simulation of 3D Scenes via Self-Corrective Multi-Agent Refinement
- 2026Are LLM-Generated GPU Kernels Production-Ready? A Trace-Driven Benchmark and Optimization Agent
- 2026Improving Efficiency of GPU Kernel Optimization Agents using a Domain-Specific Language and Speed-of-Light Guidance