mlsanityData to 14 Oct 2026

BuildArena: A Physics-Aligned Interactive Benchmark of LLMs for Engineering Construction

arXiv 2510.16559 ↗First posted 18 Oct 2025cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Engineering construction automation aims to transform natural language specifications into physically viable structures, requiring complex integrated reasoning under strict physical constraints. While modern LLMs possess broad knowledge and strong reasoning capabilities that make them promising candidates for this domain, their construction competencies remain largely unevaluated. To address this gap, we introduce BuildArena, the first physics-aligned interactive benchmark designed for language-driven engineering construction. Technically, it contributes to the community in two aspects: (1) an extendable task design strategy spanning static and dynamic mechanics across multiple difficulty tiers; (2) a 3D Spatial Geometric Computation Library for supporting construction based on language instructions. On nine frontier LLMs and three additional open-weight models, BuildArena comprehensively evaluates their capabilities for language-driven and physics-grounded construction automation. We release the code at https://github.com/AI4Science-WestlakeU/BuildArena to benefit construction automation in engineering applications.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 30 of its 85 references that are in the map. First posted on arXiv 18 Oct 2025.

Builds on

30 of 85 references.

References · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  8. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  9. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  11. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  12. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
18 more
  1. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
  2. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  3. 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 382
  4. 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 257
  5. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 144
  6. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  7. 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 83
  8. 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?cited by 45
  9. 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
  10. 2025Control Illusion: The Failure of Instruction Hierarchies in Large Language Modelscited by 33
  11. 2024DART-LLM: Dependency-Aware Multi-Robot Task Decomposition and Execution using Large Language Modelscited by 19
  12. 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problemscited by 18
  13. 2025GeoGramBench: Benchmarking the Geometric Program Reasoning in Modern LLMscited by 13
  14. 2025FloorplanQA: A Benchmark for Spatial Reasoning in LLMs using Structured Representationscited by 13
  15. 2024Find the Intention of Instruction: Comprehensive Evaluation of Instruction Understanding for Large Language Modelscited by 4
  16. 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
  17. 2025Compositional Machine Design as Program Synthesis with LLMscited by 4
  18. 2025CONSTRUCTA: Automating Commercial Construction Schedules in Fabrication Facilities with Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

  1. 2026Frontier-Eng: Benchmarking Self-Evolving Agents on Real-World Engineering Tasks with Generative Optimizationcited by 16
  2. 2026Planning with Language and Generative Models: Toward General Reward-Guided Wireless Network Designcited by 2
  3. 2025Towards an AI Fluid Scientist: LLM-Powered Scientific Discovery in Experimental Fluid Mechanicscited by 1
  4. 2026VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibration Energy Harvester Designcited by 0
  5. 2026WMLLM: Self-Evolving Optimization Agents via Predict-Then-Act World Modelingcited by 0
  6. 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Designcited by 0
  7. 2026EngIntervene: Benchmarking Multimodal Engineering State Understanding and Design Intervention Reasoningcited by 0
  8. 2026PLCWorld: Benchmarking LLM-Generated PLC Programs in Closed-Loop Plant Simulationcited by 0
  9. 2026Words to World: Benchmarking LLMs in Interactive Physical Environmentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking Scientific Modeling: Toward Physically Consistent and Simulation-Executable Programmatic Generation
  2. 2025A Large Language Model-Empowered Agent for Reliable and Robust Structural Analysis
  3. 2025Automating Structural Engineering Workflows with Large Language Model Agents
  4. 2025FEABench: Evaluating Language Models on Multiphysics Reasoning Ability
  5. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  6. 2025EngiBench: A Benchmark for Evaluating Large Language Models on Engineering Problem Solving
  7. 2025DrafterBench: Benchmarking Large Language Models for Tasks Automation in Civil Engineering
  8. 2026LMBuild: Evaluating LLM Agents for Generating Buildable and Functional Structures