mlsanityData to 7 Oct 2026

WorldCoder-Bench: Benchmarking Physically Grounded 3D World Synthesis

arXiv 2606.01869 ↗First posted 1 Jun 2026cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are increasingly asked not only to write static interfaces, but to construct executable interactive worlds from natural language. Browser-native 3D, commonly built with Three.js, is a natural next frontier: generated programs must integrate assets, obey spatial and physical constraints, and keep user-facing controls synchronized with hidden runtime state. Existing web-generation benchmarks and evaluators, however, largely observe only pixels or DOM nodes, while the mechanics of a Three.js world unfold inside an opaque <canvas>. We introduce WorldCoder-Bench, a benchmark for autonomous, physically grounded 3D world synthesis. WorldCoder-Bench contains 2,026 expert-curated tasks across Simulation, Rendering, and Application scenarios, with optional .glb assets and hidden behavioral contracts. We further propose StateProbe, an execution-based protocol that probes generated programs in a sandboxed browser and verifies hidden, mutation-hardened contracts over runtime states and transitions. Beyond verification coverage, we report Return on Automation and Time Efficiency Multiplier to measure correctness-adjusted cost and time savings. Across nine frontier models, the best system reaches only 27.8% verification coverage on WorldCoder-Core and 19.9% on WorldCoder-Robust, with failures dominated by state-schema drift and broken interaction chains rather than missing scene elements. Utility metrics further show that cheap or fast models can still provide substantial value on easier domains. WorldCoder-Bench is available at https://anonymous.4open.science/r/WorldCoder-Bench/.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

31 of 53 references.

References · 31

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  4. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  5. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
  6. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
  7. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 145
  8. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  9. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
  10. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 116
  11. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
  12. 2025WebGen-Bench: Evaluating LLMs on Generating Interactive and Functional Websites from Scratchcited by 66
19 more
  1. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  2. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 50
  3. 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generationcited by 41
  4. 2025Web-Bench: A LLM Code Benchmark Based on Web Standards and Frameworkscited by 36
  5. 2025ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluationcited by 35
  6. 2025Vibe Coding in Practice: Motivations, Challenges, and a Future Outlook -- a Grey Literature Reviewcited by 28
  7. 2024Out-of-Distribution Detection: A Task-Oriented Survey of Recent Advancescited by 24
  8. 2026GameDevBench: Evaluating Agentic Capabilities Through Game Developmentcited by 21
  9. 2025FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluationcited by 17
  10. 2026WebCoderBench: Benchmarking Web Application Generation with Comprehensive and Interpretable Evaluation Metricscited by 15
  11. 2025WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Codecited by 14
  12. 2025Uni-Layout: Integrating Human Feedback in Unified Layout Generation and Evaluationcited by 13
  13. 2024GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmarkcited by 11
  14. 2025IWR-Bench: Can LVLMs reconstruct interactive webpage from a user interaction video?cited by 10
  15. 2025WebDevJudge: Evaluating (M)LLMs as Critiques for Web Development Qualitycited by 10
  16. 2025V-GameGym: Visual Game Generation for Code Large Language Modelscited by 8
  17. 2025DeepResearch-Slice: Bridging the Retrieval-Utilization Gap via Explicit Text Slicingcited by 7
  18. 2026One Size, Many Fits: Aligning Diverse Group-Wise Click Preferences in Large-Scale Advertising Image Generationcited by 4
  19. 2026Do MLLMs Really Understand Space? A Mathematical Reasoning Evaluationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.