mlsanityData to 14 Oct 2026

PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides

arXiv 2609.29718 ↗First posted 31 Aug 2026cs.CL cs.AIcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Coding agents are increasingly moving beyond text-based software tasks to reconstruct visual targets through code. This capability, visual coding, requires agents to translate their understanding of visual targets into executable code. Slides provide a natural testbed for this capability, combining rich visual structure with objects that can be programmatically created and edited. To measure this capability, we introduce PPTBench, a benchmark for reconstructing scientific flow diagrams as editable PowerPoint slides. PPTBench covers 500 scientific flow-diagram tasks across 10 presentation domains, drawn from real research papers, and is evaluated with a four-stage agentic judge covering artifact validity, process and connector fidelity, rendering quality, and visual fidelity. Evaluation of ten models across 36 model--harness--effort configurations shows a substantial gap in reliable visual coding: the best configuration achieves 77.34, while the median across configurations is 24.38. Fine-grained analysis shows that agents can generally produce valid slide files, but struggle to produce high-quality reconstructions that faithfully recover the semantics and visual structure of the target. Further analysis shows that increasing reasoning effort primarily improves hard-gate passage rather than mean detail quality on each configuration's passing tasks, while configurations with more inspection tend to achieve higher overall scores. PPTBench establishes a measurable testbed for studying visual coding and advancing agents toward more reliable visual creation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 79 of its 91 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

79 of 91 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026AeSlides: Incentivizing Aesthetic Layout in LLM-Based Slide Generation via Verifiable Rewards21 Apr
  2. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar
  3. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization18 Feb

Other references · 76

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  7. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  8. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  9. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  10. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  11. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  12. 2016A Diagram Is Worth A Dozen Imagescited by 804
38 more
  1. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  2. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
  3. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  4. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  5. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  6. 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
  7. 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 366
  8. 2019PlotQA: Reasoning over Scientific Plotscited by 321
  9. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
  10. 2024Agent-as-a-Judge: Evaluate Agents with Agentscited by 238
  11. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  12. 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 160
  13. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 143
  14. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  15. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 129
  16. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 125
  17. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  18. 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 114
  19. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
  20. 2023StarVector: Generating Scalable Vector Graphics Code from Images and Textcited by 102
  21. 2025ChartCoder: Advancing Multimodal Large Language Model for Chart-to-Code Generationcited by 92
  22. 2024VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Modelscited by 86
  23. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  24. 2023AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZcited by 79
  25. 2024Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMscited by 74
  26. 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 70
  27. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 70
  28. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
  29. 2024MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?cited by 66
  30. 2024Empowering LLMs to Understand and Generate Complex Vector Graphicscited by 66
  31. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
  32. 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 57
  33. 2024Interaction2Code: Benchmarking MLLM-based Interactive Webpage Code Generation from Interactive Prototypingcited by 51
  34. 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 50
  35. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  36. 2024SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretationcited by 48
  37. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  38. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41

50 most cited of 76 All 76 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ReFigBench: Benchmarking Scientific Figure Reconstruction as Editable PowerPoint Artifacts
  2. 2026SLIDEFORGE: An LLM Agent for Controllable Editing of Slides as Structured Artifacts
  3. 2026Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes
  4. 2026How Far Can Coding Agents Go in Visual Generation?
  5. 2025PPTArena: A Benchmark for PowerPoint Editing
  6. 2026MT-Web2Code: Benchmarking Coding Agents on Multi-Turn Regional Reconstruction and Localized Modification
  7. 2026CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
  8. 2026Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations