PPTArena: A Benchmark for PowerPoint Editing
Not on the map. Why?
Abstract (arXiv)
We introduce PPTArena, a benchmark for PowerPoint editing that evaluates how agents modify real slides from natural-language instructions. Unlike benchmarks that rely on image-PDF renderings or text-to-slide generation, PPTArena features 100 decks with over 1,300 human-curated edits across 2,125 slides, spanning text, charts, animations, and professional master styles. Each edit pairs a ground-truth deck with a target rubric and is scored by two Vision-Language Model (VLM) judges: one rates instruction following from structural diffs, the other visual quality from slide images. On top of this benchmark, we present PPTPilot, a structure-aware agent that plans semantic edit sequences, routes between programmatic tools and deterministic XML operations, and verifies each result in an iterative plan-edit-check loop. PPTPilot outperforms strong VLM-based agents by more than 10 percentage points on compound, layout-sensitive, and cross-slide edits, with large gains in visual fidelity and deck-wide consistency. Despite this, all agents still struggle on long-horizon, document-scale tasks, underscoring how hard reliable PowerPoint editing remains. We publicly release our code at https://github.com/michaelofengend/PPTArena .
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 55 of its 73 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
55 of 73 references.
References · 55
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
38 more
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2024tinyBenchmarks: evaluating LLMs with fewer examplescited by 295
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
- 2023OpenAGI: When LLM Meets Domain Expertscited by 196
- 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
- 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
- 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 123
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 83
- 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
- 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 65
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agentscited by 55
- 2024Benchmarking Mobile Device Control Agents across Diverse Configurationscited by 54
- 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 50
- 2025Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Modelscited by 40
- 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmapcited by 40
- 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agentscited by 38
- 2023PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completioncited by 30
- 2025API Agents vs. GUI Agents: Divergence and Convergencecited by 28
- 2025A Definition of AGIcited by 25
- 2025Auto-Slides: An Interactive Multi-Agent System for Creating and Customizing Research Presentationscited by 18
- 2025Agentic AI Frameworks: Architectures, Protocols, and Design Challengescited by 16
- 2025Is Your Video Language Model a Reliable Judge?cited by 14
- 2025BrowserArena: Evaluating LLM Agents on Real-World Web Navigation Taskscited by 12
- 2024PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completioncited by 9
- 2025Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulationcited by 7
- 2025ReasonVQA: A Multi-hop Reasoning Benchmark with Structural Knowledge for Visual Question Answeringcited by 7
- 2025VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritagecited by 7
- 2025FieldWorkArena: Agentic AI Benchmark for Real Field Work Taskscited by 6
- 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Mediacited by 6
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generationcited by 12
- 2026LLMs Corrupt Your Documents When You Delegatecited by 9
- 2026APEX: Academic Poster Editing Agentic Expertcited by 5
- 2026Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generationcited by 3
- 2026Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agentscited by 1
- 2026DeepSlide: From Artifacts to Presentation Deliverycited by 0
- 2026X+Slides: Benchmarking Audience-Conditioned Slide Generationcited by 0
- 2026The Last Mile Is the File: OfficeEditBench for Preservation-Aware Office Editingcited by 0
- 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?cited by 0
- 2026AgentTime: Can Agents Estimate and Control Their Own Runtime?7 Oct 2026
- 2026The Last Mile Is the File: OfficeEditBench for Preservation-Aware Office Editing28 Sep 2026
- 2026X+Slides: Benchmarking Audience-Conditioned Slide Generation17 Jun 2026
- 2026Learn from Weaknesses: Automated Domain Specialization for Small Computer-Use Agents27 May 2026
- 2026LLMs Corrupt Your Documents When You Delegate17 Apr 2026
- 2026Design First, Code Later: Aesthetically Pleasing Template-Free Slides Generation8 Apr 2026
- 2026DeepSlide: From Artifacts to Presentation Delivery1 Apr 2026
- 2026PresentBench: A Fine-Grained Rubric-Based Benchmark for Slide Generation7 Mar 2026
- 2026APEX: Academic Poster Editing Agentic Expert8 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026PPT-Eval: A Benchmark for Computer-Use Agents on PowerPoint Tasks
- 2026EditPPT: Faithful Long-Deck Slide Editing via Structured Tool-Using Multi-Agent with Dual-Modal Validators
- 2026SLIDEFORGE: An LLM Agent for Controllable Editing of Slides as Structured Artifacts
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
- 2025PPTBench: Towards Holistic Evaluation of Large Language Models for PowerPoint Layout and Design Understanding
- 2026ACE: A Self-Correcting Agentic Canvas Editor for Multi-Slide Presentation Automation
- 2026StoryState: Agent-Based State Control for Consistent and Editable Storybooks
- 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing