mlsanityData to 7 Oct 2026

PPTArena: A Benchmark for PowerPoint Editing

arXiv 2512.03042 ↗First posted 2 Dec 2025cs.CV cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

We introduce PPTArena, a benchmark for PowerPoint editing that evaluates how agents modify real slides from natural-language instructions. Unlike benchmarks that rely on image-PDF renderings or text-to-slide generation, PPTArena features 100 decks with over 1,300 human-curated edits across 2,125 slides, spanning text, charts, animations, and professional master styles. Each edit pairs a ground-truth deck with a target rubric and is scored by two Vision-Language Model (VLM) judges: one rates instruction following from structural diffs, the other visual quality from slide images. On top of this benchmark, we present PPTPilot, a structure-aware agent that plans semantic edit sequences, routes between programmatic tools and deterministic XML operations, and verifies each result in an iterative plan-edit-check loop. PPTPilot outperforms strong VLM-based agents by more than 10 percentage points on compound, layout-sensitive, and cross-slide edits, with large gains in visual fidelity and deck-wide consistency. Despite this, all agents still struggle on long-horizon, document-scale tasks, underscoring how hard reliable PowerPoint editing remains. We publicly release our code at https://github.com/michaelofengend/PPTArena .

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 55 of its 73 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

55 of 73 references.

References · 55

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  7. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  8. 2024A Survey on LLM-as-a-Judgecited by 1,384
  9. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  10. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  11. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  12. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
38 more
  1. 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 702
  2. 2025Kimi K2: Open Agentic Intelligencecited by 523
  3. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  4. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
  5. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
  6. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  7. 2024tinyBenchmarks: evaluating LLMs with fewer examplescited by 295
  8. 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scalecited by 212
  9. 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvementcited by 203
  10. 2023OpenAGI: When LLM Meets Domain Expertscited by 196
  11. 2024SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?cited by 196
  12. 2024OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Webcited by 156
  13. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 123
  14. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  15. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 83
  16. 2025Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RLcited by 75
  17. 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 65
  18. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 63
  19. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 56
  20. 2024MMInA: Benchmarking Multihop Multimodal Internet Agentscited by 55
  21. 2024Benchmarking Mobile Device Control Agents across Diverse Configurationscited by 54
  22. 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 50
  23. 2025Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Modelscited by 40
  24. 2025Agentic Software Engineering: Foundational Pillars and a Research Roadmapcited by 40
  25. 2024CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agentscited by 38
  26. 2023PPTC Benchmark: Evaluating Large Language Models for PowerPoint Task Completioncited by 30
  27. 2025API Agents vs. GUI Agents: Divergence and Convergencecited by 28
  28. 2025A Definition of AGIcited by 25
  29. 2025Auto-Slides: An Interactive Multi-Agent System for Creating and Customizing Research Presentationscited by 18
  30. 2025Agentic AI Frameworks: Architectures, Protocols, and Design Challengescited by 16
  31. 2025Is Your Video Language Model a Reliable Judge?cited by 14
  32. 2025BrowserArena: Evaluating LLM Agents on Real-World Web Navigation Taskscited by 12
  33. 2024PPTC-R benchmark: Towards Evaluating the Robustness of Large Language Models for PowerPoint Task Completioncited by 9
  34. 2025Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulationcited by 7
  35. 2025ReasonVQA: A Multi-hop Reasoning Benchmark with Structural Knowledge for Visual Question Answeringcited by 7
  36. 2025VQArt-Bench: A semantically rich VQA Benchmark for Art and Cultural Heritagecited by 7
  37. 2025FieldWorkArena: Agentic AI Benchmark for Real Field Work Taskscited by 6
  38. 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Mediacited by 6

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PPT-Eval: A Benchmark for Computer-Use Agents on PowerPoint Tasks
  2. 2026EditPPT: Faithful Long-Deck Slide Editing via Structured Tool-Using Multi-Agent with Dual-Modal Validators
  3. 2026SLIDEFORGE: An LLM Agent for Controllable Editing of Slides as Structured Artifacts
  4. 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides
  5. 2025PPTBench: Towards Holistic Evaluation of Large Language Models for PowerPoint Layout and Design Understanding
  6. 2026ACE: A Self-Correcting Agentic Canvas Editor for Multi-Slide Presentation Automation
  7. 2026StoryState: Agent-Based State Control for Consistent and Editable Storybooks
  8. 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing