mlsanityData to 14 Oct 2026

What to Format and How: A Benchmark and Workflow Approach for Document Formatting

arXiv 2606.01936 ↗First posted 1 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in large language models (LLMs) have opened up new possibilities for automated document formatting. However, real-world formatting often requires identifying targets based on document content. This content-aware setting remains challenging and underexplored, primarily due to the lack of dedicated evaluation datasets.To enable evaluation in realistic content-aware scenarios, we introduce DocFormBench, a benchmark that extends Text-to-Format evaluation to diverse formatting requirements, along with metrics for both accuracy and efficiency.To mitigate redundant document reading in existing methods during formatting, we propose DocFormFlow, a workflow formatting method that decouples target localization from modification execution into what to format and how. Extensive experiments across multiple LLMs and multimodal models show that DocFormFlow consistently improves formatting accuracy while reducing token consumption compared to representative baselines. Further analysis reveals that precise target localization is the primary factor influencing formatting performance. We hope DocFormBench and DocFormFlow will facilitate future research toward more intelligent and reliable document formatting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 32 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

12 of 32 references.

References · 12

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  4. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  5. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  6. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
  7. 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agentscited by 159
  8. 2026OpenClaw-RL: Train Any Agent Simply by Talkingcited by 90
  9. 2025SEAgent: Self-Evolving Computer Use Agent with Autonomous Learning from Experiencecited by 69
  10. 2024NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Callscited by 48
  11. 2025ReflAct: World-Grounded Decision Making in LLM Agents via Goal-State Reflectioncited by 31
  12. 2025CRITICTOOL: Evaluating Self-Critique Capabilities of Large Language Models in Tool-Calling Error Scenarioscited by 19

Built on by

Not cited yet.