mlsanityData to 14 Oct 2026

AnyDoc: Enhancing Document Generation via Large-Scale HTML/CSS Data Synthesis and Height-Aware Reinforcement Optimization

arXiv 2603.25118 ↗First posted 26 Mar 2026cs.CVcited by 1

On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data

Abstract (arXiv)

Document generation has gained growing attention in the field of AI-driven content creation. In this work, we push its boundaries by introducing AnyDoc, a framework capable of handling multiple generation tasks across a wide spectrum of document categories, all represented in a unified HTML/CSS format. To overcome the limited coverage and scale of existing human-crafted document datasets, AnyDoc first establishes a scalable data synthesis pipeline to automatically generate documents in HTML/CSS form. This pipeline yields DocHTML, a large-scale dataset containing 265,206 document samples, while spanning 111 categories and 32 distinct styles. Additionally, all documents are equipped with comprehensive metadata, including design intentions, HTML/CSS source code, visual assets, and rendered screenshots. Building on the curated dataset, AnyDoc fine-tunes multi-modal large language models (MLLMs) to achieve three practical document generation tasks: intention-to-document, document derendering, and element-to-document. To address the content overflow issue observed during fine-tuning, AnyDoc further incorporates a height-aware reinforcement learning (HARL) post-training procedure. By defining a reward function based on the difference between predicted and target document heights, overflow is penalized and gradually mitigated during HARL, thereby enhancing overall performance. Qualitative and quantitative experiments demonstrate that AnyDoc outperforms both general-purpose MLLMs and task-specific baselines across all three tasks.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 39 of its 42 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

39 of 42 references.

References · 39

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025Qwen3 Technical Reportcited by 8,820
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
27 more
  1. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  2. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  3. 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
  4. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
  5. 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
  6. 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
  7. 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
  8. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
  9. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  10. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
  11. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  12. 2023AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generationcited by 41
  13. 2024Graphic Design with Large Multimodal Modelcited by 40
  14. 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 40
  15. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 40
  16. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
  17. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  18. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  19. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  20. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
  21. 2023Towards Flexible Multi-modal Document Modelscited by 31
  22. 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 20
  23. 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 16
  24. 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 16
  25. 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
  26. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 13
  27. 2024WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DocReward: A Document Reward Model for Structuring and Stylizing
  2. 2026WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learning
  3. 2025WebRenderBench: Enhancing Web Interface Generation through Layout-Style Consistency and Reinforcement Learning
  4. 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
  5. 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaboration
  6. 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
  7. 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generation
  8. 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning