AnyDoc: Enhancing Document Generation via Large-Scale HTML/CSS Data Synthesis and Height-Aware Reinforcement Optimization
On the map: Synthetic data and self-improvement for LLMs → Self-improving MLLMs and synthetic data
Abstract (arXiv)
Document generation has gained growing attention in the field of AI-driven content creation. In this work, we push its boundaries by introducing AnyDoc, a framework capable of handling multiple generation tasks across a wide spectrum of document categories, all represented in a unified HTML/CSS format. To overcome the limited coverage and scale of existing human-crafted document datasets, AnyDoc first establishes a scalable data synthesis pipeline to automatically generate documents in HTML/CSS form. This pipeline yields DocHTML, a large-scale dataset containing 265,206 document samples, while spanning 111 categories and 32 distinct styles. Additionally, all documents are equipped with comprehensive metadata, including design intentions, HTML/CSS source code, visual assets, and rendered screenshots. Building on the curated dataset, AnyDoc fine-tunes multi-modal large language models (MLLMs) to achieve three practical document generation tasks: intention-to-document, document derendering, and element-to-document. To address the content overflow issue observed during fine-tuning, AnyDoc further incorporates a height-aware reinforcement learning (HARL) post-training procedure. By defining a reward function based on the difference between predicted and target document heights, overflow is penalized and gradually mitigated during HARL, thereby enhancing overall performance. Qualitative and quantitative experiments demonstrate that AnyDoc outperforms both general-purpose MLLMs and task-specific baselines across all three tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Self-improving MLLMs and synthetic data, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 39 of its 42 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
39 of 42 references.
References · 39
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
27 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 152
- 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 95
- 2025PPTAgent: Generating and Evaluating Presentations Beyond Text-to-Slidescited by 86
- 2025AutoPresent: Designing Structured Visuals from Scratchcited by 68
- 2025Paper2Poster: Towards Multimodal Poster Automation from Scientific Paperscited by 63
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
- 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
- 2023AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generationcited by 41
- 2024Graphic Design with Large Multimodal Modelcited by 40
- 2025DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Modelscited by 40
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 40
- 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
- 2023Towards Flexible Multi-modal Document Modelscited by 31
- 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 20
- 2023Planning and Rendering: Towards Product Poster Generation with Diffusion Modelscited by 16
- 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 16
- 2025PrismLayers: Open Data for High-Quality Multi-Layer Transparent Image Generative Modelscited by 15
- 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 13
- 2024WebRPG: Automatic Web Rendering Parameters Generation for Visual Presentationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025DocReward: A Document Reward Model for Structuring and Stylizing
- 2026WebGen-R1: Incentivizing Large Language Models to Generate Functional and Aesthetic Websites with Reinforcement Learning
- 2025WebRenderBench: Enhancing Web Interface Generation through Layout-Style Consistency and Reinforcement Learning
- 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding
- 2026ViviDoc: Generating Interactive Documents through Human-Agent Collaboration
- 2025WebGen-V Bench: Structured Representation for Enhancing Visual Design in LLM-based Web Generation and Evaluation
- 2024AnyControl: Create Your Artwork with Versatile Control on Text-to-Image Generation
- 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning