mlsanityData to 14 Oct 2026

SheetDesigner: MLLM-Powered Spreadsheet Layout Generation with Rule-Based and Vision-Based Reflection

arXiv 2509.07473 ↗First posted 9 Sep 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Spreadsheets are critical to data-centric tasks, with rich, structured layouts that enable efficient information transmission. Given the time and expertise required for manual spreadsheet layout design, there is an urgent need for automated solutions. However, existing automated layout models are ill-suited to spreadsheets, as they often (1) treat components as axis-aligned rectangles with continuous coordinates, overlooking the inherently discrete, grid-based structure of spreadsheets; and (2) neglect interrelated semantics, such as data dependencies and contextual links, unique to spreadsheets. In this paper, we first formalize the spreadsheet layout generation task, supported by a seven-criterion evaluation protocol and a dataset of 3,326 spreadsheets. We then introduce SheetDesigner, a zero-shot and training-free framework using Multimodal Large Language Models (MLLMs) that combines rule and vision reflection for component placement and content population. SheetDesigner outperforms five baselines by at least 22.6%. We further find that through vision modality, MLLMs handle overlap and balance well but struggle with alignment, necessitates hybrid rule and visual reflection strategies. Our codes and data is available at Github.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 9 Sep 2025.

Builds on

22 of 39 references.

References · 22

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  3. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
  4. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  5. 2021Variational Transformer Networks for Layout Generationcited by 88
  6. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  7. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  8. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
  9. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
  10. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  11. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
  12. 2024Graphic Design with Large Multimodal Modelcited by 40
10 more
  1. 2025PosterO: Structuring Layout Trees to Enable Language Models in Generalized Content-Aware Layout Generationcited by 16
  2. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
  3. 2025DAGPrompT: Pushing the Limits of Graph Prompting with a Distribution-aware Graph Prompt Tuning Approachcited by 11
  4. 2021Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Modelscited by 8
  5. 2025Fast-Slow-Thinking: Complex Task Solving with Large Language Modelscited by 7
  6. 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generationcited by 7
  7. 2024Revision Matters: Generative Design Guided by Revision Editscited by 4
  8. 2024CoLay: Controllable Layout Generation through Multi-conditional Latent Diffusioncited by 3
  9. 2025Large Language Models for Predictive Analysis: How Far Are They?cited by 3
  10. 2025Adaptive Heterogeneous Graph Neural Networks: Bridging Heterophily and Heterogeneitycited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Representation Interventions Enable Lifelong Knowledge Memory Control in LLMscited by 3

Similar, not cited

Close in wording, no citation either way

  1. 2024Vision Language Models for Spreadsheet Understanding: Challenges and Opportunities
  2. 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Models
  3. 2026SheetCompass: Hierarchical Relation Graphs for Agentic Spreadsheet Reasoning
  4. 2026From Rows to Reasoning: A Retrieval-Augmented Multimodal Framework for Spreadsheet Understanding
  5. 2026Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editing
  6. 2026Towards Robust Real-World Spreadsheet Understanding with Multi-Agent Multi-Format Reasoning
  7. 2026SpreadsheetArena: Decomposing Preference in LLM Generation of Spreadsheet Workbooks
  8. 2025PPTBench: Towards Holistic Evaluation of Large Language Models for PowerPoint Layout and Design Understanding