VSA:Visual-Structural Alignment for UI-to-Code
Not on the map. Why?
Abstract (arXiv)
The automation of user interface development has the potential to accelerate software delivery by mitigating intensive manual implementation. Despite the advancements in Large Multimodal Models for design-to-code translation, existing methodologies predominantly yield unstructured, flat codebases that lack compatibility with component-oriented libraries such as React or Angular. Such outputs typically exhibit low cohesion and high coupling, complicating long-term maintenance. In this paper, we propose VSA (VSA), a multi-stage paradigm designed to synthesize organized frontend assets through visual-structural alignment. Our approach first employs a spatial-aware transformer to reconstruct the visual input into a hierarchical tree representation. Moving beyond basic layout extraction, we integrate an algorithmic pattern-matching layer to identify recurring UI motifs and encapsulate them into modular templates. These templates are then processed via a schema-driven synthesis engine, ensuring the Large Language Model generates type-safe, prop-drilled components suitable for production environments. Experimental results indicate that our framework yields a substantial improvement in code modularity and architectural consistency over state-of-the-art benchmarks, effectively bridging the gap between raw pixels and scalable software engineering.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DOne: Decoupling Structure and Rendering for High-Fidelity Design-to-Code Generation
- 2025ScreenCoder: Advancing Visual-to-Code Generation for Front-End Automation via Modular Multimodal Agents
- 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
- 2025Portal UX Agent -- A Plug-and-Play Engine for Rendering UIs from Natural Language Specifications
- 2025Advancing vision-language models in front-end development via data synthesis
- 2025DesignBench: A Comprehensive Benchmark for MLLM-based Front-end Code Generation
- 2026TaoD2C-Bench: Benchmarking MLLMs for Industrial UI Code Generation Beyond Visual Fidelity
- 2026Rubrics as Visual-Repair Context for Self-Evolving UI-to-Code Generation