Sketch2FullStack: Generating Skeleton Code of Full Stack Website and Application from Sketch using Deep Learning and Computer Vision
Not on the map. Why?
Abstract (arXiv)
For a full-stack web or app development, it requires a software firm or more specifically a team of experienced developers to contribute a large portion of their time and resources to design the website and then convert it to code. As a result, the efficiency of the development team is significantly reduced when it comes to converting UI wireframes and database schemas into an actual working system. It would save valuable resources and fasten the overall workflow if the clients or developers can automate this process of converting the pre-made full-stack website design to get a partially working if not fully working code. In this paper, we present a novel approach of generating the skeleton code from sketched images using Deep Learning and Computer Vision approaches. The dataset for training are first-hand sketched images of low fidelity wireframes, database schemas and class diagrams. The approach consists of three parts. First, the front-end or UI elements detection and extraction from custom-made UI wireframes. Second, individual database table creation from schema designs and lastly, creating a class file from class diagrams.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 43 references that are in the map. First posted on arXiv 26 Nov 2022.
Builds on
14 of 43 references.
References · 14
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2015Fast R-CNNcited by 2,930
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2019Image-based table recognition: data, model, and evaluationcited by 233
- 2016Speed/accuracy trade-offs for modern convolutional object detectorscited by 198
- 2017pix2code: Generating Code from a Graphical User Interface Screenshotcited by 113
- 2020CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documentscited by 98
- 2020TableNet: Deep Learning model for end-to-end Table detection and Tabular data extraction from Scanned Document Imagescited by 69
- 2018Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Appscited by 36
- 2020CDeC-Net: Composite Deformable Cascade Network for Table Detection in Document Imagescited by 22
- 2019Sketch2Code: Transformation of Sketches to UI in Real-time Using Deep Neural Networkcited by 21
Built on by
Citing papers per year: 2025: 1.
1 paper.