From Dead Pixels to Editable Slides: Infographic Reconstruction into Native Google Slides via Vision-Language Region Understanding
Not on the map. Why?
Abstract (arXiv)
Infographics are widely used to communicate information with a combination of text, icons, and data visualizations, but once exported as images their content is locked into pixels, making updates, localization, and reuse expensive. We describe textscImages2Slides, an API-based pipeline that converts a static infographic (PNG/JPG) into a native, editable Google Slides slide by extracting a region-level specification with a vision-language model (VLM), mapping pixel geometry into slide coordinates, and recreating elements using the Google Slides batch update API. The system is model-agnostic and supports multiple VLM backends via a common JSON region schema and deterministic postprocessing. On a controlled benchmark of 29 programmatically generated infographic slides with known ground-truth regions, textscImages2Slides achieves an overall element recovery rate of 0.989±0.057 (text: 0.985±0.083, images: 1.000±0.000), with mean text transcription error CER=0.033±0.149 and mean layout fidelity IoU=0.364±0.161 for text regions and 0.644±0.131 for image regions. We also highlight practical engineering challenges in reconstruction, including text size calibration and non-uniform backgrounds, and describe failure modes that guide future work.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
22 of 29 references.
References · 22
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
- 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
- 2021InfographicVQAcited by 430
- 2021OCR-free Document Understanding Transformercited by 400
- 2022Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understandingcited by 360
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 349
- 2023Nougat: Neural Optical Understanding for Academic Documentscited by 240
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
10 more
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2022DePlot: One-shot visual language reasoning by plot-to-table translationcited by 157
- 2024Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineeringcited by 146
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
- 2024ScreenAI: A Vision-Language Model for UI and Infographics Understandingcited by 97
- 2024DocVLM: Make Your VLM an Efficient Readercited by 27
- 2023ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rulescited by 24
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 18
- 2024DLAFormer: An End-to-End Transformer For Document Layout Analysiscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Semantic Document Derendering: SVG Reconstruction via Vision-Language Modeling
- 2025VLM-SlideEval: Evaluating VLMs on Structured Comprehension and Perturbation Sensitivity in PPT
- 2026SLIDEFORGE: An LLM Agent for Controllable Editing of Slides as Structured Artifacts
- 2026InfoEdit: Probing Global Layout Reasoning in Infographic Editing
- 2025Animation Needs Attention: A Holistic Approach to Slides Animation Comprehension with Visual-Language Models
- 2025SlideCoder: Layout-aware RAG-enhanced Hierarchical Slide Generation from Design
- 2025Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulation
- 2026PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides