# Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline

arXiv: https://arxiv.org/abs/1907.13550 · HTML: https://mlsanity.com/paper/1907.13550/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 31 Jul 2019.

## Built on by (most cited first, 20 of 20)

- [Foundation Models Meet Visualizations: Challenges and Opportunities](https://mlsanity.com/paper/2310.05771/) (2023)
- [Chart Question Answering: State of the Art and Future Directions](https://mlsanity.com/paper/2205.03966/) (2022)
- [Generative AI for Visualization: State of the Art and Future Directions](https://mlsanity.com/paper/2404.18144/) (2024)
- [Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model](https://mlsanity.com/paper/2304.14630/) (2023)
- [Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaboration](https://mlsanity.com/paper/2309.15723/) (2023)
- [InvVis: Large-Scale Data Embedding for Invertible Visualization](https://mlsanity.com/paper/2307.16176/) (2023)
- [Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directions](https://mlsanity.com/paper/2409.19747/) (2024)
- [Mystique: Deconstructing SVG Charts for Layout Reuse](https://mlsanity.com/paper/2307.13567/) (2023)
- [InfoDet: A Dataset for Infographic Element Detection](https://mlsanity.com/paper/2505.17473/) (2025)
- [Infographics Wizard: Flexible Infographics Authoring and Design Exploration](https://mlsanity.com/paper/2204.09904/) (2022)
- [Generalization of CNNs on Relational Reasoning with Bar Charts](https://mlsanity.com/paper/2503.00086/) (2025)
- [User-Centric Semi-Automated Infographics Authoring and Recommendation](https://mlsanity.com/paper/2108.11914/) (2021)
- [Reinforced Labels: Multi-Agent Deep Reinforcement Learning for Point-Feature Label Placement](https://mlsanity.com/paper/2303.01388/) (2023)
- [ChartKG: A Knowledge-Graph-Based Representation for Chart Images](https://mlsanity.com/paper/2410.09761/) (2024)
- [VisGuard: Securing Visualization Dissemination through Tamper-Resistant Data Retrieval](https://mlsanity.com/paper/2507.14459/) (2025)
- [AskYourDB: An end-to-end system for querying and visualizing relational databases using natural language](https://mlsanity.com/paper/2210.08532/) (2022)
- [Learning Multimodal Affinities for Textual Editing in Images](https://mlsanity.com/paper/2103.10139/) (2021)
- [Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support](https://mlsanity.com/paper/2604.07989/) (2026)
- [Semantic-Structural Alignment for Generative Pictorial Charts](https://mlsanity.com/paper/2606.06498/) (2026)
- [Semantic Segmentation of Node and Edge Diagrams for Assistive Technology](https://mlsanity.com/paper/2606.11320/) (2026)

## Abstract (arXiv)

Designers need to consider not only perceptual effectiveness but also visual styles when creating an infographic. This process can be difficult and time consuming for professional designers, not to mention non-expert users, leading to the demand for automated infographics design. As a first step, we focus on timeline infographics, which have been widely used for centuries. We contribute an end-to-end approach that automatically extracts an extensible timeline template from a bitmap image. Our approach adopts a deconstruction and reconstruction paradigm. At the deconstruction stage, we propose a multi-task deep neural network that simultaneously parses two kinds of information from a bitmap timeline: 1) the global information, i.e., the representation, scale, layout, and orientation of the timeline, and 2) the local information, i.e., the location, category, and pixels of each visual element on the timeline. At the reconstruction stage, we propose a pipeline with three techniques, i.e., Non-Maximum Merging, Redundancy Recover, and DL GrabCut, to extract an extensible template from the infographic, by utilizing the deconstruction results. To evaluate the effectiveness of our approach, we synthesize a timeline dataset (4296 images) and collect a real-world timeline dataset (393 images) from the Internet. We first report quantitative evaluation results of our approach over the two datasets. Then, we present examples of automatically extracted templates and timelines automatically generated based on these templates to qualitatively demonstrate the performance. The results confirm that our approach can effectively extract extensible templates from real-world timeline infographics.