# Extracting Scientific Figures with Distantly Supervised Neural Networks

arXiv: https://arxiv.org/abs/1804.02445 · HTML: https://mlsanity.com/paper/1804.02445/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 6 Apr 2018.

## Built on by (most cited first, 30 of 36)

- [LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding](https://mlsanity.com/paper/2202.13669/) (2022)
- [LayoutReader: Pre-training of Text and Layout for Reading Order Detection](https://mlsanity.com/paper/2108.11591/) (2021)
- [DocILE Benchmark for Document Information Localization and Extraction](https://mlsanity.com/paper/2302.05658/) (2023)
- [Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction](https://mlsanity.com/paper/2410.21169/) (2024)
- [VSR: A Unified Framework for Document Layout Analysis combining Vision, Semantics and Relations](https://mlsanity.com/paper/2105.06220/) (2021)
- [VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups](https://mlsanity.com/paper/2106.00676/) (2021)
- [A large-scale dataset for end-to-end table recognition in the wild](https://mlsanity.com/paper/2303.14884/) (2023)
- [Current Status and Performance Analysis of Table Recognition in Document Images with Deep Neural Networks](https://mlsanity.com/paper/2104.14272/) (2021)
- [Form2Seq : A Framework for Higher-Order Form Structure Extraction](https://mlsanity.com/paper/2107.04419/) (2021)
- [TabLeX: A Benchmark Dataset for Structure and Content Information Extraction from Scientific Tables](https://mlsanity.com/paper/2105.06400/) (2021)
- [Deep learning for table detection and structure recognition: A survey](https://mlsanity.com/paper/2211.08469/) (2022)
- [TNCR: Table Net Detection and Classification Dataset](https://mlsanity.com/paper/2106.15322/) (2021)
- [Business Document Information Extraction: Towards Practical Benchmarks](https://mlsanity.com/paper/2206.11229/) (2022)
- [ACL-Fig: A Dataset for Scientific Figure Classification](https://mlsanity.com/paper/2301.12293/) (2023)
- [Robust PDF Document Conversion Using Recurrent Neural Networks](https://mlsanity.com/paper/2102.09395/) (2021)
- [ICDAR 2021 Competition on Scientific Table Image Recognition to LaTeX](https://mlsanity.com/paper/2105.14426/) (2021)
- [BioFors: A Large Biomedical Image Forensics Dataset](https://mlsanity.com/paper/2108.12961/) (2021)
- [Delivering Document Conversion as a Cloud Service with High Throughput and Responsiveness](https://mlsanity.com/paper/2206.00785/) (2022)
- [Tables to LaTeX: structure and content extraction from scientific tables](https://mlsanity.com/paper/2210.17246/) (2022)
- [Multi-Modal Association based Grouping for Form Structure Extraction](https://mlsanity.com/paper/2107.04396/) (2021)
- [Tab2Know: Building a Knowledge Base from Tables in Scientific Papers](https://mlsanity.com/paper/2107.13306/) (2021)
- [Line Graphics Digitization: A Step Towards Full Automation](https://mlsanity.com/paper/2307.02065/) (2023)
- [Table Detection in the Wild: A Novel Diverse Table Detection Dataset and Method](https://mlsanity.com/paper/2209.09207/) (2022)
- [Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence](https://mlsanity.com/paper/2601.12318/) (2026)
- [MexPub: Deep Transfer Learning for Metadata Extraction from German Publications](https://mlsanity.com/paper/2106.07359/) (2021)
- [ScanBank: A Benchmark Dataset for Figure Extraction from Scanned Electronic Theses and Dissertations](https://mlsanity.com/paper/2106.15320/) (2021)
- [Document Domain Randomization for Deep Learning Document Layout Extraction](https://mlsanity.com/paper/2105.14931/) (2021)
- [Language Independent Neuro-Symbolic Semantic Parsing for Form Understanding](https://mlsanity.com/paper/2305.04460/) (2023)
- [A Framework For Refining Text Classification and Object Recognition from Academic Articles](https://mlsanity.com/paper/2305.17401/) (2023)
- [Object Recognition from Scientific Document based on Compartment Refinement Framework](https://mlsanity.com/paper/2312.09038/) (2023)

## Abstract (arXiv)

Non-textual components such as charts, diagrams and tables provide key information in many scientific documents, but the lack of large labeled datasets has impeded the development of data-driven methods for scientific figure extraction. In this paper, we induce high-quality training labels for the task of figure extraction in a large number of scientific documents, with no human intervention. To accomplish this we leverage the auxiliary data provided in two large web collections of scientific documents (arXiv and PubMed) to locate figures and their associated captions in the rasterized PDF. We share the resulting dataset of over 5.5 million induced labels---4,000 times larger than the previous largest figure extraction dataset---with an average precision of 96.8%, to enable the development of modern data-driven methods for this task. We use this dataset to train a deep neural network for end-to-end figure detection, yielding a model that can be more easily extended to new domains compared to previous work. The model was successfully deployed in Semantic Scholar, a large-scale academic search engine, and used to extract figures in 13 million scientific documents.