AxCell: Automatic Extraction of Results from Machine Learning Papers
Not on the map. Why?
Abstract (arXiv)
Tracking progress in machine learning has become increasingly difficult with the recent explosion in the number of papers. In this paper, we present AxCell, an automatic machine learning pipeline for extracting results from papers. AxCell uses several novel components, including a table segmentation subtask, to learn relevant structural knowledge that aids extraction. When compared with existing methods, our approach significantly improves the state of the art for results extraction. We also release a structured, annotated dataset for training models for results extraction, and a dataset for evaluating the performance of models on this task. Lastly, we show the viability of our approach enables it to be used for semi-automated results extraction in production, suggesting our improvements make this task practically viable for the first time. Code is available on GitHub.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 11; 2023: 6; 2024: 12; 2025: 8; 2026: 5.
48 papers.
Sort:
By area:
- 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generationcited by 117
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2021MATE: Multi-view Attention for Table Transformer Efficiencycited by 54
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 41
- 2022Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Reviewcited by 37
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agentscited by 32
- 2023Schema-Driven Information Extraction from Heterogeneous Tablescited by 24
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
36 more
- 2022Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurementscited by 21
- 2021CitationIE: Leveraging the Citation Graph for Scientific Information Extractioncited by 19
- 2021Automated Mining of Leaderboards for Empirical AI Researchcited by 16
- 2022STable: Table Generation Framework for Encoder-Decoder Modelscited by 15
- 2025How Far Are AI Scientists from Changing the World?cited by 15
- 2021Learning to Reason for Text Generation from Scientific Tablescited by 13
- 2022Specialized Document Embeddings for Aspect-based Similarity of Research Paperscited by 12
- 2023GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasetscited by 12
- 2022Business Document Information Extraction: Towards Practical Benchmarkscited by 11
- 2024Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboardscited by 10
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challengescited by 10
- 2022A Dataset for N-ary Relation Extraction of Drug Combinationscited by 9
- 2022Graph Neural Networks and Representation Embedding for Table Extraction in PDF Documentscited by 6
- 2024Effective Context Selection in LLM-based Leaderboard Generation: An Empirical Studycited by 6
- 2024On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboardscited by 6
- 2022Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answeringcited by 4
- 2023CTE: A Dataset for Contextualized Table Extractioncited by 3
- 2023S2abEL: A Dataset for Entity Linking from Scientific Tablescited by 3
- 2024iTBLS: A Dataset of Interactive Conversations Over Tabular Informationcited by 3
- 2024Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIscited by 3
- 2025Can LLMs Help Uncover Insights about LLMs? A Large-Scale, Evolving Literature Analysis of Frontier LLMscited by 3
- 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboardscited by 3
- 2024LEGOBench: Scientific Leaderboard Generation Benchmarkcited by 2
- 2024Leveraging Distillation Techniques for Document Understanding: A Case Study with FLAN-T5cited by 2
- 2025League: Leaderboard Generation on Demandcited by 1
- 2025Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mappingcited by 1
- 2025Anticipatory Evaluation of Language Modelscited by 1
- 2026ModelLens: Finding the Best for Your Task from Myriads of Modelscited by 1
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sourcescited by 1
- 2022Data augmentation on graphs for table type classificationcited by 0
- 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approachcited by 0
- 2024Scaling Automatic Extraction of Pseudocodecited by 0
- 2024Instruction Finetuning for Leaderboard Generation from Empirical AI Researchcited by 0
- 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLUcited by 0
- 2026Standardization of Post-Publication Code Verification by Journals is Possible with the Support of the Communitycited by 0
- 2026MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experimentscited by 0
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sources19 Jun 2026
- 2026ModelLens: Finding the Best for Your Task from Myriads of Models8 May 2026
- 2026AIRS-Bench: a Suite of Tasks for Frontier AI Research Science Agents6 Feb 2026
- 2026MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experiments30 Jan 2026
- 2026Standardization of Post-Publication Code Verification by Journals is Possible with the Support of the Community12 Jan 2026
- 2025Anticipatory Evaluation of Language Models25 Sep 2025
- 2025Tabular Data Understanding with LLMs: A Survey of Recent Advances and Challenges31 Jul 2025
- 2025How Far Are AI Scientists from Changing the World?31 Jul 2025
- 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboards23 May 2025
- 2025Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping11 May 2025
- 2025Can LLMs Help Uncover Insights about LLMs? A Large-Scale, Evolving Literature Analysis of Frontier LLMs26 Feb 2025
- 2025League: Leaderboard Generation on Demand25 Feb 2025
36 more
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025
- 2024Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards19 Sep 2024
- 2024Leveraging Distillation Techniques for Document Understanding: A Case Study with FLAN-T517 Sep 2024
- 2024RexUniNLU: Recursive Method with Explicit Schema Instructor for Universal NLU9 Sep 2024
- 2024Instruction Finetuning for Leaderboard Generation from Empirical AI Research19 Aug 2024
- 2024On the Workflows and Smells of Leaderboard Operations (LBOps): An Exploratory Study of Foundation Model Leaderboards4 Jul 2024
- 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizations1 Jul 2024
- 2024Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs27 Jun 2024
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature10 Jun 2024
- 2024Scaling Automatic Extraction of Pseudocode7 Jun 2024
- 2024Effective Context Selection in LLM-based Leaderboard Generation: An Empirical Study6 Jun 2024
- 2024iTBLS: A Dataset of Interactive Conversations Over Tabular Information19 Apr 2024
- 2024LEGOBench: Scientific Leaderboard Generation Benchmark11 Jan 2024
- 2023DocLLM: A layout-aware generative language model for multimodal document understanding31 Dec 2023
- 2023GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets16 Nov 2023
- 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approach5 Nov 2023
- 2023Schema-Driven Information Extraction from Heterogeneous Tables23 May 2023
- 2023S2abEL: A Dataset for Entity Linking from Scientific Tables30 Apr 2023
- 2023CTE: A Dataset for Contextualized Table Extraction2 Feb 2023
- 2022Unifying Vision, Text, and Layout for Universal Document Processing5 Dec 2022
- 2022Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answering4 Oct 2022
- 2022Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurements30 Sep 2022
- 2022Data augmentation on graphs for table type classification23 Aug 2022
- 2022Graph Neural Networks and Representation Embedding for Table Extraction in PDF Documents23 Aug 2022
- 2022Business Document Information Extraction: Towards Practical Benchmarks20 Jun 2022
- 2022STable: Table Generation Framework for Encoder-Decoder Models8 Jun 2022
- 2022A Dataset for N-ary Relation Extraction of Drug Combinations4 May 2022
- 2022Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Review22 Apr 2022
- 2022Specialized Document Embeddings for Aspect-based Similarity of Research Papers28 Mar 2022
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks24 Jan 2022
- 2021Automated scholarly paper review: Concepts, technologies, and challenges15 Nov 2021
- 2021MATE: Multi-view Attention for Table Transformer Efficiency9 Sep 2021
- 2021Automated Mining of Leaderboards for Empirical AI Research31 Aug 2021
- 2021HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation15 Aug 2021
- 2021CitationIE: Leveraging the Citation Graph for Scientific Information Extraction3 Jun 2021
- 2021Learning to Reason for Text Generation from Scientific Tables16 Apr 2021
- 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
- 2022Unifying Vision, Text, and Layout for Universal Document Processingcited by 140
- 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
- 2021MATE: Multi-view Attention for Table Transformer Efficiencycited by 54
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2022Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Reviewcited by 37
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2023Schema-Driven Information Extraction from Heterogeneous Tablescited by 24
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2022Evaluate & Evaluation on the Hub: Better Best Practices for Data and Model Measurementscited by 21
- 2021CitationIE: Leveraging the Citation Graph for Scientific Information Extractioncited by 19
- 2021Automated Mining of Leaderboards for Empirical AI Researchcited by 16
12 most cited of 44 All 44 (JSON)
- 2026Building Agent Harnesses for Scientific Curation from Multimodal Sources19 Jun 2026
- 2026ModelLens: Finding the Best for Your Task from Myriads of Models8 May 2026
- 2026MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experiments30 Jan 2026
- 2026Standardization of Post-Publication Code Verification by Journals is Possible with the Support of the Community12 Jan 2026
- 2025Anticipatory Evaluation of Language Models25 Sep 2025
- 2025How Far Are AI Scientists from Changing the World?31 Jul 2025
- 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboards23 May 2025
- 2025Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping11 May 2025
- 2025Can LLMs Help Uncover Insights about LLMs? A Large-Scale, Evolving Literature Analysis of Frontier LLMs26 Feb 2025
- 2025League: Leaderboard Generation on Demand25 Feb 2025
- 2024Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards19 Sep 2024
- 2024Leveraging Distillation Techniques for Document Understanding: A Case Study with FLAN-T517 Sep 2024
12 newest of 44 All 44 (JSON)