SciDaSynth: Interactive Structured Data Extraction from Scientific Literature with Large Language Model
Not on the map. Why?
Abstract (arXiv)
The explosion of scientific literature has made the efficient and accurate extraction of structured data a critical component for advancing scientific knowledge and supporting evidence-based decision-making. However, existing tools often struggle to extract and structure multimodal, varied, and inconsistent information across documents into standardized formats. We introduce SciDaSynth, a novel interactive system powered by large language models (LLMs) that automatically generates structured data tables according to users' queries by integrating information from diverse sources, including text, tables, and figures. Furthermore, SciDaSynth supports efficient table data validation and refinement, featuring multi-faceted visual summaries and semantic grouping capabilities to resolve cross-document data inconsistencies. A within-subjects study with nutrition and NLP researchers demonstrates SciDaSynth's effectiveness in producing high-quality structured data more efficiently than baseline methods. We discuss design implications for human-AI collaborative systems supporting data extraction tasks. The system code is available at https://github.com/xingbow/SciDaEx
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 22 of its 66 references that are in the map. First posted on arXiv 21 Apr 2024.
Builds on
22 of 66 references.
References · 22
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
- 2022Teaching language models to support answers with verified quotescited by 292
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2022Attributed Question Answering: Evaluation and Modeling for Attributed Large Language Modelscited by 112
- 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 101
- 2023Automatic Evaluation of Attribution by Large Language Modelscited by 72
10 more
- 2019Inferring Which Medical Treatments Work from Reports of Clinical Trialscited by 64
- 2020Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbolscited by 36
- 2022Scim: Intelligent Skimming Support for Scientific Paperscited by 27
- 2023Synergi: A Mixed-Initiative System for Scholarly Synthesis and Sensemakingcited by 26
- 2022Paper Plain: Making Medical Research Papers Approachable to Healthcare Consumers with Natural Language Processingcited by 23
- 2022Threddy: An Interactive System for Personalized Thread-based Exploration and Organization of Scientific Literaturecited by 22
- 2020Conversations with Documents. An Exploration of Document-Centered Assistancecited by 12
- 2020Trialstreamer: Mapping and Browsing Medical Evidence in Real-Timecited by 12
- 2022Beyond Interestingness: Semantic and Context-Aware Natural Language Query Recommendations for Visual Data Analysiscited by 6
- 2022Marvista: Exploring the Design of a Human-AI Collaborative News Reading Toolcited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.