mlsanityData to 7 Oct 2026

Beyond Tables: Doc2DB-Bench for Relationally Faithful Document-to-Database Construction

arXiv 2608.08459 ↗First posted 9 Aug 2026cs.CL cs.AI cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Practical AI systems increasingly need to turn long, heterogeneous documents into queryable relational databases, not isolated spreadsheets. In domains such as finance, healthcare, education, transportation, and enterprise operations, downstream workflows rely on normalized schemas, entity identities, keys, cross-table relationships, and integrity constraints for analytics, compliance, auditing, and SQL-backed decision making. Existing Document-to-Table benchmarks are insufficient for this setting: flattening evidence into single tables can duplicate entities, obscure many-to-many relationships, create sparse records, and avoid testing whether extracted facts form a valid database instance. This creates an urgent need to evaluate document understanding as database construction rather than field extraction. We introduce Doc2DB-Bench, a benchmark for Document-to-Database construction, containing 203 long-document instances across 42 schemas and seven domain groups, with 117 entity tables, 132 relationship tables, 7,341 rows, and 41,935 cells. Built through a controllable DB-to-Doc synthesis pipeline and organized by a taxonomy of intra-table extraction and inter-table reasoning, the generated documents undergo authenticity verification, proving indistinguishable from real-world references. Doc2DB-Bench thus provides a testbed for reliable, auditable, and relationally faithful LLM-based data systems. The benchmark is publicly available at https://github.com/SetonLiang/Doc2DB-Bench.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 55 references that are in the map. First posted on arXiv 9 Aug 2026.

Builds on

33 of 55 references.

References · 33

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2024Qwen2.5 Technical Reportcited by 4,713
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  6. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  7. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  8. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
  9. 2017The E2E Dataset: New Challenges For End-to-End Generationcited by 252
  10. 2017Challenges in Data-to-Document Generationcited by 226
  11. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  12. 2024MMLongBench-Doc: Benchmarking Long-context Document Understanding with Visualizationscited by 174
21 more
  1. 2017Cross-Sentence N-ary Relation Extraction with Graph LSTMscited by 101
  2. 2024StructRAG: Boosting Knowledge Intensive Reasoning of LLMs via Inference-time Hybrid Information Structurizationcited by 70
  3. 2024LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locatingcited by 70
  4. 2018OpenTag: Open Attribute Value Extraction from Product Profiles [Deep Learning, Active Learning, Named Entity Recognition]cited by 62
  5. 2024DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processingcited by 49
  6. 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
  7. 2023Instruct and Extract: Instruction Tuning for On-Demand Information Extractioncited by 35
  8. 2024Text-Tuple-Table: Towards Information Integration in Text-to-Table Generation via Global Tuple Extractioncited by 33
  9. 2025Benchmarking Retrieval-Augmented Multimodal Generation for Document Question Answeringcited by 33
  10. 2015Incremental Knowledge Base Construction Using DeepDivecited by 14
  11. 2024LLMs4Synthesis: Leveraging Large Language Models for Scientific Synthesiscited by 13
  12. 2024Structsum Generation for Faster Text Comprehensioncited by 9
  13. 2025SemBench: A Benchmark for Semantic Query Processing Enginescited by 8
  14. 2025Map&Make: Schema Guided Text to Table Generationcited by 6
  15. 2022Sparse Conditional Hidden Markov Model for Weakly Supervised Named Entity Recognitioncited by 4
  16. 2025SQUiD: Synthesizing Relational Databases from Unstructured Textcited by 4
  17. 2025StructText: A Synthetic Table-to-Text Approach for Benchmark Generation with Multi-Dimensional Evaluationcited by 4
  18. 2026Long-Document QA with Chain-of-Structured-Thought and Fine-Tuned SLMscited by 3
  19. 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspacescited by 3
  20. 2026DTBench: A Synthetic Benchmark for Document-to-Table Extractioncited by 2
  21. 2026QwenPaw-Data: Bridging Facts, Methodology, and Execution for Autonomous Enterprise Data Analyticscited by 1

Built on by

Not cited yet.