mlsanityData to 14 Oct 2026

FloodSQL-Bench: A Retrieval-Augmented Benchmark for Geospatially-Grounded Text-to-SQL

arXiv 2512.12084 ↗First posted 12 Dec 2025cs.IRcited by 3

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

also in 1 more
Abstract (arXiv)

Existing Text-to-SQL benchmarks primarily focus on single-table queries or limited joins in general-purpose domains, and thus fail to reflect the complexity of domain-specific, multi-table and geospatial reasoning, To address this limitation, we introduce FLOODSQL-BENCH, a geospatially grounded benchmark for the flood management domain that integrates heterogeneous datasets through key-based, spatial, and hybrid joins. The benchmark captures realistic flood-related information needs by combining social, infrastructural, and hazard data layers. We systematically evaluate recent large language models with the same retrieval-augmented generation settings and measure their performance across difficulty tiers. By providing a unified, open benchmark grounded in real-world disaster management data, FLOODSQL-BENCH establishes a practical testbed for advancing Text-to-SQL research in high-stakes application domains.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 28 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

11 of 28 references.

References · 11

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  3. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
  4. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  5. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
  6. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  7. 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 185
  8. 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 144
  9. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  10. 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
  11. 2019SpatialNLI: A Spatial Domain Natural Language Interface to Databases Using Spatial Comprehensioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DisastRAG: A Multi-Source Disaster Information Integration and Access System Based on Retrieval-Augmented Large Language Models
  2. 2023FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLM
  3. 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps
  4. 2025From Questions to Queries: An AI-powered Multi-Agent Framework for Spatial Text-to-SQL
  5. 2025TARGET: Benchmarking Table Retrieval for Generative Tasks
  6. 2025RASL: Retrieval Augmented Schema Linking for Massive Database Text-to-SQL
  7. 2026Training-free retrieval-augmented generation with reinforced reasoning for flood damage nowcasting
  8. 2026CSR-RAG: An Efficient Retrieval System for Text-to-SQL on the Enterprise Scale