FloodSQL-Bench: A Retrieval-Augmented Benchmark for Geospatially-Grounded Text-to-SQL
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
also in 1 more
Abstract (arXiv)
Existing Text-to-SQL benchmarks primarily focus on single-table queries or limited joins in general-purpose domains, and thus fail to reflect the complexity of domain-specific, multi-table and geospatial reasoning, To address this limitation, we introduce FLOODSQL-BENCH, a geospatially grounded benchmark for the flood management domain that integrates heterogeneous datasets through key-based, spatial, and hybrid joins. The benchmark captures realistic flood-related information needs by combining social, infrastructural, and hazard data layers. We systematically evaluate recent large language models with the same retrieval-augmented generation settings and measure their performance across difficulty tiers. By providing a unified, open benchmark grounded in real-world disaster management data, FLOODSQL-BENCH establishes a practical testbed for advancing Text-to-SQL research in high-stakes application domains.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 28 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
11 of 28 references.
References · 11
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
- 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 185
- 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 144
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
- 2019SpatialNLI: A Spatial Domain Natural Language Interface to Databases Using Spatial Comprehensioncited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026DisasterBench: Benchmarking LLM Planning under Typed Tool Interface Constraintscited by 3
- 2026DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Managementcited by 2
- 2026DisasterLex: An Expert Concept-to-Schema Knowledge Graph for Geospatial Reasoning in Disaster Analyticscited by 0
- 2026DisasterLex: An Expert Concept-to-Schema Knowledge Graph for Geospatial Reasoning in Disaster Analytics28 May 2026
- 2026DisasterBench: Benchmarking LLM Planning under Typed Tool Interface Constraints27 May 2026
- 2026DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026DisastRAG: A Multi-Source Disaster Information Integration and Access System Based on Retrieval-Augmented Large Language Models
- 2023FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLM
- 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps
- 2025From Questions to Queries: An AI-powered Multi-Agent Framework for Spatial Text-to-SQL
- 2025TARGET: Benchmarking Table Retrieval for Generative Tasks
- 2025RASL: Retrieval Augmented Schema Linking for Massive Database Text-to-SQL
- 2026Training-free retrieval-augmented generation with reinforced reasoning for flood damage nowcasting
- 2026CSR-RAG: An Efficient Retrieval System for Text-to-SQL on the Enterprise Scale