CAESURA: Language Models as Multi-Modal Query Planners
Not on the map. Why?
Abstract (arXiv)
Traditional query planners translate SQL queries into query plans to be executed over relational data. However, it is impossible to query other data modalities, such as images, text, or video stored in modern data systems such as data lakes using these query planners. In this paper, we propose Language-Model-Driven Query Planning, a new paradigm of query planning that uses Language Models to translate natural language queries into executable query plans. Different from relational query planners, the resulting query plans can contain complex operators that are able to process arbitrary modalities. As part of this paper, we present a first GPT-4 based prototype called CEASURA and show the general feasibility of this idea on two datasets. Finally, we discuss several ideas to improve the query planning capabilities of today's Language Models.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Aug 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 4; 2025: 9; 2026: 6.
19 papers.
Sort:
By area:
- 2024A Declarative System for Optimizing AI Workloadscited by 35
- 2025AgenticData: An Agentic Data Analytics System for Heterogeneous Datacited by 22
- 2024The Design of an LLM-powered Unstructured Analytics Systemcited by 20
- 2025Abacus: A Cost-Based Optimizer for Semantic Operator Systemscited by 11
- 2025SemBench: A Benchmark for Semantic Query Processing Enginescited by 8
- 2024Multi-Modal Data Exploration via Language Agentscited by 7
- 2025Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analyticscited by 6
- 2025Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimizationcited by 3
- 2024LaPuda: LLM-Enabled Policy-Based Query Optimizer for Multi-modal Datacited by 1
- 2025HCT-QA: A Benchmark for Question Answering on Human-Centric Tablescited by 1
- 2025TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakescited by 1
- 2025Implementing Semantic Join Operators Efficientlycited by 1
7 more
- 2026Memento: Towards Proactive Visualization of Everyday Memories with Personal Wearable AR Assistantcited by 1
- 2025Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systemscited by 0
- 2026Evergreen: Efficient Claim Verification for Semantic Aggregatescited by 0
- 2026Benchmarking Text-to-SQL under Role-Based Access Controlcited by 0
- 2026Concord: A Video Relational Algebra for Cross-Modal Query Optimizationcited by 0
- 2026KathDB-FAO: Synthesized Query Plans in a Multimodal DBMScited by 0
- 2026WeaveData: A Multimodal Data Analysis System with Self-Critiquing and Self-Evolving LLM Planscited by 0
- 2026WeaveData: A Multimodal Data Analysis System with Self-Critiquing and Self-Evolving LLM Plans28 Sep 2026
- 2026KathDB-FAO: Synthesized Query Plans in a Multimodal DBMS23 Sep 2026
- 2026Concord: A Video Relational Algebra for Cross-Modal Query Optimization4 Sep 2026
- 2026Benchmarking Text-to-SQL under Role-Based Access Control24 Jul 2026
- 2026Evergreen: Efficient Claim Verification for Semantic Aggregates28 Apr 2026
- 2026Memento: Towards Proactive Visualization of Everyday Memories with Personal Wearable AR Assistant24 Jan 2026
- 2025Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimization25 Nov 2025
- 2025SemBench: A Benchmark for Semantic Query Processing Engines3 Nov 2025
- 2025Implementing Semantic Join Operators Efficiently9 Oct 2025
- 2025Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analytics2 Sep 2025
- 2025AgenticData: An Agentic Data Analytics System for Heterogeneous Data7 Aug 2025
- 2025Abacus: A Cost-Based Optimizer for Semantic Operator Systems20 May 2025
7 more
- 2025TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes16 May 2025
- 2025HCT-QA: A Benchmark for Question Answering on Human-Centric Tables9 Mar 2025
- 2025Semantic Integrity Constraints: Declarative Guardrails for AI-Augmented Data Processing Systems1 Mar 2025
- 2024Multi-Modal Data Exploration via Language Agents24 Dec 2024
- 2024The Design of an LLM-powered Unstructured Analytics System1 Sep 2024
- 2024A Declarative System for Optimizing AI Workloads23 May 2024
- 2024LaPuda: LLM-Enabled Policy-Based Query Optimizer for Multi-modal Data20 Mar 2024
- 2024A Declarative System for Optimizing AI Workloadscited by 35
- 2024The Design of an LLM-powered Unstructured Analytics Systemcited by 20
- 2025Abacus: A Cost-Based Optimizer for Semantic Operator Systemscited by 11
- 2025SemBench: A Benchmark for Semantic Query Processing Enginescited by 8
- 2025Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimizationcited by 3
- 2024LaPuda: LLM-Enabled Policy-Based Query Optimizer for Multi-modal Datacited by 1
- 2025HCT-QA: A Benchmark for Question Answering on Human-Centric Tablescited by 1
- 2025TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakescited by 1
- 2025Implementing Semantic Join Operators Efficientlycited by 1
- 2026Memento: Towards Proactive Visualization of Everyday Memories with Personal Wearable AR Assistantcited by 1
- 2026Evergreen: Efficient Claim Verification for Semantic Aggregatescited by 0
- 2026Benchmarking Text-to-SQL under Role-Based Access Controlcited by 0
12 most cited of 13 All 13 (JSON)
- 2026KathDB-FAO: Synthesized Query Plans in a Multimodal DBMS23 Sep 2026
- 2026Benchmarking Text-to-SQL under Role-Based Access Control24 Jul 2026
- 2026Evergreen: Efficient Claim Verification for Semantic Aggregates28 Apr 2026
- 2026Memento: Towards Proactive Visualization of Everyday Memories with Personal Wearable AR Assistant24 Jan 2026
- 2025Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimization25 Nov 2025
- 2025SemBench: A Benchmark for Semantic Query Processing Engines3 Nov 2025
- 2025Implementing Semantic Join Operators Efficiently9 Oct 2025
- 2025Abacus: A Cost-Based Optimizer for Semantic Operator Systems20 May 2025
- 2025TAIJI: MCP-based Multi-Modal Data Analytics on Data Lakes16 May 2025
- 2025HCT-QA: A Benchmark for Question Answering on Human-Centric Tables9 Mar 2025
- 2024The Design of an LLM-powered Unstructured Analytics System1 Sep 2024
- 2024A Declarative System for Optimizing AI Workloads23 May 2024
12 newest of 13 All 13 (JSON)