mlsanityData to 14 Oct 2026

SParC: Cross-Domain Semantic Parsing in Context

arXiv 1906.02285 ↗First posted 5 Jun 2019cs.CL cs.AIcited by 144

Not on the map. Why?

Abstract (arXiv)

We present SParC, a dataset for cross-domainSemanticParsing inContext that consists of 4,298 coherent question sequences (12k+ individual questions annotated with SQL queries). It is obtained from controlled user interactions with 200 complex databases over 138 domains. We provide an in-depth analysis of SParC and show that it introduces new challenges compared to existing datasets. SParC demonstrates complex contextual dependencies, (2) has greater semantic diversity, and (3) requires generalization to unseen domains due to its cross-domain nature and the unseen databases at test time. We experiment with two state-of-the-art text-to-SQL models adapted to the context-dependent, cross-domain setup. The best model obtains an exact match accuracy of 20.2% over all questions and less than10% over all interaction sequences, indicating that the cross-domain setting and the con-textual phenomena of the dataset present significant challenges for future research. The dataset, baselines, and leaderboard are released at https://yale-lily.github.io/sparc.

Key facts. Cited by 144 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Jun 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 11; 2022: 26; 2023: 35; 2024: 22; 2025: 19; 2026: 31.

144 papers.

Sort:

By area:

  1. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
  2. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
  3. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  4. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
  5. 2024Next-Generation Database Interfaces: A Survey of LLM-based Text-to-SQLcited by 120
  6. 2023A comprehensive evaluation of ChatGPT's zero-shot Text-to-SQL capabilitycited by 119
  7. 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 98
  8. 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 87
  9. 2022RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQLcited by 85
  10. 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
  11. 2023Is GPT-4 a Good Data Analyst?cited by 70
  12. 2024A Survey on Employing Large Language Models for Text-to-SQL Taskscited by 67
38 more
  1. 2023ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thoughtcited by 65
  2. 2024Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?cited by 56
  3. 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?cited by 56
  4. 2022A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directionscited by 52
  5. 2023FACTUAL: A Benchmark for Faithful and Consistent Textual Scene Graph Parsingcited by 50
  6. 2022Recent Advances in Text-to-SQL: A Survey of What We Have and What We Expectcited by 47
  7. 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 45
  8. 2023RobuT: A Systematic Study of Table QA Robustness Against Human-Annotated Adversarial Perturbationscited by 43
  9. 2022Neural Approaches to Conversational Information Retrievalcited by 42
  10. 2023Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Modelscited by 39
  11. 2024TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decompositioncited by 39
  12. 2021NL-EDIT: Correcting semantic parse errors through natural language interactioncited by 33
  13. 2024A Survey of Table Reasoning with Large Language Modelscited by 29
  14. 2024StructLM: Towards Building Generalist Models for Structured Knowledge Groundingcited by 29
  15. 2022Towards Robustness of Text-to-SQL Models Against Natural and Realistic Adversarial Table Perturbationcited by 28
  16. 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
  17. 2022HIE-SQL: History Information Enhanced Network for Context-Dependent Text-to-SQL Semantic Parsingcited by 26
  18. 2021Improving Text-to-SQL with Schema Dependency Learningcited by 25
  19. 2022MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsingcited by 22
  20. 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 22
  21. 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
  22. 2022UniSAr: A Unified Structure-Aware Autoregressive Language Model for Text-to-SQLcited by 20
  23. 2022N-Best Hypotheses Reranking for Text-To-SQL Systemscited by 19
  24. 2022STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsingcited by 19
  25. 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanationscited by 19
  26. 2024PRACTIQ: A Practical Conversational Text-to-SQL dataset with Ambiguous and Unanswerable Queriescited by 19
  27. 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 19
  28. 2023Towards Knowledge-Intensive Text-to-SQL Semantic Parsing with Formulaic Knowledgecited by 18
  29. 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
  30. 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
  31. 2024From Natural Language to SQL: Review of LLM-based Text-to-SQL Systemscited by 16
  32. 2021Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsingcited by 15
  33. 2025MARS-SQL: A multi-agent reinforcement learning framework for Text-to-SQLcited by 15
  34. 2023UNITE: A Unified Benchmark for Text-to-SQL Evaluationcited by 14
  35. 2021Decoupled Dialogue Modeling and Semantic Parsing for Multi-Turn Text-to-SQLcited by 13
  36. 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Modelscited by 13
  37. 2024CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editionscited by 13
  38. 2022CQR-SQL: Conversational Question Reformulation Enhanced Context-Dependent Text-to-SQL Parserscited by 11

50 most cited of 144 All 144 (JSON)