mlsanityData to 7 Oct 2026

Schema-Aware Multi-Task Learning for Complex Text-to-SQL

arXiv 2403.09706 ↗First posted 9 Mar 2024cs.CL cs.AI cs.DBcited by 1

Not on the map. Why?

Abstract (arXiv)

Conventional text-to-SQL parsers are not good at synthesizing complex SQL queries that involve multiple tables or columns, due to the challenges inherent in identifying the correct schema items and performing accurate alignment between question and schema items. To address the above issue, we present a schema-aware multi-task learning framework (named MTSQL) for complicated SQL queries. Specifically, we design a schema linking discriminator module to distinguish the valid question-schema linkings, which explicitly instructs the encoder by distinctive linking relations to enhance the alignment quality. On the decoder side, we define 6-type relationships to describe the connections between tables and columns (e.g., WHERE_TC), and introduce an operator-centric triple extractor to recognize those associated schema items with the predefined relationship. Also, we establish a rule set of grammar constraints via the predicted triples to filter the proper SQL operators and schema items during the SQL generation. On Spider, a cross-domain challenging text-to-SQL benchmark, experimental results indicate that MTSQL is more effective than baselines, especially in extremely hard scenarios. Moreover, further analyses verify that our approach leads to promising improvements for complicated SQL queries.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 27 references that are in the map. First posted on arXiv 9 Mar 2024.

Builds on

21 of 27 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  5. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  6. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  7. 2018Self-Attention with Relative Position Representationscited by 1,112
  8. 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
  9. 2017Non-Autoregressive Neural Machine Translationcited by 457
  10. 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
  11. 2021PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Modelscited by 402
  12. 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
9 more
  1. 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
  2. 2018Improving Text-to-SQL Evaluation Methodologycited by 133
  3. 2020Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsingcited by 133
  4. 2020SmBoP: Semi-autoregressive Bottom-up Semantic Parsingcited by 97
  5. 2020Grounded Adaptation for Zero-shot Executable Semantic Parsingcited by 76
  6. 2021Natural SQL: Making SQL Easier to Infer from Natural Language Specificationscited by 66
  7. 2020Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Trainingcited by 65
  8. 2020Joint Entity and Relation Extraction with Set Prediction Networkscited by 54
  9. 2021SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoisingcited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.