NL-EDIT: Correcting semantic parse errors through natural language interaction
Not on the map. Why?
Abstract (arXiv)
We study semantic parsing in an interactive setting in which users correct errors with natural language feedback. We present NL-EDIT, a model for interpreting natural language feedback in the interaction context to generate a sequence of edits that can be applied to the initial parse to correct its errors. We show that NL-EDIT can boost the accuracy of existing text-to-SQL parsers by up to 20% with only one turn of correction. We analyze the limitations of the model and discuss directions for improvement and evaluation. The code and datasets used in this paper are publicly available at http://aka.ms/NLEdit.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 26 Mar 2021.
Builds on
29 of 44 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2018Self-Attention with Relative Position Representationscited by 1,112
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 679
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
- 2019RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parserscited by 420
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
- 2019Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representationcited by 210
- 2019CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databasescited by 180
17 more
- 2020GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsingcited by 171
- 2019SParC: Cross-Domain Semantic Parsing in Contextcited by 141
- 2020Task-Oriented Dialogue as Dataflow Synthesiscited by 122
- 2019Encode, Tag, Realize: High-Precision Text Editingcited by 99
- 2017Learning a Neural Semantic Parser from User Feedbackcited by 98
- 2019Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questionscited by 80
- 2018SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Taskcited by 74
- 2020RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databasescited by 63
- 2020Seq2Edits: Sequence Transduction Using Span-level Edit Operationscited by 58
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2019Model-based Interactive Semantic Parsing: A Unified Framework and A Text-to-SQL Case Studycited by 40
- 2020Learning to Update Natural Language Comments Based on Code Changescited by 30
- 2020AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training Datacited by 29
- 2018Learning to Map Context-Dependent Sentences to Executable Formal Queriescited by 23
- 2020DuoRAT: Towards Simpler Text-to-SQL Modelscited by 17
- 2019Encoding Database Schemas with Relation-Aware Self-Attention for Text-to-SQL Parserscited by 4
- 2018Building a Neural Semantic Parser from a Domain Ontologycited by 2
Built on by
Citing papers per year: 2021: 6; 2022: 3; 2023: 14; 2024: 4; 2025: 4; 2026: 2.
33 papers.
Sort:
By area:
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 203
- 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
- 2021Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Datacited by 43
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
- 2021Learning to Repair: Repairing model output errors after deployment using a dynamic memory of feedbackcited by 35
- 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 31
- 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
21 more
- 2022When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labelscited by 20
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanationscited by 19
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsingcited by 19
- 2023SCREWS: A Modular Framework for Reasoning with Revisionscited by 16
- 2024THOUGHTSCULPT: Reasoning with Intermediate Revision and Searchcited by 11
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
- 2021Towards Transparent Interactive Semantic Parsing via Step-by-Step Correctioncited by 9
- 2021Interscript: A dataset for interactive learning of scripts through error feedbackcited by 9
- 2023Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answeringcited by 6
- 2021Improving Neural Model Performance through Natural Language Feedback on Their Explanationscited by 5
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examplescited by 5
- 2023Can LLMs Patch Security Issues?cited by 3
- 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Modelscited by 3
- 2022Memory-assisted prompt editing to improve GPT-3 after deploymentcited by 2
- 2023Correcting Semantic Parses with Natural Language through Dynamic Schema Encodingcited by 2
- 2023What if you said that differently?: How Explanation Formats Affect Human Feedback Efficacy and User Perceptioncited by 2
- 2022Text Editing as Imitation Gamecited by 1
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
- 2025CLEAR: Contrasting Textual Feedback with Experts and Amateurs for Reasoningcited by 0
- 2026Beyond Output Critique: Self-Correction via Task Distillationcited by 0
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revisioncited by 0
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revision8 Apr 2026
- 2026Beyond Output Critique: Self-Correction via Task Distillation31 Jan 2026
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2025CLEAR: Contrasting Textual Feedback with Experts and Amateurs for Reasoning24 Mar 2025
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoning5 Jan 2025
- 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Models3 Jan 2025
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanations10 Sep 2024
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examples24 Apr 2024
- 2024THOUGHTSCULPT: Reasoning with Intermediate Revision and Search9 Apr 2024
- 2024CodeAgent: Autonomous Communicative Agents for Code Review3 Feb 2024
- 2023What if you said that differently?: How Explanation Formats Affect Human Feedback Efficacy and User Perception16 Nov 2023
- 2023Can LLMs Patch Security Issues?13 Nov 2023
21 more
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguity20 Oct 2023
- 2023SCREWS: A Modular Framework for Reasoning with Revisions20 Sep 2023
- 2023Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering11 Jun 2023
- 2023Correcting Semantic Parses with Natural Language through Dynamic Schema Encoding31 May 2023
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQL23 May 2023
- 2023Text-to-SQL Error Correction with Language Models of Code22 May 2023
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing14 May 2023
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations12 May 2023
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation1 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr 2023
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar 2023
- 2022When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels28 Oct 2022
- 2022Text Editing as Imitation Game21 Oct 2022
- 2022Memory-assisted prompt editing to improve GPT-3 after deployment16 Jan 2022
- 2021Learning to Repair: Repairing model output errors after deployment using a dynamic memory of feedback16 Dec 2021
- 2021Interscript: A dataset for interactive learning of scripts through error feedback15 Dec 2021
- 2021Towards Transparent Interactive Semantic Parsing via Step-by-Step Correction15 Oct 2021
- 2021Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data9 Jun 2021
- 2021Constrained Language Models Yield Few-Shot Semantic Parsers18 Apr 2021
- 2021Improving Neural Model Performance through Natural Language Feedback on Their Explanations18 Apr 2021
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023REFINER: Reasoning Feedback on Intermediate Representationscited by 203
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQLcited by 69
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
- 2023SCREWS: A Modular Framework for Reasoning with Revisionscited by 16
- 2024THOUGHTSCULPT: Reasoning with Intermediate Revision and Searchcited by 11
- 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Modelscited by 3
- 2025CLEAR: Contrasting Textual Feedback with Experts and Amateurs for Reasoningcited by 0
- 2025CLEAR: Contrasting Textual Feedback with Experts and Amateurs for Reasoning24 Mar 2025
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoning5 Jan 2025
- 2025Recursive Decomposition of Logical Thoughts: Framework for Superior Reasoning and Knowledge Propagation in Large Language Models3 Jan 2025
- 2024THOUGHTSCULPT: Reasoning with Intermediate Revision and Search9 Apr 2024
- 2023SCREWS: A Modular Framework for Reasoning with Revisions20 Sep 2023
- 2023Exploring Chain-of-Thought Style Prompting for Text-to-SQL23 May 2023
- 2023REFINER: Reasoning Feedback on Intermediate Representations4 Apr 2023
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar 2023
- 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examplescited by 5
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQLcited by 1
- 2025GBV-SQL: Guided Generation and SQL2Text Back-Translation Validation for Multi-Agent Text2SQL16 Sep 2025
- 2024A Human-Computer Collaborative Tool for Training a Single Large Language Model Agent into a Network through Few Examples24 Apr 2024
- 2024CodeAgent: Autonomous Communicative Agents for Code Review3 Feb 2024
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
- 2022When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labelscited by 20
- 2021Improving Neural Model Performance through Natural Language Feedback on Their Explanationscited by 5
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation1 May 2023
- 2022When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels28 Oct 2022
- 2021Improving Neural Model Performance through Natural Language Feedback on Their Explanations18 Apr 2021
- 2021Constrained Language Models Yield Few-Shot Semantic Parserscited by 162
- 2021Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Datacited by 43
- 2021Learning to Repair: Repairing model output errors after deployment using a dynamic memory of feedbackcited by 35
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguitycited by 31
- 2023Text-to-SQL Error Correction with Language Models of Codecited by 21
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanationscited by 19
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsingcited by 19
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanationscited by 10
- 2021Towards Transparent Interactive Semantic Parsing via Step-by-Step Correctioncited by 9
- 2021Interscript: A dataset for interactive learning of scripts through error feedbackcited by 9
- 2023Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answeringcited by 6
12 most cited of 19 All 19 (JSON)
- 2026Fine-grained Approaches for Confidence Calibration of LLMs in Automated Code Revision8 Apr 2026
- 2026Beyond Output Critique: Self-Correction via Task Distillation31 Jan 2026
- 2024SQLucid: Grounding Natural Language Database Queries with Interactive Explanations10 Sep 2024
- 2023What if you said that differently?: How Explanation Formats Affect Human Feedback Efficacy and User Perception16 Nov 2023
- 2023Can LLMs Patch Security Issues?13 Nov 2023
- 2023Benchmarking and Improving Text-to-SQL Generation under Ambiguity20 Oct 2023
- 2023Multi-Source Test-Time Adaptation as Dueling Bandits for Extractive Question Answering11 Jun 2023
- 2023Correcting Semantic Parses with Natural Language through Dynamic Schema Encoding31 May 2023
- 2023Text-to-SQL Error Correction with Language Models of Code22 May 2023
- 2023Learning to Simulate Natural Language Feedback for Interactive Semantic Parsing14 May 2023
- 2023Interactive Text-to-SQL Generation via Editable Step-by-Step Explanations12 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
12 newest of 19 All 19 (JSON)