Interscript: A dataset for interactive learning of scripts through error feedback
Not on the map. Why?
Abstract (arXiv)
How can an end-user provide feedback if a deployed structured prediction model generates inconsistent output, ignoring the structural complexity of human language? This is an emerging topic with recent progress in synthetic or constrained settings, and the next big leap would require testing and tuning models in real-world settings. We present a new dataset, Interscript, containing user feedback on a deployed model that generates complex everyday tasks. Interscript contains 8,466 data points -- the input is a possibly erroneous script and a user feedback, and the output is a modified script. We posit two use-cases of ours that might significantly advance the state-of-the-art in interactive learning. The dataset is available at: https://github.com/allenai/interscript.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 14 of its 30 references that are in the map. First posted on arXiv 15 Dec 2021.
Builds on
14 of 30 references.
References · 14
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2020Transformers as Soft Reasoners over Languagecited by 270
- 2021TEACh: Task-driven Embodied Agents that Chatcited by 197
- 2020Speak to your Parser: Interactive Text-to-SQL with Natural Language Feedbackcited by 44
- 2016Learning Language Games through Interactioncited by 43
- 2019Active Learning for Graph Neural Networks via Node Feature Propagationcited by 37
- 2021NL-EDIT: Correcting semantic parse errors through natural language interactioncited by 33
- 2020Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledgecited by 24
- 2021proScript: Partially Ordered Scripts Generation via Pre-trained Language Modelscited by 21
2 more
- 2020Active Imitation Learning with Noisy Guidancecited by 15
- 2019Improving Natural Language Interaction with Robots Using Advicecited by 9
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 2; 2025: 1; 2026: 1.
9 papers.
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinementcited by 247
- 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputscited by 105
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoningcited by 40
- 2024Large Language Models Can Self-Correct with Key Condition Verificationcited by 39
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Toolscited by 29
- 2023SCREWS: A Modular Framework for Reasoning with Revisionscited by 16
- 2022InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictionscited by 7
- 2026Beyond Output Critique: Self-Correction via Task Distillationcited by 0
- 2026Beyond Output Critique: Self-Correction via Task Distillation31 Jan 2026
- 2025A Survey of Test-Time Compute: From Intuitive Inference to Deliberate Reasoning5 Jan 2025
- 2024Large Language Models Can Self-Correct with Key Condition Verification23 May 2024
- 2024OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement22 Feb 2024
- 2023SCREWS: A Modular Framework for Reasoning with Revisions20 Sep 2023
- 2023CHATREPORT: Democratizing Sustainability Disclosure Analysis through LLM-based Tools28 Jul 2023
- 2023RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs15 May 2023
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar 2023
- 2022InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions14 Oct 2022