Reasoning about Procedures with Natural Language Processing: A Tutorial
Not on the map. Why?
Abstract (arXiv)
This tutorial provides a comprehensive and in-depth view of the research on procedures, primarily in Natural Language Processing. A procedure is a sequence of steps intended to achieve some goal. Understanding procedures in natural language has a long history, with recent breakthroughs made possible by advances in technology. First, we discuss established approaches to collect procedures, by human annotation or extraction from web resources. Then, we examine different angles from which procedures can be reasoned about, as well as ways to represent them. Finally, we enumerate scenarios where procedural knowledge can be applied to the real world.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 38 of its 91 references that are in the map. First posted on arXiv 16 May 2022.
Builds on
38 of 91 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 619
26 more
- 2018VirtualHome: Simulating Household Activities via Programscited by 415
- 2018WikiHow: A Large Scale Text Summarization Datasetcited by 204
- 2020WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarizationcited by 154
- 2019"Going on a vacation" takes longer than "Going for a walk": A Study of Temporal Commonsense Understandingcited by 123
- 2019WIQA: A dataset for "What if..." reasoning over procedural textcited by 71
- 2020Reasoning about Goals, Steps, and Temporal Ordering with WikiHowcited by 66
- 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
- 2017Simulating Action Dynamics with Neural Process Networkscited by 53
- 2019Joint Event and Temporal Relation Extraction with Shared Representations and Structured Predictioncited by 53
- 2019The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structurescited by 49
- 2021Visual Goal-Step Inference using wikiHowcited by 43
- 2020A Dataset for Tracking Entities in Open Domain Procedural Textcited by 37
- 2016Simpler Context-Dependent Logical Forms via Model Projectionscited by 33
- 2019Everything Happens for a Reason: Discovering the Purpose of Actions in Procedural Textcited by 31
- 2021Goal-Oriented Script Constructioncited by 30
- 2020Analogous Process Structure Induction for Sub-event Sequence Predictioncited by 26
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
- 2021Improving Paraphrase Detection with the Adversarial Paraphrasing Taskcited by 19
- 2020TicketTalk: Toward human-level performance with end-to-end, transaction-based dialog systemscited by 18
- 2021EventPlus: A Temporal Event Understanding Pipelinecited by 17
- 2019Learning Household Task Knowledge from WikiHow Descriptionscited by 15
- 2020A Recipe for Creating Multimodal Aligned Datasets for Sequential Taskscited by 15
- 2017Sequence to Sequence Learning for Event Predictioncited by 9
- 2020What-if I ask you to explain: Explaining the effects of perturbations in procedural textcited by 9
- 2016Integrating Know-How into the Linked Data Cloudcited by 4
- 2014A Semantic Web of Know-How: Linked Data for Community-Centric Taskscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 3; 2025: 0; 2026: 1.
8 papers.
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
- 2023Tailoring with Targeted Precision: Edit-Based Agents for Open-Domain Procedure Customizationcited by 5
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
- 2022Incorporating Task-specific Concept Knowledge into Script Learningcited by 3
- 2024Instructional Text Across Disciplines: A Survey of Representations, Downstream Tasks, and Open Challenges Toward Capable AI Agentscited by 1
- 2026Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Modelscited by 1
- 2024Structured Event Reasoning with Large Language Modelscited by 0
- 2026Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Models30 Jan 2026
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Models27 Nov 2024
- 2024Instructional Text Across Disciplines: A Survey of Representations, Downstream Tasks, and Open Challenges Toward Capable AI Agents24 Oct 2024
- 2024Structured Event Reasoning with Large Language Models28 Aug 2024
- 2023Tailoring with Targeted Precision: Edit-Based Agents for Open-Domain Procedure Customization16 Nov 2023
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Texts24 May 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022Incorporating Task-specific Concept Knowledge into Script Learning31 Aug 2022