mlsanityData to 7 Oct 2026

Reasoning about Goals, Steps, and Temporal Ordering with WikiHow

arXiv 2009.07690 ↗First posted 16 Sep 2020cs.CLcited by 66

Not on the map. Why?

Abstract (arXiv)

We propose a suite of reasoning tasks on two types of relations between procedural events: goal-step relations ("learn poses" is a step in the larger goal of "doing yoga") and step-step temporal relations ("buy a yoga mat" typically precedes "learn poses"). We introduce a dataset targeting these two relations based on wikiHow, a website of instructional how-to articles. Our human-validated test set serves as a reliable benchmark for commonsense inference, with a gap of about 10% to 20% between the performance of state-of-the-art transformer models and human performance. Our automatically-generated training set allows models to effectively transfer to out-of-domain tasks requiring knowledge of procedural events, with greatly improved performances on SWAG, Snips, and the Story Cloze Test in zero- and few-shot settings.

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Sep 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 15; 2023: 24; 2024: 14; 2025: 4; 2026: 1.

66 papers.

Sort:

By area:

  1. 2023Can Large Language Models Infer Causation from Correlation?cited by 142
  2. 2023CLadder: Assessing Causal Reasoning in Language Modelscited by 102
  3. 2023Natural Language Reasoning, A Surveycited by 61
  4. 2023Procedure-Aware Pretraining for Instructional Video Understandingcited by 48
  5. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  6. 2021Visual Goal-Step Inference using wikiHowcited by 42
  7. 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
  8. 2021The Future is not One-dimensional: Complex Event Schema Induction by Graph Modeling for Event Predictioncited by 39
  9. 2021Goal-Oriented Script Constructioncited by 30
  10. 2022Neuro-Symbolic Procedural Planning with Commonsense Promptingcited by 28
  11. 2024SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videoscited by 24
  12. 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
38 more
  1. 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
  2. 2021What do Large Language Models Learn about Scripts?cited by 19
  3. 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verificationcited by 19
  4. 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manualscited by 18
  5. 2024UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs' Memorizationcited by 17
  6. 2021Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrievalcited by 13
  7. 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Modelscited by 13
  8. 2022Multimedia Generative Script Learning for Task Planningcited by 12
  9. 2023TaskLAMA: Probing the Complex Task Understanding of Language Modelscited by 12
  10. 2022Coalescing Global and Local Information for Procedural Text Understandingcited by 10
  11. 2022SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controllercited by 10
  12. 2023An Overview Of Temporal Commonsense Reasoning and Acquisitioncited by 10
  13. 2024CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Planscited by 10
  14. 2024CELLO: Causal Evaluation of Large Vision-Language Modelscited by 10
  15. 2021PaCo: Preconditions Attributed to Commonsense Knowledgecited by 9
  16. 2022Zero-Shot On-the-Fly Event Schema Inductioncited by 9
  17. 2022What Makes the Story Forward? Inferring Commonsense Explanations as Prompts for Future Event Generationcited by 8
  18. 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
  19. 2023NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processingcited by 8
  20. 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
  21. 2023Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generationcited by 7
  22. 2023Improved Instruction Ordering in Recipe-Grounded Conversationcited by 7
  23. 2023Generating Illustrated Instructionscited by 7
  24. 2023Exploring the Curious Case of Code Promptscited by 6
  25. 2022DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discriminationcited by 5
  26. 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
  27. 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkishcited by 5
  28. 2022Probing Script Knowledge from Pre-Trained Modelscited by 4
  29. 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
  30. 2022Schema-Guided Event Graph Completioncited by 4
  31. 2023Non-Sequential Graph Script Induction via Multimedia Groundingcited by 4
  32. 2024Open Grounded Planning: Challenges and Benchmark Constructioncited by 4
  33. 2024WorldAPIs: The World Is Worth How Many APIs? A Thought Experimentcited by 4
  34. 2024PAGED: A Benchmark for Procedural Graphs Extraction from Documentscited by 4
  35. 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
  36. 2022Incorporating Task-specific Concept Knowledge into Script Learningcited by 3
  37. 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Datasetcited by 3
  38. 2022Semantically-informed Hierarchical Event Modelingcited by 2

50 most cited of 66 All 66 (JSON)