mlsanityData to 7 Oct 2026

Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data

arXiv 2203.07264 ↗First posted 14 Mar 2022cs.CL cs.AIcited by 22

Not on the map. Why?

Abstract (arXiv)

Procedures are inherently hierarchical. To "make videos", one may need to "purchase a camera", which in turn may require one to "set a budget". While such hierarchical knowledge is critical for reasoning about complex procedures, most existing work has treated procedures as shallow structures without modeling the parent-child relation. In this work, we attempt to construct an open-domain hierarchical knowledge-base (KB) of procedures based on wikiHow, a website containing more than 110k instructional articles, each documenting the steps to carry out a complex procedure. To this end, we develop a simple and efficient method that links steps (e.g., "purchase a camera") in an article to other articles with similar goals (e.g., "how to choose a camera"), recursively constructing the KB. Our method significantly outperforms several strong baselines according to automatic evaluation, human judgment, and application to downstream tasks such as instructional video retrieval. A demo with partial data can be found at https://wikihow-hierarchy.github.io. The code and the data are at https://github.com/shuyanzhou/wikihow_hierarchy.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 28 of its 62 references that are in the map. First posted on arXiv 14 Mar 2022.

Builds on

28 of 62 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2017Billion-scale similarity search with GPUscited by 2,477
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  10. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  11. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
  12. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
16 more
  1. 2015Unsupervised Learning from Narrated Instruction Videoscited by 116
  2. 2019Scalable Zero-shot Entity Linking with Dense Entity Retrievalcited by 85
  3. 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
  4. 2019WIQA: A dataset for "What if..." reasoning over procedural textcited by 71
  5. 2020Reasoning about Goals, Steps, and Temporal Ordering with WikiHowcited by 66
  6. 2021Visual Goal-Step Inference using wikiHowcited by 42
  7. 2019Everything Happens for a Reason: Discovering the Purpose of Actions in Procedural Textcited by 31
  8. 2021Goal-Oriented Script Constructioncited by 30
  9. 2020Analogous Process Structure Induction for Sub-event Sequence Predictioncited by 26
  10. 2019Simple and Effective Paraphrastic Similarity from Parallel Translationscited by 25
  11. 2020Intent Detection with WikiHowcited by 19
  12. 2021Paraphrastic Representations at Scalecited by 19
  13. 2019Learning Household Task Knowledge from WikiHow Descriptionscited by 15
  14. 2021Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrievalcited by 13
  15. 2020What-if I ask you to explain: Explaining the effects of perturbations in procedural textcited by 9
  16. 2016Integrating Know-How into the Linked Data Cloudcited by 4

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 12; 2024: 4; 2025: 3.

22 papers.

Sort:

By area:

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
  3. 2023Procedure-Aware Pretraining for Instructional Video Understandingcited by 48
  4. 2024Synatra: Turning Indirect Knowledge into Direct Demonstrations for Digital Agents at Scalecited by 43
  5. 2023Open-Domain Hierarchical Event Schema Induction by Incremental Prompting and Verificationcited by 19
  6. 2024DAG-Plan: Generating Directed Acyclic Dependency Graphs for Dual-Arm Cooperative Planningcited by 14
  7. 2022Multimedia Generative Script Learning for Task Planningcited by 12
  8. 2023TaskLAMA: Probing the Complex Task Understanding of Language Modelscited by 12
  9. 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
  10. 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
  11. 2023Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generationcited by 7
  12. 2023Generating Illustrated Instructionscited by 7
10 more
  1. 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
  2. 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkishcited by 5
  3. 2022Schema-Guided Event Graph Completioncited by 4
  4. 2024WorldAPIs: The World Is Worth How Many APIs? A Thought Experimentcited by 4
  5. 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Datasetcited by 3
  6. 2025Universal Retrieval for Multimodal Trajectory Modelingcited by 3
  7. 2023Large Language Models as Sous Chefs: Revising Recipes with GPT-3cited by 2
  8. 2023Choice-75: A Dataset on Decision Branching in Script Learningcited by 2
  9. 2023Towards Flow Graph Prediction of Open-Domain Procedural Textscited by 0
  10. 2025PSSD: Making Large Language Models Self-denial via Human Psyche Structurecited by 0