Learning Household Task Knowledge from WikiHow Descriptions
Not on the map. Why?
Abstract (arXiv)
Commonsense procedural knowledge is important for AI agents and robots that operate in a human environment. While previous attempts at constructing procedural knowledge are mostly rule- and template-based, recent advances in deep learning provide the possibility of acquiring such knowledge directly from natural language sources. As a first step in this direction, we propose a model to learn embeddings for tasks, as well as the individual steps that need to be taken to solve them, based on WikiHow articles. We learn these embeddings such that they are predictive of both step relevance and step ordering. We also experiment with the use of integer programming for inferring consistent global step orderings from noisy pairwise predictions.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 3; 2024: 1; 2025: 1; 2026: 1.
15 papers.
Sort:
By area:
- 2021Visual Goal-Step Inference using wikiHowcited by 42
- 2021Goal-Oriented Script Constructioncited by 30
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manualscited by 18
- 2022Multimedia Generative Script Learning for Task Planningcited by 12
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
- 2023Generating Illustrated Instructionscited by 7
- 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkishcited by 5
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
- 2022Claim Optimization in Computational Argumentationcited by 3
3 more
- 2025InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learningcited by 2
- 2026Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Modelscited by 1
- 2023Towards Flow Graph Prediction of Open-Domain Procedural Textscited by 0
- 2026Procedural Knowledge Extraction from Industrial Troubleshooting Guides Using Vision Language Models30 Jan 2026
- 2025InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learning20 Dec 2025
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Models27 Nov 2024
- 2023Generating Illustrated Instructions7 Dec 2023
- 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish13 Sep 2023
- 2023Towards Flow Graph Prediction of Open-Domain Procedural Texts31 May 2023
- 2022Claim Optimization in Computational Argumentation17 Dec 2022
- 2022Multimedia Generative Script Learning for Task Planning25 Aug 2022
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understanding25 May 2022
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorial16 May 2022
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data14 Mar 2022
- 2021What do Large Language Models Learn about Scripts?27 Dec 2021
3 more
- 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals16 Oct 2021
- 2021Goal-Oriented Script Construction28 Jul 2021
- 2021Visual Goal-Step Inference using wikiHow12 Apr 2021
- 2021Visual Goal-Step Inference using wikiHowcited by 42
- 2021Goal-Oriented Script Constructioncited by 30
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manualscited by 18
- 2022Multimedia Generative Script Learning for Task Planningcited by 12
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
- 2023Generating Illustrated Instructionscited by 7
- 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkishcited by 5
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Modelscited by 4
- 2022Claim Optimization in Computational Argumentationcited by 3
12 most cited of 14 All 14 (JSON)
- 2025InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learning20 Dec 2025
- 2024Human Evaluation of Procedural Knowledge Graph Extraction from Text with Large Language Models27 Nov 2024
- 2023Generating Illustrated Instructions7 Dec 2023
- 2023Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish13 Sep 2023
- 2023Towards Flow Graph Prediction of Open-Domain Procedural Texts31 May 2023
- 2022Claim Optimization in Computational Argumentation17 Dec 2022
- 2022Multimedia Generative Script Learning for Task Planning25 Aug 2022
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understanding25 May 2022
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorial16 May 2022
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data14 Mar 2022
- 2021What do Large Language Models Learn about Scripts?27 Dec 2021
- 2021Understanding Multimodal Procedural Knowledge by Sequencing Multimodal Instructional Manuals16 Oct 2021
12 newest of 14 All 14 (JSON)