mlsanityData to 7 Oct 2026

Knowing-how & Knowing-that: A New Task for Machine Comprehension of User Manuals

arXiv 2306.04187 ↗First posted 7 Jun 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The machine reading comprehension (MRC) of user manuals has huge potential in customer service. However, current methods have trouble answering complex questions. Therefore, we introduce the Knowing-how & Knowing-that task that requires the model to answer factoid-style, procedure-style, and inconsistent questions about user manuals. We resolve this task by jointly representing the steps and facts in a graph TARA, which supports a unified inference of various questions. Towards a systematical benchmarking study, we design a heuristic method to automatically parse user manuals into TARAs and build an annotated dataset to test the model's ability in answering real-world questions. Empirical results demonstrate that representing user manuals as TARAs is a desired solution for the MRC of user manuals. An in-depth investigation of TARA further sheds light on the issues and broader impacts of future representations of user manuals. We hope our work can move the MRC of user manuals to a more complex and realistic stage.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 7 Jun 2023.

Builds on

18 of 49 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  3. 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
  4. 2019Unsupervised Question Answering by Cloze Translationcited by 59
  5. 2017Simulating Action Dynamics with Neural Process Networkscited by 53
  6. 2019The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structurescited by 48
  7. 2018Simpler but More Accurate Semantic Dependency Parsingcited by 46
  8. 2020A Dataset for Tracking Entities in Open Domain Procedural Textcited by 37
  9. 2020N-LTP: An Open-source Neural Language Technology Platform for Chinesecited by 29
  10. 2022PERT: Pre-training BERT with Permuted Language Modelcited by 23
  11. 2019Second-Order Semantic Dependency Parsing with End-to-End Neural Networkscited by 21
  12. 2018Adaptations of ROUGE and BLEU to Better Evaluate Machine Reading Comprehension Taskcited by 20
6 more
  1. 2019Establishing Strong Baselines for the New Decade: Sequence Tagging, Syntactic and Semantic Parsing with BERTcited by 19
  2. 2020Knowledge-Aware Procedural Text Understanding with Multi-Stage Trainingcited by 17
  3. 2020Procedural Reading Comprehension with Attribute-Aware Context Flowcited by 16
  4. 2020Annotating and Extracting Synthesis Process of All-Solid-State Batteries from Scientific Literaturecited by 15
  5. 2022Unsupervised Question Answering via Answer Diversifyingcited by 4
  6. 2021Tracking entities in technical procedures -- a new dataset and baselinescited by 2

Built on by

Not cited yet.