Tracking entities in technical procedures -- a new dataset and baselines
Not on the map. Why?
Abstract (arXiv)
We introduce TechTrack, a new dataset for tracking entities in technical procedures. The dataset, prepared by annotating open domain articles from WikiHow, consists of 1351 procedures, e.g., "How to connect a printer", identifies more than 1200 unique entities with an average of 4.7 entities per procedure. We evaluate the performance of state-of-the-art models on the entity-tracking task and find that they are well below the human annotation performance. We describe how TechTrack can be used to take forward the research on understanding procedures from temporal texts.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 8 of its 9 references that are in the map. First posted on arXiv 15 Apr 2021.
Builds on
8 of 9 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
- 2018Tracking State Changes in Procedural Text: A Challenge Dataset and Models for Process Paragraph Comprehensioncited by 62
- 2017Simulating Action Dynamics with Neural Process Networkscited by 53
- 2016Simpler Context-Dependent Logical Forms via Model Projectionscited by 33
- 2018Reasoning about Actions and State Changes by Injecting Commonsense Knowledgecited by 29
- 2018Building Dynamic Knowledge Graphs from Text using Machine Reading Comprehensioncited by 17
- 2020Procedural Reading Comprehension with Attribute-Aware Context Flowcited by 16
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.