Everything Happens for a Reason: Discovering the Purpose of Actions in Procedural Text
Not on the map. Why?
Abstract (arXiv)
Our goal is to better comprehend procedural text, e.g., a paragraph about photosynthesis, by not only predicting what happens, but why some actions need to happen before others. Our approach builds on a prior process comprehension framework for predicting actions' effects, to also identify subsequent steps that those effects enable. We present our new model (XPAD) that biases effect predictions towards those that (1) explain more of the actions in the paragraph and (2) are more plausible with respect to background knowledge. We also extend an existing benchmark dataset for procedural text comprehension, ProPara, by adding the new task of explaining actions by predicting their dependencies. We find that XPAD significantly outperforms prior systems on this task, while maintaining the performance on the original task in ProPara. The dataset is available at http://data.allenai.org/propara
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 12; 2023: 10; 2024: 5.
31 papers.
Sort:
By area:
- 2023Entity Tracking in Language Modelscited by 44
- 2024Code Pretraining Improves Entity Tracking Abilities of Language Modelscited by 31
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2021Time-Stamped Language Model: Teaching Language Models to Understand the Flow of Eventscited by 22
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processescited by 22
- 2021Factoring Statutory Reasoning as Language Understanding Challengescited by 20
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2022Reasoning about Actions over Visual and Linguistic Modalities: A Surveycited by 10
- 2024CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Planscited by 10
- 2023GLUECons: A Generic Benchmark for Learning Under Constraintscited by 9
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
19 more
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
- 2022LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-trainingcited by 5
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interactioncited by 5
- 2021Relational Gating for "What If" Reasoningcited by 4
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understandingcited by 4
- 2023The Role of Semantic Parsing in Understanding Procedural Textcited by 4
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformerscited by 3
- 2022Probing with Noise: Unpicking the Warp and Weft of Embeddingscited by 3
- 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Datasetcited by 3
- 2022Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehensioncited by 2
- 2023Choice-75: A Dataset on Decision Branching in Script Learningcited by 2
- 2024ActionCOMET: A Zero-shot Approach to Learn Image-specific Commonsense Concepts about Actionscited by 2
- 2022Procedural Text Understanding via Scene-Wise Evolutioncited by 1
- 2022Dense Paraphrasing for Textual Enrichmentcited by 1
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoningcited by 1
- 2023Explanation Graph Generation via Generative Pre-training over Synthetic Graphscited by 1
- 2024Consistent Joint Decision-Making with Heterogeneous Learning Modelscited by 1
- 2023CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Textcited by 0
- 2024ActionCOMET: A Zero-shot Approach to Learn Image-specific Commonsense Concepts about Actions17 Oct 2024
- 2024CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Plans22 Jun 2024
- 2024Code Pretraining Improves Entity Tracking Abilities of Language Models31 May 2024
- 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset5 Mar 2024
- 2024Consistent Joint Decision-Making with Heterogeneous Learning Models6 Feb 2024
- 2023CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Text22 Oct 2023
- 2023Choice-75: A Dataset on Decision Branching in Script Learning21 Sep 2023
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interaction16 Jun 2023
- 2023Explanation Graph Generation via Generative Pre-training over Synthetic Graphs1 Jun 2023
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Texts24 May 2023
- 2023Entity Tracking in Language Models3 May 2023
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoning28 Apr 2023
19 more
- 2023GLUECons: A Generic Benchmark for Learning Under Constraints16 Feb 2023
- 2023The Role of Semantic Parsing in Understanding Procedural Text14 Feb 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Models10 Nov 2022
- 2022Probing with Noise: Unpicking the Warp and Weft of Embeddings21 Oct 2022
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processes21 Oct 2022
- 2022Dense Paraphrasing for Textual Enrichment20 Oct 2022
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers20 Oct 2022
- 2022Reasoning about Actions over Visual and Linguistic Modalities: A Survey15 Jul 2022
- 2022Learning Action Conditions from Instructional Manuals for Instruction Understanding25 May 2022
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorial16 May 2022
- 2022Modeling Temporal-Modal Entity Graph for Procedural Multimodal Machine Comprehension6 Apr 2022
- 2022Procedural Text Understanding via Scene-Wise Evolution15 Mar 2022
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data14 Mar 2022
- 2022LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-training20 Jan 2022
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environments8 Jul 2021
- 2021Relational Gating for "What If" Reasoning27 May 2021
- 2021Factoring Statutory Reasoning as Language Understanding Challenges17 May 2021
- 2021Time-Stamped Language Model: Teaching Language Models to Understand the Flow of Events15 Apr 2021
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformerscited by 3
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoningcited by 1
- 2023Explanation Graph Generation via Generative Pre-training over Synthetic Graphscited by 1
- 2023Explanation Graph Generation via Generative Pre-training over Synthetic Graphs1 Jun 2023
- 2023Explainable Verbal Reasoner Plus (EVR+): A Natural Language Reasoning Framework that Supports Diverse Compositional Reasoning28 Apr 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Models10 Nov 2022
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers20 Oct 2022
- 2023Entity Tracking in Language Modelscited by 44
- 2024Code Pretraining Improves Entity Tracking Abilities of Language Modelscited by 31
- 2021Time-Stamped Language Model: Teaching Language Models to Understand the Flow of Eventscited by 22
- 2022Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Datacited by 22
- 2022Life is a Circus and We are the Clowns: Automatically Finding Analogies between Situations and Processescited by 22
- 2021Factoring Statutory Reasoning as Language Understanding Challengescited by 20
- 2021A Systematic Survey of Text Worlds as Embodied Natural Language Environmentscited by 17
- 2022Reasoning about Actions over Visual and Linguistic Modalities: A Surveycited by 10
- 2024CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Planscited by 10
- 2023GLUECons: A Generic Benchmark for Learning Under Constraintscited by 9
- 2022Reasoning about Procedures with Natural Language Processing: A Tutorialcited by 8
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Textscited by 8
12 most cited of 26 All 26 (JSON)
- 2024ActionCOMET: A Zero-shot Approach to Learn Image-specific Commonsense Concepts about Actions17 Oct 2024
- 2024CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Plans22 Jun 2024
- 2024Code Pretraining Improves Entity Tracking Abilities of Language Models31 May 2024
- 2024PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset5 Mar 2024
- 2024Consistent Joint Decision-Making with Heterogeneous Learning Models6 Feb 2024
- 2023CLMSM: A Multi-Task Learning Framework for Pre-training on Procedural Text22 Oct 2023
- 2023Choice-75: A Dataset on Decision Branching in Script Learning21 Sep 2023
- 2023Rewriting the Script: Adapting Text Instructions for Voice Interaction16 Jun 2023
- 2023OpenPI2.0: An Improved Dataset for Entity Tracking in Texts24 May 2023
- 2023Entity Tracking in Language Models3 May 2023
- 2023GLUECons: A Generic Benchmark for Learning Under Constraints16 Feb 2023
- 2023The Role of Semantic Parsing in Understanding Procedural Text14 Feb 2023
12 newest of 26 All 26 (JSON)