Guided Generation of Cause and Effect
Not on the map. Why?
Abstract (arXiv)
We present a conditional text generation framework that posits sentential expressions of possible causes and effects. This framework depends on two novel resources we develop in the course of this work: a very large-scale collection of English sentences expressing causal patterns CausalBank; and a refinement over previous work on constructing large lexical causal knowledge graphs Cause Effect Graph. Further, we extend prior work in lexically-constrained decoding to support disjunctive positive constraints. Human assessment confirms that our approach gives high-quality and diverse outputs. Finally, we use CausalBank to perform continued training of an encoder supporting a recent state-of-the-art model for causal reasoning, leading to a 3-point improvement on the COPA challenge set, with no change in model architecture.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 20 of its 80 references that are in the map. First posted on arXiv 21 Jul 2021.
Builds on
20 of 80 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2017Convolutional Sequence to Sequence Learningcited by 550
- 2018Hypothesis Only Baselines in Natural Language Inferencecited by 291
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
- 2018Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data Taskscited by 214
- 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
- 2019ASER: A Large-scale Eventuality Knowledge Graphcited by 89
- 2018Event2Mind: Commonsense Inference on Events, Intents, and Reactionscited by 82
- 2019Target-Guided Open-Domain Conversationcited by 66
8 more
- 2018Story Ending Generation with Incremental Encoding and Commonsense Knowledgecited by 60
- 2019Joint Reasoning for Temporal and Causal Relationscited by 60
- 2019ParaBank: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-constrained Neural Machine Translationcited by 38
- 2018Constructing Narrative Event Evolutionary Graph for Script Event Predictioncited by 33
- 2016Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Surveycited by 16
- 2017Sockeye: A Toolkit for Neural Machine Translationcited by 15
- 2019Story Ending Prediction by Transferable BERTcited by 10
- 2019Learning to Rank for Plausible Plausibilitycited by 9
Built on by
Citing papers per year: 2021: 2; 2022: 8; 2023: 11; 2024: 9; 2025: 1; 2026: 2.
33 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
- 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoningcited by 47
- 2024Causal Inference with Large Language Model: A Surveycited by 31
- 2022SciNLI: A Corpus for Natural Language Inference on Scientific Textcited by 27
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Modelscited by 24
- 2022Towards Fine-grained Causal Reasoning and QAcited by 13
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Modelscited by 13
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 9
- 2023Evaluation of Induced Expert Knowledge in Causal Structure Learning by NOTEARScited by 8
21 more
- 2023NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillationcited by 8
- 2021Knowledge-Augmented Language Models for Cause-Effect Relation Classificationcited by 7
- 2022CARE: Causality Reasoning for Empathetic Responses by Conditional Graph Generationcited by 7
- 2023A Survey of Methods, Challenges and Perspectives in Causalitycited by 6
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsingcited by 6
- 2022DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discriminationcited by 5
- 2023Causal Question Answering with Reinforcement Learningcited by 5
- 2023InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Modelscited by 5
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
- 2024Narrating Causal Graphs with Large Language Modelscited by 4
- 2024A Data-Driven Guided Decoding Mechanism for Diagnostic Captioningcited by 4
- 2023i-Align: an interpretable knowledge graph alignment modelcited by 2
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysiscited by 2
- 2025Beyond LLMs: A Linguistic Approach to Causal Graph Generation from Narrative Textscited by 2
- 2022ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networkscited by 1
- 2024Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processingcited by 1
- 2024Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 using Weighted Finite State Automatacited by 1
- 2024Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AIcited by 1
- 2026ClimateCause: Complex and Implicit Causal Structures in Climate Reportscited by 1
- 2023Cascaded Beam Search: Plug-and-Play Terminology-Forcing For Neural Machine Translationcited by 0
- 2026Implicit Causal Graph Construction in Text via Chain Discoverycited by 0
- 2026Implicit Causal Graph Construction in Text via Chain Discovery20 Apr 2026
- 2026ClimateCause: Complex and Implicit Causal Structures in Climate Reports16 Apr 2026
- 2025Beyond LLMs: A Linguistic Approach to Causal Graph Generation from Narrative Texts10 Apr 2025
- 2024Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AI17 Sep 2024
- 2024Causal Inference with Large Language Model: A Survey15 Sep 2024
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models10 Jul 2024
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning27 Jun 2024
- 2024A Data-Driven Guided Decoding Mechanism for Diagnostic Captioning20 Jun 2024
- 2024Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 using Weighted Finite State Automata10 Apr 2024
- 2024Narrating Causal Graphs with Large Language Models11 Mar 2024
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis22 Feb 2024
- 2024Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processing22 Jan 2024
21 more
- 2023InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Models21 Dec 2023
- 2023NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation10 Dec 2023
- 2023Causal Question Answering with Reinforcement Learning5 Nov 2023
- 2023i-Align: an interpretable knowledge graph alignment model26 Aug 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Prompting10 Jun 2023
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsing24 May 2023
- 2023Cascaded Beam Search: Plug-and-Play Terminology-Forcing For Neural Machine Translation23 May 2023
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation12 May 2023
- 2023A Survey of Methods, Challenges and Perspectives in Causality1 Feb 2023
- 2023Evaluation of Induced Expert Knowledge in Causal Structure Learning by NOTEARS4 Jan 2023
- 2022ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks16 Dec 2022
- 2022CARE: Causality Reasoning for Empathetic Responses by Conditional Graph Generation1 Nov 2022
- 2022Knowledge-in-Context: Towards Knowledgeable Semi-Parametric Language Models28 Oct 2022
- 2022DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discrimination21 Aug 2022
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Mining19 Aug 2022
- 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoning12 May 2022
- 2022Towards Fine-grained Causal Reasoning and QA15 Apr 2022
- 2022SciNLI: A Corpus for Natural Language Inference on Scientific Text13 Mar 2022
- 2021Knowledge-Augmented Language Models for Cause-Effect Relation Classification16 Dec 2021
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Models14 Oct 2021
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Promptingcited by 77
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluationcited by 69
- 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoningcited by 47
- 2024Causal Inference with Large Language Model: A Surveycited by 31
- 2022Towards Fine-grained Causal Reasoning and QAcited by 13
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Modelscited by 13
- 2024Causal Inference with Large Language Model: A Survey15 Sep 2024
- 2024A Critical Review of Causal Reasoning Benchmarks for Large Language Models10 Jul 2024
- 2023Boosting Language Models Reasoning with Chain-of-Knowledge Prompting10 Jun 2023
- 2023Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation12 May 2023
- 2022e-CARE: a New Dataset for Exploring Explainable Causal Reasoning12 May 2022
- 2022Towards Fine-grained Causal Reasoning and QA15 Apr 2022
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2022SciNLI: A Corpus for Natural Language Inference on Scientific Textcited by 27
- 2022UniCausal: Unified Benchmark and Repository for Causal Text Miningcited by 9
- 2023Evaluation of Induced Expert Knowledge in Causal Structure Learning by NOTEARScited by 8
- 2023NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillationcited by 8
- 2021Knowledge-Augmented Language Models for Cause-Effect Relation Classificationcited by 7
- 2022CARE: Causality Reasoning for Empathetic Responses by Conditional Graph Generationcited by 7
- 2023A Survey of Methods, Challenges and Perspectives in Causalitycited by 6
- 2023Measuring and Mitigating Constraint Violations of In-Context Learning for Utterance-to-API Semantic Parsingcited by 6
- 2022DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discriminationcited by 5
- 2023Causal Question Answering with Reinforcement Learningcited by 5
12 most cited of 26 All 26 (JSON)
- 2026Implicit Causal Graph Construction in Text via Chain Discovery20 Apr 2026
- 2026ClimateCause: Complex and Implicit Causal Structures in Climate Reports16 Apr 2026
- 2025Beyond LLMs: A Linguistic Approach to Causal Graph Generation from Narrative Texts10 Apr 2025
- 2024Hierarchical Narrative Analysis: Unraveling Perceptions of Generative AI17 Sep 2024
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning27 Jun 2024
- 2024A Data-Driven Guided Decoding Mechanism for Diagnostic Captioning20 Jun 2024
- 2024Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 using Weighted Finite State Automata10 Apr 2024
- 2024Narrating Causal Graphs with Large Language Models11 Mar 2024
- 2024Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis22 Feb 2024
- 2024Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processing22 Jan 2024
- 2023InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Models21 Dec 2023
- 2023NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation10 Dec 2023
12 newest of 26 All 26 (JSON)