Similarity-weighted Construction of Contextualized Commonsense Knowledge Graphs for Knowledge-intense Argumentation Tasks
Not on the map. Why?
Abstract (arXiv)
Arguments often do not make explicit how a conclusion follows from its premises. To compensate for this lack, we enrich arguments with structured background knowledge to support knowledge-intense argumentation tasks. We present a new unsupervised method for constructing Contextualized Commonsense Knowledge Graphs (CCKGs) that selects contextually relevant knowledge from large knowledge graphs (KGs) efficiently and at high quality. Our work goes beyond context-insensitive knowledge extraction heuristics by computing semantic similarity between KG triplets and textual arguments. Using these triplet similarities as weights, we extract contextualized knowledge paths that connect a conclusion to its premise, while maximizing similarity to the argument. We combine multiple paths into a CCKG that we optionally prune to reduce noise and raise precision. Intrinsic evaluation of the quality of our graphs shows that our method is effective for (re)constructing human explanation graphs. Manual evaluations in a large-scale knowledge selection setup confirm high recall and precision of implicit CSK in the CCKGs. Finally, we demonstrate the effectiveness of CCKGs in a knowledge-insensitive argument quality rating task, outperforming strong baselines and rivaling a GPT-3 based system.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 29 of its 69 references that are in the map. First posted on arXiv 15 May 2023.
Builds on
29 of 69 references.
References · 29
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2020Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillationcited by 591
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2020COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge Graphscited by 254
- 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 212
- 2021Implicit Representations of Meaning in Neural Language Modelscited by 179
- 2021On Hallucination and Predictive Uncertainty in Conditional Language Generationcited by 176
17 more
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2021Argumentative XAI: A Surveycited by 66
- 2021ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoningcited by 58
- 2020Aspect-Controlled Neural Argument Generationcited by 43
- 2022SafeText: A Benchmark for Exploring Physical Safety in Language Modelscited by 41
- 2019Multi-Hop Paragraph Retrieval for Open-Domain Question Answeringcited by 34
- 2021Lawyers are Dishonest? Quantifying Representational Harms in Commonsense Knowledge Resourcescited by 30
- 2021Challenges in Generalization in Open Domain Question Answeringcited by 30
- 2022Relational Memory Augmented Language Modelscited by 24
- 2021Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentationcited by 17
- 2020Detecting Attackable Sentences in Argumentscited by 14
- 2021Belief-based Generation of Argumentative Claimscited by 14
- 2021Linguistic Dependencies and Statistical Dependencecited by 10
- 2020Fast Interleaved Bidirectional Sequence Generationcited by 8
- 2022Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive Learningcited by 8
- 2022Will It Blend? Mixing Training Paradigms & Prompting for Argument Quality Predictioncited by 7
- 2022CoSe-Co: Text Conditioned Generative CommonSense Contextualizercited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 2; 2026: 1.
6 papers.
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Surveycited by 12
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answeringcited by 8
- 2024Graph Language Modelscited by 6
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Modelscited by 4
- 2025From Argumentation to Deliberation: Perspectivized Stance Vectors for Fine-grained (Dis)agreement Analysiscited by 2
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generationcited by 0
- 2026GLM-RAG: Graph Language Models for Graph-Based Retrieval-Augmented Generation30 Jul 2026
- 2025Interpretable Text Embeddings and Text Similarity Explanation: A Survey20 Feb 2025
- 2025From Argumentation to Deliberation: Perspectivized Stance Vectors for Fine-grained (Dis)agreement Analysis10 Feb 2025
- 2024Enhancing Large Language Models with Pseudo- and Multisource- Knowledge Graphs for Open-ended Question Answering15 Feb 2024
- 2024Graph Language Models13 Jan 2024
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models15 Oct 2023