Classification and Clustering of Arguments with Contextualized Word Embeddings
Not on the map. Why?
Abstract (arXiv)
We experiment with two recent contextualized word embedding methods (ELMo and BERT) in the context of open-domain argument search. For the first time, we show how to leverage the power of contextualized word embeddings to classify and cluster topic-dependent arguments, achieving impressive results on both tasks and across multiple datasets. For argument classification, we improve the state-of-the-art for the UKP Sentential Argument Mining Corpus by 20.8 percentage points and for the IBM Debater - Evidence Sentences dataset by 7.4 percentage points. For the understudied task of argument clustering, we propose a pre-training step which improves by 7.8 percentage points over strong baselines on a novel dataset, and by 12.3 percentage points for the Argument Facet Similarity (AFS) Corpus.
Key facts. Cited by 57 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 9; 2023: 15; 2024: 7; 2025: 8; 2026: 6.
57 papers.
Sort:
By area:
- 2022SGPT: GPT Sentence Embeddings for Semantic Searchcited by 204
- 2022SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Featurescited by 33
- 2021DirectProbe: Studying Representations without Classifierscited by 25
- 2022ArgLegalSumm: Improving Abstractive Summarization of Legal Documents with Argument Miningcited by 25
- 2022IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Taskscited by 23
- 2023Natural Language Decompositions of Implicit Content Enable Better Text Representationscited by 19
- 2021Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemescited by 18
- 2021Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentationcited by 17
- 2023Examining Bias in Opinion Summarisation Through the Perspective of Opinion Diversitycited by 14
- 2025Large Language Models in Argument Mining: A Surveycited by 14
- 2024Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluationcited by 13
- 2021Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Studycited by 9
38 more
- 2021SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checkingcited by 8
- 2021Evaluating Pre-Trained Models for User Feedback Analysis in Software Engineering: A Study on Classification of App-Reviewscited by 7
- 2021Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Researchcited by 7
- 2022Persua: A Visual Interactive System to Enhance the Persuasiveness of Arguments in Online Discussioncited by 7
- 2022Will It Blend? Mixing Training Paradigms & Prompting for Argument Quality Predictioncited by 7
- 2023Equiangular Basis Vectorscited by 7
- 2021Multi-Task Attentive Residual Networks for Argument Miningcited by 6
- 2023Predicting Desirable Revisions of Evidence and Reasoning in Argumentative Writingcited by 6
- 2024A Hybrid Intelligence Method for Argument Miningcited by 6
- 2023Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisationcited by 5
- 2023Shaping Political Discourse using multi-source News Summarizationcited by 5
- 2024Efficient argument classification with compact language models and ChatGPT-4 refinementscited by 5
- 2024Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metriccited by 5
- 2025Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Argumentscited by 5
- 2022The COVMis-Stance dataset: Stance Detection on Twitter for COVID-19 Misinformationcited by 4
- 2023How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Studycited by 4
- 2025Argument Summarization and its Evaluation in the Era of Large Language Modelscited by 4
- 2025ArgInstruct: Specialized Instruction Fine-Tuning for Computational Argumentationcited by 4
- 2023Topic Ontologies for Argumentscited by 3
- 2023Argument Mining using BERT and Self-Attention based Embeddingscited by 3
- 2023Vec2Vec: A Compact Neural Network Approach for Transforming Text Embeddings with High Fidelitycited by 3
- 2021Tree-Constrained Graph Neural Networks For Argument Miningcited by 2
- 2022Enhancing Legal Argument Mining with Domain Pre-training and Neural Networkscited by 2
- 2022Towards a Holistic View on Argument Quality Predictioncited by 2
- 2023Multilingual estimation of political-party positioning: From label aggregation to long-input Transformerscited by 2
- 2024WIBA: What Is Being Argued? A Comprehensive Approach to Argument Miningcited by 2
- 2023You Are What You Talk About: Inducing Evaluative Topics for Personality Analysiscited by 1
- 2024TACO -- Twitter Arguments from COnversationscited by 1
- 2024Investigating the Robustness of Modelling Decisions for Few-Shot Cross-Topic Stance Detection: A Preregistered Studycited by 1
- 2025A comprehensive study of LLM-based argument classification: from LLAMA through GPT-4o to Deepseek-R1cited by 1
- 2025Stakeholder Suite: A Unified AI Framework for Mapping Actors, Topics and Arguments in Public Debatescited by 1
- 2026A comprehensive study of LLM-based argument classification: from Llama through DeepSeek to GPT-5.2cited by 1
- 2026ArgBench: Benchmarking LLMs on Computational Argumentation Taskscited by 1
- 2021An Empirical Study on Measuring the Similarity of Sentential Arguments with Language Model Domain Adaptationcited by 0
- 2021Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis managementcited by 0
- 2021Towards Full-Fledged Argument Search: A Framework for Extracting and Clustering Arguments from Unstructured Textcited by 0
- 2023Classifying Text-Based Conspiracy Tweets related to COVID-19 using Contextualized Word Embeddingscited by 0
- 2023Explainable Topic-Enhanced Argument Mining from Heterogeneous Sourcescited by 0
50 most cited of 57 All 57 (JSON)
- 2026Logical Embeddings for Argument Analysis15 Aug 2026
- 2026Evaluating Pluralism in LLMs through Latent Perspectives11 Jun 2026
- 2026Contextualized Prompting For Stance Detection On Social Media4 Jun 2026
- 2026ArgBench: Benchmarking LLMs on Computational Argumentation Tasks19 Apr 2026
- 2026A Community-Based Approach for Stance Distribution and Argument Organization18 Apr 2026
- 2026A comprehensive study of LLM-based argument classification: from Llama through DeepSeek to GPT-5.225 Feb 2026
- 2025Stakeholder Suite: A Unified AI Framework for Mapping Actors, Topics and Arguments in Public Debates19 Dec 2025
- 2025Arg-LLaDA: Argument Summarization via Large Language Diffusion Models and Sufficiency-Aware Refinement25 Jul 2025
- 2025A comprehensive study of LLM-based argument classification: from LLAMA through GPT-4o to Deepseek-R111 Jul 2025
- 2025Private Training & Data Generation by Clustering Embeddings20 Jun 2025
- 2025Large Language Models in Argument Mining: A Survey19 Jun 2025
- 2025Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Arguments28 May 2025
38 more
- 2025ArgInstruct: Specialized Instruction Fine-Tuning for Computational Argumentation28 May 2025
- 2025Argument Summarization and its Evaluation in the Era of Large Language Models2 Mar 2025
- 2024Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation5 Jun 2024
- 2024WIBA: What Is Being Argued? A Comprehensive Approach to Argument Mining1 May 2024
- 2024Enhancing Argument Summarization: Prioritizing Exhaustiveness in Key Point Generation and Introducing an Automatic Coverage Evaluation Metric17 Apr 2024
- 2024Investigating the Robustness of Modelling Decisions for Few-Shot Cross-Topic Stance Detection: A Preregistered Study5 Apr 2024
- 2024TACO -- Twitter Arguments from COnversations30 Mar 2024
- 2024Efficient argument classification with compact language models and ChatGPT-4 refinements20 Mar 2024
- 2024A Hybrid Intelligence Method for Argument Mining11 Mar 2024
- 2023Shaping Political Discourse using multi-source News Summarization18 Dec 2023
- 2023Indicative Summarization of Long Discussions3 Nov 2023
- 2023Multilingual estimation of political-party positioning: From label aggregation to long-input Transformers19 Oct 2023
- 2023How to Handle Different Types of Out-of-Distribution Scenarios in Computational Argumentation? A Comprehensive and Fine-Grained Field Study15 Sep 2023
- 2023Explainable Topic-Enhanced Argument Mining from Heterogeneous Sources22 Jul 2023
- 2023Vec2Vec: A Compact Neural Network Approach for Transforming Text Embeddings with High Fidelity22 Jun 2023
- 2023Examining Bias in Opinion Summarisation Through the Perspective of Opinion Diversity7 Jun 2023
- 2023Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisation25 May 2023
- 2023Natural Language Decompositions of Implicit Content Enable Better Text Representations23 May 2023
- 2023Equiangular Basis Vectors21 Mar 2023
- 2023Classifying Text-Based Conspiracy Tweets related to COVID-19 using Contextualized Word Embeddings7 Mar 2023
- 2023Argument Mining using BERT and Self-Attention based Embeddings27 Feb 2023
- 2023Predicting Desirable Revisions of Evidence and Reasoning in Argumentative Writing10 Feb 2023
- 2023You Are What You Talk About: Inducing Evaluative Topics for Personality Analysis1 Feb 2023
- 2023Topic Ontologies for Arguments23 Jan 2023
- 2022Will It Blend? Mixing Training Paradigms & Prompting for Argument Quality Prediction19 Sep 2022
- 2022ArgLegalSumm: Improving Abstractive Summarization of Legal Documents with Argument Mining4 Sep 2022
- 2022SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features14 Jun 2022
- 2022Towards a Holistic View on Argument Quality Prediction19 May 2022
- 2022Persua: A Visual Interactive System to Enhance the Persuasiveness of Arguments in Online Discussion16 Apr 2022
- 2022The COVMis-Stance dataset: Stance Detection on Twitter for COVID-19 Misinformation5 Apr 2022
- 2022IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks23 Mar 2022
- 2022Enhancing Legal Argument Mining with Domain Pre-training and Neural Networks27 Feb 2022
- 2022SGPT: GPT Sentence Embeddings for Semantic Search17 Feb 2022
- 2021Towards Full-Fledged Argument Search: A Framework for Extracting and Clustering Arguments from Unstructured Text30 Nov 2021
- 2021SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checking25 Oct 2021
- 2021Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research18 Oct 2021
- 2021Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Study14 Oct 2021
- 2021Tree-Constrained Graph Neural Networks For Argument Mining2 Sep 2021
50 newest of 57 All 57 (JSON)
- 2025Large Language Models in Argument Mining: A Surveycited by 14
- 2025Large Language Models in Argument Mining: A Survey19 Jun 2025
- 2022SGPT: GPT Sentence Embeddings for Semantic Searchcited by 204
- 2022SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Featurescited by 33
- 2021DirectProbe: Studying Representations without Classifierscited by 25
- 2022ArgLegalSumm: Improving Abstractive Summarization of Legal Documents with Argument Miningcited by 25
- 2022IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Taskscited by 23
- 2023Natural Language Decompositions of Implicit Content Enable Better Text Representationscited by 19
- 2021Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemescited by 18
- 2021Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentationcited by 17
- 2023Examining Bias in Opinion Summarisation Through the Perspective of Opinion Diversitycited by 14
- 2024Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluationcited by 13
- 2021Is Stance Detection Topic-Independent and Cross-topic Generalizable? -- A Reproduction Studycited by 9
- 2021SciClops: Detecting and Contextualizing Scientific Claims for Assisting Manual Fact-Checkingcited by 8
12 most cited of 53 All 53 (JSON)
- 2026Logical Embeddings for Argument Analysis15 Aug 2026
- 2026Evaluating Pluralism in LLMs through Latent Perspectives11 Jun 2026
- 2026Contextualized Prompting For Stance Detection On Social Media4 Jun 2026
- 2026ArgBench: Benchmarking LLMs on Computational Argumentation Tasks19 Apr 2026
- 2026A Community-Based Approach for Stance Distribution and Argument Organization18 Apr 2026
- 2026A comprehensive study of LLM-based argument classification: from Llama through DeepSeek to GPT-5.225 Feb 2026
- 2025Stakeholder Suite: A Unified AI Framework for Mapping Actors, Topics and Arguments in Public Debates19 Dec 2025
- 2025Private Training & Data Generation by Clustering Embeddings20 Jun 2025
- 2025ArgInstruct: Specialized Instruction Fine-Tuning for Computational Argumentation28 May 2025
- 2025Argument Summarization and its Evaluation in the Era of Large Language Models2 Mar 2025
- 2024Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation5 Jun 2024
- 2024WIBA: What Is Being Argued? A Comprehensive Approach to Argument Mining1 May 2024
12 newest of 53 All 53 (JSON)