Argue with Me Tersely: Towards Sentence-Level Counter-Argument Generation
Not on the map. Why?
Abstract (arXiv)
Counter-argument generation -- a captivating area in computational linguistics -- seeks to craft statements that offer opposing views. While most research has ventured into paragraph-level generation, sentence-level counter-argument generation beckons with its unique constraints and brevity-focused challenges. Furthermore, the diverse nature of counter-arguments poses challenges for evaluating model performance solely based on n-gram-based metrics. In this paper, we present the ArgTersely benchmark for sentence-level counter-argument generation, drawing from a manually annotated dataset from the ChangeMyView debate forum. We also propose Arg-LlaMA for generating high-quality counter-argument. For better evaluation, we trained a BERT-based evaluator Arg-Judge with human preference data. We conducted comparative experiments involving various baselines such as LlaMA, Alpaca, GPT-3, and others. The results show the competitiveness of our proposed framework and evaluator in counter-argument generation tasks. Code and data are available at https://github.com/amazingljy1206/ArgTersely.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 21 Dec 2023.
Builds on
25 of 42 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
13 more
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2022Instruction Induction: From Few Examples to Natural Language Task Descriptionscited by 152
- 2016Winning Arguments: Interaction Dynamics and Persuasion Strategies in Good-faith Online Discussionscited by 106
- 2018Cross-topic Argument Mining from Heterogeneous Sources Using Attention-based Neural Networkscited by 58
- 2019Argument Generation with Retrieval, Planning, and Realizationcited by 45
- 2020Aspect-Controlled Neural Argument Generationcited by 43
- 2018Neural Argument Generation Augmented with Externally Retrieved Evidencecited by 34
- 2021Argument Undermining: Counter-Argument Generation by Attacking Weak Premisescited by 22
- 2022Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learnerscited by 22
- 2019Discrete Argument Representation Learning for Interactive Argument Pair Identificationcited by 6
- 2020High Quality Real-Time Structured Debate Generationcited by 2
Built on by
Citing papers per year: 2024: 5; 2025: 3; 2026: 4.
12 papers.
- 2024Is Safer Better? The Impact of Guardrails on the Argumentative Strength of LLMs in Hate Speech Counteringcited by 11
- 2024ConQRet: Benchmarking Fine-Grained Evaluation of Retrieval Augmented Argumentation with LLM Judgescited by 5
- 2025Dynamic Knowledge Integration for Evidence-Driven Counter-Argument Generation with Large Language Modelscited by 3
- 2024Overview of AI-Debater 2023: The Challenges of Argument Generation Taskscited by 2
- 2024Incivility and Rigidity: Evaluating the Risks of Fine-Tuning LLMs for Political Argumentationcited by 1
- 2025Towards Comprehensive Argument Analysis in Education: Dataset, Tasks, and Methodcited by 1
- 2026When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speechcited by 1
- 2026ArgBench: Benchmarking LLMs on Computational Argumentation Taskscited by 1
- 2024Overview of the CAIL 2023 Argument Mining Trackcited by 0
- 2025Data Descriptions from Large Language Models with Influence Estimationcited by 0
- 2026Who Annotates in NLP? A Large-scale Assessment of Human Annotation Reporting between 2018 and 2025cited by 0
- 2026PTCG: Persona-guided Tree-based Counterargument Generationcited by 0
- 2026PTCG: Persona-guided Tree-based Counterargument Generation7 Sep 2026
- 2026Who Annotates in NLP? A Large-scale Assessment of Human Annotation Reporting between 2018 and 20251 Jun 2026
- 2026ArgBench: Benchmarking LLMs on Computational Argumentation Tasks19 Apr 2026
- 2026When Hate Meets Facts: LLMs-in-the-Loop for Check-worthiness Detection in Hate Speech26 Mar 2026
- 2025Data Descriptions from Large Language Models with Influence Estimation11 Nov 2025
- 2025Towards Comprehensive Argument Analysis in Education: Dataset, Tasks, and Method17 May 2025
- 2025Dynamic Knowledge Integration for Evidence-Driven Counter-Argument Generation with Large Language Models7 Mar 2025
- 2024ConQRet: Benchmarking Fine-Grained Evaluation of Retrieval Augmented Argumentation with LLM Judges6 Dec 2024
- 2024Incivility and Rigidity: Evaluating the Risks of Fine-Tuning LLMs for Political Argumentation25 Nov 2024
- 2024Is Safer Better? The Impact of Guardrails on the Argumentative Strength of LLMs in Hate Speech Countering4 Oct 2024
- 2024Overview of AI-Debater 2023: The Challenges of Argument Generation Tasks20 Jul 2024
- 2024Overview of the CAIL 2023 Argument Mining Track20 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2025Arg-LLaDA: Argument Summarization via Large Language Diffusion Models and Sufficiency-Aware Refinement
- 2023AMERICANO: Argument Generation with Discourse-driven Decomposition and Agent Interaction
- 2024"Reasoning" with Rhetoric: On the Style-Evidence Tradeoff in LLM-Generated Counter-Arguments
- 2024A Logical Fallacy-Informed Framework for Argument Generation
- 2025Limited Generalizability in Argument Mining: State-Of-The-Art Models Learn Datasets, Not Arguments
- 2026Argument Quality Assessment with Large Language Models: A Pairwise Bradley-Terry Approach
- 2025Large Language Models in Argument Mining: A Survey
- 2025DS@GT at Touch'e: Large Language Models for Retrieval-Augmented Debate