Improving Synthetic Data Generation for Argument Mining via Adversarial Reinforcement Learning
On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation
Abstract (arXiv)
Argument Mining (AM) is fundamentally constrained by the scarcity of high-quality structure-annotated datasets. While LLMs have shown promise in synthetic data generation, producing synthetic AM data that is both structurally accurate and sufficiently diverse remains a challenging problem. To address this problem, we revisit synthetic data generation for AM from a new perspective and propose a novel adversarial reinforcement learning framework for data synthesis. The proposed framework jointly optimizes the generator and the discriminator in an adversarial loop, in which the generator produces structured AM instances, and the discriminator provides learning signals by distinguishing real data from synthetic candidates. This enables the generator to progressively improve both the structural accuracy of generated argument data while maintaining diversity through adversarial feedback. Extensive experiments demonstrate that the proposed framework consistently improves AM performance on three benchmark datasets in both full-data and low-resource settings, validating its effectiveness and scalability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. First posted on arXiv 6 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Sample Prompting and Actor-Critic Prompt Optimization for Diverse Synthetic Data Generation
- 2025A comprehensive study of LLM-based argument classification: from LLAMA through GPT-4o to Deepseek-R1
- 2025Lightweight Safety Guardrails via Synthetic Data and RL-guided Adversarial Training
- 2026Adversarial Arena: Crowdsourcing Data Generation through Interactive Competition
- 2024Surveying the Effects of Quality, Diversity, and Complexity in Synthetic Data From Large Language Models
- 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Code
- 2025Generative Adversarial Reasoner: Enhancing LLM Reasoning with Adversarial Reinforcement Learning
- 2026Linguistic and Argument Diversity in Synthetic Data for Function-Calling Agents