UZHCL_for_the_win at Touche: Encoder Fine-Tuning, Synthetic Augmentation, and an Underpowered Encoder-LLM Comparison
Not on the map. Why?
Abstract (arXiv)
Online discussions on platforms like Reddit are a productive testbed for fallacy detection: short texts, broad topical range, and the full inventory of informal fallacies. The Touche 2026 lab at CLEF formalises this as a shared task on a Reddit-derived corpus that combines fallacy detection with argument-scheme classification. This paper describes our participation in all three subtasks (ST1 binary fallacy detection, ST2 eight-way fallacy classification, ST3 four-way argument-scheme classification) and both evaluation tracks. Our submitted systems are fine-tuned RoBERTa-large encoders with task-specific heads, augmented with a small batch of LLM-generated synthetic contrastive pairs; for ST2 and ST3 on the enhanced track we additionally added confidence-filtered pseudo-labelled examples from the unlabelled pool. A wider backbone comparison spanning additional encoders (DeBERTa-v3, ModernBERT) and an LLM track (four Qwen variants from 3B to 32B, zero-shot through CoT-LoRA) showed no validated benefit over RoBERTa-large at this corpus scale, with 5-fold variance wide enough that we call the comparison underpowered rather than settled. We also characterise how much of the enhanced track's lift reflects organiser-rewritten inputs carrying label information rather than genuine argument clarification. On the official Touche 2026 test set our systems ranked first on both base-track classification cells (ST2 and ST3) and second on both binary-detection (ST1) tracks, with the two enhanced-track classification cells topped by cascaded and multitask systems. We close with the rare-class limitation on ST3 and the most useful follow-ups. Code: https://github.com/psychias/fallacy_detection_clef_2026
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 30 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
11 of 30 references.
References · 11
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2019Fine-Grained Analysis of Propaganda in News Articlescited by 133
- 2023Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitationscited by 100
- 2017The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrantscited by 56
- 2023Multitask Instruction-based Prompting for Fallacy Recognitioncited by 23
- 2020Uncertainty-aware Self-training for Text Classification with Few Labelscited by 20
- 2021Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemescited by 18
- 2024Are LLMs Good Zero-Shot Fallacy Classifiers?cited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models Are Better Logical Fallacy Reasoners with Counterargument, Explanation, and Goal-Aware Prompt Formulation
- 2026Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis
- 2025Follow My Lead: Logical Fallacy Classification with Knowledge-Augmented LLMs
- 2024A Logical Fallacy-Informed Framework for Argument Generation
- 2025Joint Effects of Argumentation Theory, Audio Modality and Data Enrichment on LLM-Based Fallacy Classification
- 2025MisSynth: Improving MISSCI Logical Fallacies Classification with Synthetic Data
- 2022Logical Fallacy Detection
- 2026Argument Quality Assessment with Large Language Models: A Pairwise Bradley-Terry Approach