ttda704 at SemEval-2026 Task 6: Structured Chain-of-Thought Prompting for Political Evasion Detection
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
This paper describes our system for SemEval-2026 Task 6, which addresses the classification of political evasion strategies in English question-answer pairs extracted from U.S. presidential interviews. We systematically compare two distinct paradigms: (1) Parameter-Efficient Fine-Tuning of Qwen3 models (4B-32B) using QLoRA, enhanced with tiered upsampling and weighted cross-entropy loss to address severe class imbalance, and (2) structured Chain-of-Thought (CoT) prompting of reasoning-capable API models, namely DeepSeek-V3.2 and Grok-4-Fast. Our evaluation demonstrates that structured CoT prompting of reasoning-enabled models substantially outperforms our baseline parameter-efficient fine-tuning implementation in absolute Macro F1. Our best system, Grok-4-Fast with extended reasoning and few-shot hierarchical CoT prompting, achieves a Macro F1 of 0.5147 on Subtask 2 (9-class evasion) and 0.7979 on Subtask 1 (3-class clarity), ranking 8th out of 33 teams on Subtask 2 and 13th out of 41 teams on Subtask 1 on the official leaderboard. Furthermore, our ablation studies reveal key insights into effective prompt design for evasion detection: presenting labels within a hierarchical taxonomy helps structure model reasoning, while few-shot exemplars provide task calibration. However, the strongest prompt variants are not statistically distinguishable in Macro F1, and explicitly enabling extended reasoning modes yields substantial performance gains by facilitating the multi-step pragmatic analysis required to detect evasive intent.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 3 of its 17 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
3 of 17 references.
Closest ancestors · 1
Same direction, newest first
Other references · 2
- 2025Qwen3 Technical Reportcited by 8,820
- 2026SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasionscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Prompt-Based Clarity Evaluation and Topic Detection in Political Question Answering
- 2023R3 Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context
- 2024ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting
- 2023Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language Models
- 2024Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods
- 2024Bias-Augmented Consistency Training Reduces Biased Reasoning in Chain-of-Thought
- 2024Enhancing Chain of Thought Prompting in Large Language Models via Reasoning Patterns
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models