mlsanityData to 7 Oct 2026

CLaC at SemEval-2026 Task 6: Response Clarity Detection in Political Discourse

arXiv 2605.02170 ↗First posted 4 May 2026cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we present our system for SemEval-2026 Task 6 (CLARITY) on response clarity and evasion detection in question-answer pairs from U.S. presidential interviews, comparing fine-tuned encoders with prompt-based LLMs. Our LLM ensemble achieves 80 macro-F1 on the 3-class Task 1 (9th/41) and 59 on the 9-class Task 2 (3rd/33). Across 8 transformer encoders optimized through a four-stage pipeline, partial encoder layer unfreezing outperforms full fine-tuning by a wide margin. Combining English and multilingual encoders further improves ensemble performance over either family alone, despite multilingual models being individually weaker. Prompt-based LLMs, without any task-specific parameter updates, outperform fine-tuned encoders, particularly on minority classes; among open-weight LLMs, parameter count does not predict performance. Enriched input, concatenating the full interviewer turn, improves LLM performance but not that of encoders, an effect that persists with Longformer's extended context window, suggesting the divergence is not attributable to sequence-length capacity alone in our settings. The Clear Reply/Ambivalent boundary remains the dominant failure mode, mirroring the disagreement among human annotators. Our code, prompts, model configurations, and results are publicly available.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

10 of 21 references.

References · 10

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  6. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  7. 2024The Prompt Report: A Systematic Survey of Prompt Engineering Techniquescited by 115
  8. 2023Re-Reading Improves Reasoning in Large Language Modelscited by 37
  9. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  10. 2026SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasionscited by 5

Built on by

Not cited yet.