mlsanityData to 7 Oct 2026

SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasions

arXiv 2603.14027 ↗First posted 14 Mar 2026cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Political speakers often avoid answering questions directly while maintaining the appearance of responsiveness. Despite its importance for public discourse, such strategic evasion remains underexplored in Natural Language Processing. We introduce SemEval-2026 Task 6, CLARITY, a shared task on political question evasion consisting of two subtasks: (i) clarity-level classification into Clear Reply, Ambivalent, and Clear Non-Reply, and (ii) evasion-level classification into nine fine-grained evasion strategies. The benchmark is constructed from U.S. presidential interviews and follows an expert-grounded taxonomy of response clarity and evasion. The task attracted 124 registered teams, who submitted 946 valid runs for clarity-level classification and 539 for evasion-level classification. Results show a substantial gap in difficulty between the two subtasks: the best system achieved 0.89 macro-F1 on clarity classification, surpassing the strongest baseline by a large margin, while the top evasion-level system reached 0.68 macro-F1, matching the best baseline. Overall, large language model prompting and hierarchical exploitation of the taxonomy emerged as the most effective strategies, with top systems consistently outperforming those that treated the two subtasks independently. CLARITY establishes political response evasion as a challenging benchmark for computational discourse analysis and highlights the difficulty of modeling strategic ambiguity in political language.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 8 of its 32 references that are in the map. First posted on arXiv 14 Mar 2026.

Builds on

8 of 32 references.

References · 8

  1. 2022Stop Measuring Calibration When Humans Disagreecited by 70
  2. 2018Framing and Agenda-setting in Russian News: a Computational Analysis of Intricate Political Strategiescited by 47
  3. 2021Did they answer? Subjective acts and intents in conversational discoursecited by 22
  4. 2023Stance Detection: A Practical Guide to Classifying Political Beliefs in Textcited by 20
  5. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  6. 2025C-QUERI: Congressional Questions, Exchanges, and Responses in Institutions Datasetcited by 1
  7. 2026Prompt-Based Clarity Evaluation and Topic Detection in Political Question Answeringcited by 1
  8. 2026CSE-UOI at SemEval-2026 Task 6: A Two-Stage Heterogeneous Ensemble with Deliberative Complexity Gating for Political Evasion Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.