AsymVerify at SemEval-2026 Task 6: Asymmetric Confidence-Gated Verification for Political Evasion Detection
Not on the map. Why?
Abstract (arXiv)
Political evasion is difficult to detect because evasive answers often appear cooperative while avoiding concrete commitment. We present AsymVerify, a confidence-gated verification system for SemEval-2026 Task 6, a three-way classification of Clear Reply, Ambivalent, and Clear Non-Reply responses. AsymVerify scored 0.85 Macro F1 on the evaluation split (D_eval, n=237), placing 2nd out of 41 teams on the official leaderboard. The system first classifies each question-answer pair, then selectively applies downgrade verification (CR/CNR -> AMB) or upgrade verification (AMB -> CR) to low-confidence predictions. Development analysis shows that errors concentrate at the Ambivalent boundary in both directions, motivating this asymmetric two-verifier design while confidence gating keeps additional inference cost low. On D_dev (n=308), AsymVerify with GLM-4.7 gains +17.1 Macro F1 over single-pass classification at 1.48 calls/example, and the upgrade verifier alone improves every tested LLM backend on D_dev by +6.8 to +15.2 Macro F1 over its single-pass baseline. Code is available at https://github.com/kaons-research/AsymVerify-ACL.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 36 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
12 of 36 references.
References · 12
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 946
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 791
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2024Language Model Cascades: Token-level uncertainty and beyondcited by 115
- 2023Text Classification via Large Language Modelscited by 104
- 2023Reasoning Implicit Sentiment with Chain-of-Thought Promptingcited by 79
- 2024Uncertainty in Language Models: Assessment through Rank-Calibrationcited by 40
- 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
- 2026SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasionscited by 5
Built on by
Not cited yet.