CSE-UOI at SemEval-2026 Task 6: A Two-Stage Heterogeneous Ensemble with Deliberative Complexity Gating for Political Evasion Detection
Not on the map. Why?
Abstract (arXiv)
This paper describes our system for SemEval-2026 Task 6, which classifies clarity of responses in political interviews into three categories: Clear Reply, Ambivalent, and Clear Non-Reply. We propose a heterogeneous dual large language model (LLM) ensemble via self-consistency (SC) and weighted voting, and a novel post-hoc correction mechanism, Deliberative Complexity Gating (DCG). This mechanism uses cross-model behavioral signals and exploits the finding that an LLM response-length proxy correlates strongly with sample ambiguity. To further examine mechanisms for improving ambiguity detection, we evaluated multi-agent debate as an alternative strategy for increasing deliberative capacity. Unlike DCG, which adaptively gates reasoning using cross-model behavioral signals, debate increases agent count without increasing model diversity. Our solution achieved a Macro-F1 score of 0.85 on the evaluation set, securing 3rd place and tied with the second-best reported score.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
8 of 21 references.
References · 8
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
- 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detectioncited by 23
- 2025The Illusion of Progress: Re-evaluating Hallucination Detection in LLMscited by 22
- 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
- 2025How Does Response Length Affect Long-Form Factualitycited by 6
- 2025MSA at BEA 2025 Shared Task: Disagreement-Aware Instruction Tuning for Multi-Dimensional Evaluation of LLMs as Math Tutorscited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ARMOR-MAD: Adaptive Routing for Heterogeneous Multi-Agent Debate in Large Language Model Reasoning
- 2025Beyond Single Models: Enhancing LLM Detection of Ambiguity in Requests through Debate
- 2026Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates
- 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
- 2026Statistical Scouting Finds Debate-Safe but Not Debate-Useful Cases: A Matched-Ceiling Study of Open-Weight LLM Reasoning Protocols
- 2024Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation
- 2026Detection Without Correction: A Two-Parameter Decomposition of Multi-Stage LLM Pipelines
- 2025Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences