mlsanityData to 14 Oct 2026

CSE-UOI at SemEval-2026 Task 6: A Two-Stage Heterogeneous Ensemble with Deliberative Complexity Gating for Political Evasion Detection

arXiv 2603.12453 ↗First posted 12 Mar 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper describes our system for SemEval-2026 Task 6, which classifies clarity of responses in political interviews into three categories: Clear Reply, Ambivalent, and Clear Non-Reply. We propose a heterogeneous dual large language model (LLM) ensemble via self-consistency (SC) and weighted voting, and a novel post-hoc correction mechanism, Deliberative Complexity Gating (DCG). This mechanism uses cross-model behavioral signals and exploits the finding that an LLM response-length proxy correlates strongly with sample ambiguity. To further examine mechanisms for improving ambiguity detection, we evaluated multi-agent debate as an alternative strategy for increasing deliberative capacity. Unlike DCG, which adaptively gates reasoning using cross-model behavioral signals, debate increases agent count without increasing model diversity. Our solution achieved a Macro-F1 score of 0.85 on the evaluation set, securing 3rd place and tied with the second-best reported score.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 21 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

8 of 21 references.

References · 8

  1. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  3. 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
  4. 2025Multi-Agent Debate for LLM Judges with Adaptive Stability Detectioncited by 23
  5. 2025The Illusion of Progress: Re-evaluating Hallucination Detection in LLMscited by 22
  6. 2024"I Never Said That": A dataset, taxonomy and baselines on response clarity classificationcited by 9
  7. 2025How Does Response Length Affect Long-Form Factualitycited by 6
  8. 2025MSA at BEA 2025 Shared Task: Disagreement-Aware Instruction Tuning for Multi-Dimensional Evaluation of LLMs as Math Tutorscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ARMOR-MAD: Adaptive Routing for Heterogeneous Multi-Agent Debate in Large Language Model Reasoning
  2. 2025Beyond Single Models: Enhancing LLM Detection of Ambiguity in Requests through Debate
  3. 2026Minority Sentinel: When to Overturn Majority Voting in Multi-Agent LLM Debates
  4. 2026Demystifying Multi-Agent Debate: The Role of Confidence and Diversity
  5. 2026Statistical Scouting Finds Debate-Safe but Not Debate-Useful Cases: A Matched-Ceiling Study of Open-Weight LLM Reasoning Protocols
  6. 2024Debate, Deliberate, Decide (D3): A Cost-Aware Adversarial Framework for Reliable and Interpretable LLM Evaluation
  7. 2026Detection Without Correction: A Two-Parameter Decomposition of Multi-Stage LLM Pipelines
  8. 2025Finding Common Ground: Using Large Language Models to Detect Agreement in Multi-Agent Decision Conferences