mlsanityData to 14 Oct 2026

SMADE-IE: Sparse Multi-Agent Framework with Evidence-Driven Debate for Zero-Shot Information Extraction

arXiv 2606.04691 ↗First posted 3 Jun 2026cs.CLcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Zero-shot information extraction (IE) with large language models (LLMs) enables adaptation to new schemas and domains without task-specific training. Existing methods mainly follow three paradigms. Monolithic prompting is efficient but prone to missed mentions, boundary errors, and type confusion. Each-type prompting improves type-level focus but may produce overlapping or conflicting predictions, while multi-agent debate can resolve such conflicts at the cost of irrelevant context, redundant interactions, and high token overhead. To address these issues, we propose SMADE-IE, a sparse and evidence-driven multi-agent framework. An Adaptive Mode Selector routes simple inputs to a lightweight Global Extraction Mode and ambiguous inputs to a Type-Centric Extraction Mode based on sample complexity and relevant types. Cross-type conflicts are resolved by an Evidence-Driven Debate module that uses Toulmin-style arguments, external evidence scoring, Beta-based confidence updates, and early stopping. Experiments on nine benchmarks covering NER, RE, and JERE show that SMADE-IE improves average Partial F1 over the strongest baselines by 11.37, 3.83, and 14.46 points, respectively. Compared with the multi-agent baseline CrossAgentIE, SMADE-IE reduces token consumption by 85.1% on DocRED and 80.1% on CrossRE, demonstrating substantially higher inference efficiency. Code is available at https://github.com/Cppys/SMADE-IE.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 3 of its 60 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

3 of 60 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026TIDE: Trajectory-based Diagnostic Evaluation of Test-Time Improvement in LLM Agents2 Feb

Other references · 2

  1. 2026Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language Modelscited by 2
  2. 2024An Empirical Study on Information Extraction using Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Cooperative Multi-Agent Framework for Zero-Shot Named Entity Recognition
  2. 2025Extracting Events Like Code: A Multi-Agent Programming Framework for Zero-Shot Event Extraction
  3. 2024SMoA: Improving Multi-agent Large Language Models with Sparse Mixture-of-Agents
  4. 2023Agent Instructs Large Language Models to be General Zero-Shot Reasoners
  5. 2025iMAD: Intelligent Multi-Agent Debate for Efficient and Accurate LLM Inference
  6. 2026Learning to Generate and Extract: A Multi-Agent Collaboration Framework For Zero-shot Document-level Event Arguments Extraction
  7. 2026Multimodal Collaborative Debate for Zero-Shot Time Series Reasoning
  8. 2025MR-UIE: Multi-Perspective Reasoning with Reinforcement Learning for Universal Information Extraction