mlsanityData to 7 Oct 2026

PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts

arXiv 2605.14002 ↗First posted 13 May 2026cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Large Reasoning Models (LRMs) embedded in agentic frameworks have transformed information retrieval from static, long context question answering into open-ended exploration. Yet real world use requires models to discover and synthesize "long-tail" facts from dispersed sources, a capability that remains under-evaluated. We introduce PolitNuggets, a multilingual benchmark for agentic information synthesis via constructing political biographies for 400 global elites, covering over 10000 political facts. We standardize evaluation with an optimized multi agent system and propose FactNet, an evidence conditional protocol that scores discovery, fine-grained accuracy, and efficiency. Across models and settings, we find that current systems often struggle with fine-grained details, and vary substantially in efficiency. Finally, using benchmark diagnostics, we relate agent performance to underlying model capabilities, highlighting the importance of short-context extraction, multilingual robustness, and reliable tool use.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 16 of its 24 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

16 of 24 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul

Other references · 15

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  5. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  6. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  7. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  8. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
  9. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  10. 2024∞Bench: Extending Long Context Evaluation Beyond 100K Tokenscited by 360
  11. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 236
  12. 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
3 more
  1. 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understandingcited by 175
  2. 2024Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queriescited by 85
  3. 2025A Controllable Examination for Long-Context Language Modelscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Search
  2. 2025Agent-Enhanced Large Language Models for Researching Political Institutions
  3. 2026Agentic Framework for Political Biography Extraction
  4. 2024RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
  5. 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs
  6. 2024GermanPartiesQA: Benchmarking Commercial Large Language Models and AI Companions for Political Alignment and Sycophancy
  7. 2026CIVI: A Framework for Diagnosing Search Agent Failures in Civic Information
  8. 2025Understanding Inequality of LLM Fact-Checking over Geographic Regions with Agent and Retrieval models