SEVA: Self-Evolving Verification Agent with Process Reward for Fact Attribution
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
also in 1 more
Abstract (arXiv)
Hallucination is the reliability bottleneck for LLM-based agents, and fact attribution verifiers are the last line of defense -- yet today's verifiers emit only opaque binary labels, leaving agents unable to self-correct and operators unable to audit. We present SEVA, a structured verification agent that emits evidence alignments, step-by-step reasoning chains, calibrated confidence, and a six-category error diagnosis with actionable fixes. Training such an agent with RL is non-trivial: standard binary reward on multi-component output triggers advantage collapse -- within-group reward variance vanishes and the GRPO gradient disappears. We resolve this with a process reward that decomposes verification quality into five independent components weighted 70/30 toward process signals, restoring the gradient and inducing an implicit curriculum -- the agent first masters verification behavior (alignment 0.917 -> 0.997, format 72% -> 100%), then outcomes (F1 64.9 -> 69.0). Structured output further enables a Verify -> Reflect -> Probe -> Refine self-evolution loop, which over four rounds on a 7B model surfaces an unexpected structural finding: each round produces a benchmark-specialist, not a generalist (+15 pp on HaluEval, -10 to -14 pp on TruthfulQA in the same model, persistent at 4x data). On ClearFacts, SEVA-3B matches GPT-4o-mini (69.0 vs. 69.8 F1) while producing substantially richer, auditable output -- confirming a principle that should generalize: for any RL task with multi-component generation, reward granularity must match output granularity.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 18 of its 20 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
18 of 20 references.
References · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023Let's Verify Step by Stepcited by 3,598
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 798
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
6 more
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
- 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
- 2023Fine-tuning Language Models for Factualitycited by 219
- 2025RL Tango: Reinforcing Generator and Verifier Together for Language Reasoningcited by 39
- 2025Verifying the Verifiers: Unveiling Pitfalls and Potentials in Fact Verifierscited by 12
- 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucinationcited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Reward-Free Evolving Agents via Pairwise Validator
- 2026Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification
- 2026SEVerA: Verified Synthesis of Self-Evolving Agents
- 2026Self-Modifying Lean Proof Agents with Verifier-Grounded Benchmark Coevolution
- 2026Scaling the Scaling Logic: Agentic Meta-Synthesis of Logic Reasoning
- 2026The Verification Horizon: No Silver Bullet for Coding Agent Rewards
- 2026Verify Before You Commit: Towards Faithful Reasoning in LLM Agents via Self-Auditing
- 2026DeepFact: Co-Evolving Benchmarks and Agents for Deep Research Factuality