mlsanityData to 14 Oct 2026

Dr.Credit: Rubric-Grounded Process Credit Assignment for Deep Research Agents

arXiv 2609.34296 ↗First posted 28 Sep 2026cs.CL cs.AIcited by 0

New in LLM agents and tool use; no direction yet. LLM agents and tool use

Abstract (arXiv)

Rubric-based tasks are increasingly addressed through reinforcement learning (RL), with rubric scores used as training rewards. However, these rewards typically supervise final answers without distinguishing the contributions of intermediate decisions. Many existing credit assignment methods rely on ground-truth answers to define process rewards, limiting their applicability to open-ended tasks without canonical solutions. To address this limitation, the proposed rubric-grounded credit uses task requirements as a shared reference for final answer evaluation and process supervision. The information returned by tools is assessed for the additional support it provides toward satisfying each rubric relative to that rubric's history of accepted support. By referencing these histories, credit distinguishes new support from evidence already present in the trajectory while recognizing partial support for each rubric. Dr.Credit uses rubric-grounded credit to supervise intermediate tool turns in an RL framework for deep research agents. The resulting process advantages are combined with GRPO outcome advantages to guide research decisions while retaining supervision of final-report quality. Evaluations on four in-domain and out-of-domain benchmarks show that Dr.Credit outperforms the evaluated open deep research baselines on every primary metric and submetric. Meanwhile, with an 8B-parameter backbone, the trained agent achieves average performance competitive with the evaluated frontier proprietary models. Further analyses suggest more efficient evidence acquisition and higher-quality reports under limited research-turn budgets, motivating the extension of rubric-grounded process supervision to a broader range of rubric-based tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 35 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

31 of 35 references.

References · 31

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 2,026
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  6. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  7. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  8. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
  9. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
  10. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
  11. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  12. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
19 more
  1. 2018RUDDER: Return Decomposition for Delayed Rewardscited by 173
  2. 2025Checklists Are Better Than Reward Models For Aligning Language Modelscited by 128
  3. 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
  4. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
  5. 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 92
  6. 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 84
  7. 2026Hindsight Credit Assignment for Long-Horizon LLM Agentscited by 65
  8. 2026Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Taskscited by 62
  9. 2025ResearchQA: Evaluating Scholarly Question Answering at Scale Across 75 Fields with Survey-Mined Questions and Rubricscited by 49
  10. 2025Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agentscited by 48
  11. 2026TIPS: Turn-Level Information-Potential Reward Shaping for Search-Augmented LLMscited by 24
  12. 2026Learning Query-Specific Rubrics from Human Preferences for DeepResearch Report Generationcited by 18
  13. 2026RubricEM: Meta-RL with Rubric-guided Policy Decomposition beyond Verifiable Rewardscited by 12
  14. 2026QUEST: Training Frontier Deep Research Agents with Fully Synthetic Taskscited by 11
  15. 2026Intrinsic Credit Assignment for Long Horizon Interactioncited by 9
  16. 2026LOTAPO: Leave-One-Turn Attribution for Self-Generated Process Rewards in Multi-Turn Search Reasoningcited by 5
  17. 2026DEEPRUBRIC: Evidence-Tree Rubric Supervision for Efficient Reinforcement Learning of Deep Research Agentscited by 4
  18. 2026ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignmentcited by 3
  19. 2026Deep Research as Rubric for Reinforcement Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CoCA: Criterion-Aware Credit Assignment for Rubric-Based Reinforcement Learning
  2. 2026DRACO: Fine-Grained Credit Assignment with Dynamic Rubrics for Long-Horizon Agent Training
  3. 2026OPD Before RL: Warm-Starting Rubric-Based RL with On-Policy Distillation
  4. 2026Rubric-Grounded RL: Structured Judge Rewards for Generalizable Reasoning
  5. 2025Reinforcement Learning with Rubric Anchors
  6. 2026Step-wise Rubric Rewards for LLM Reasoning
  7. 2026TRCA: Transition-wise Rubric Credit Assignment for Long-horizon LLM Agents
  8. 2026CREDO: Variance-Guided Rubric Evolution for Replay-Corrected Credit Assignment