mlsanityData to 14 Oct 2026

InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal

arXiv 2608.28612 ↗First posted 21 Jul 2026cs.AIcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Generating professional scholarly content, such as peer reviews and rebuttals, requires an intricate synergy between domain reasoning and factual grounding. This work presents a comprehensive framework for the development and evaluation of specialized scholarly agents, InternReviewer and InternAdvocate. We first establish a large-scale, high-quality scholarly dataset and integrate a high-efficiency arXiv retrieval tool to enable active evidence gathering. To optimize these agents, we implement an agentic Reinforcement Learning (RL) paradigm driven by a unified objective metric and reward system. This system avoids the biases of subjective model-based judging by employing multi-dimensional criteria, including reference-anchored semantic alignment, structural compliance, and a strict verification mechanism that cross-checks citations against real-time interaction logs to eliminate hallucinations. Experimental results demonstrate that agents trained within this closed-loop framework exhibit significant improvements in reasoning depth and citation accuracy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 89 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

37 of 89 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
  2. 2024AgentReview: Exploring Peer Review Dynamics with LLM Agents18 Jun
  3. 2024MARG: Multi-Agent Review Generation for Scientific Papers8 Jan

Other references · 34

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2024A Survey on LLM-as-a-Judgecited by 1,423
  7. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  8. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  9. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  10. 2025Group Sequence Policy Optimizationcited by 835
  11. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
  12. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
22 more
  1. 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
  2. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
  3. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  4. 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 122
  5. 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
  6. 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 100
  7. 2021Can We Automate Scientific Reviewing?cited by 63
  8. 2025Large language models for automated scholarly paper review: A surveycited by 61
  9. 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
  10. 2023GPT4 is Slightly Helpful for Peer-Review Assistance: A Pilot Studycited by 40
  11. 2025TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Reviewcited by 31
  12. 2024OpenDataLab: Empowering General Artificial Intelligence with Open Datasetscited by 29
  13. 2024What Can Natural Language Processing Do for Peer Review?cited by 25
  14. 2025ReviewEval: An Evaluation Framework for AI-Generated Reviewscited by 25
  15. 2025Mind the Blind Spots: A Focus-Level Evaluation Framework for LLM Reviewscited by 24
  16. 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
  17. 2025ReviewRL: Towards Automated Scientific Review with RLcited by 19
  18. 2025OmniScientist: Toward a Co-evolving Ecosystem of Human and AI Scientistscited by 18
  19. 2025ReviewerToo: Should AI Join The Program Committee? A Look At The Future of Peer Reviewcited by 16
  20. 2025Pre-Trained Policy Discriminators are General Reward Modelscited by 15
  21. 2024Evaluating the Predictive Capacity of ChatGPT for Academic Peer Review Outcomes Across Multiple Platformscited by 11
  22. 2025REMOR: Automated Peer Review Generation with LLM Reasoning and Multi-Objective Reinforcement Learningcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026REM-CTX: Automated Peer Review via Reinforcement Learning with Auxiliary Context
  2. 2026ScholarPeer: A Context-Aware Multi-Agent Framework for Automated Peer Review
  3. 2026Benchmarking Agentic Review Systems
  4. 2026Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
  5. 2026From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent
  6. 2026Reimagining Peer Review Process Through Multi-Agent Mechanism Design
  7. 2026ReCite: Agentic Reasoning for Faithful Citation
  8. 2026EGTR-Review: Efficient Evidence-Grounded Scientific Peer Review Generation via Multi-Agent Teacher Distillation