InternReviewer & InternAdvocate: Objective Reward and Evaluation for Agentic Reinforcement Learning in Peer Review and Rebuttal
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Generating professional scholarly content, such as peer reviews and rebuttals, requires an intricate synergy between domain reasoning and factual grounding. This work presents a comprehensive framework for the development and evaluation of specialized scholarly agents, InternReviewer and InternAdvocate. We first establish a large-scale, high-quality scholarly dataset and integrate a high-efficiency arXiv retrieval tool to enable active evidence gathering. To optimize these agents, we implement an agentic Reinforcement Learning (RL) paradigm driven by a unified objective metric and reward system. This system avoids the biases of subjective model-based judging by employing multi-dimensional criteria, including reference-anchored semantic alignment, structural compliance, and a strict verification mechanism that cross-checks citations against real-time interaction logs to eliminate hallucinations. Experimental results demonstrate that agents trained within this closed-loop framework exhibit significant improvements in reasoning depth and citation accuracy.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 89 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
37 of 89 references.
Closest ancestors · 3
Same direction, newest first
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
- 2024AgentReview: Exploring Peer Review Dynamics with LLM Agents18 Jun
- 2024MARG: Multi-Agent Review Generation for Scientific Papers8 Jan
Other references · 34
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Qwen Technical Reportcited by 3,344
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025Group Sequence Policy Optimizationcited by 835
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 815
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
22 more
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
- 2023ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewingcited by 122
- 2025MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document Parsingcited by 116
- 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 100
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2025Large language models for automated scholarly paper review: A surveycited by 61
- 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
- 2023GPT4 is Slightly Helpful for Peer-Review Assistance: A Pilot Studycited by 40
- 2025TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Reviewcited by 31
- 2024OpenDataLab: Empowering General Artificial Intelligence with Open Datasetscited by 29
- 2024What Can Natural Language Processing Do for Peer Review?cited by 25
- 2025ReviewEval: An Evaluation Framework for AI-Generated Reviewscited by 25
- 2025Mind the Blind Spots: A Focus-Level Evaluation Framework for LLM Reviewscited by 24
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2025ReviewRL: Towards Automated Scientific Review with RLcited by 19
- 2025OmniScientist: Toward a Co-evolving Ecosystem of Human and AI Scientistscited by 18
- 2025ReviewerToo: Should AI Join The Program Committee? A Look At The Future of Peer Reviewcited by 16
- 2025Pre-Trained Policy Discriminators are General Reward Modelscited by 15
- 2024Evaluating the Predictive Capacity of ChatGPT for Academic Peer Review Outcomes Across Multiple Platformscited by 11
- 2025REMOR: Automated Peer Review Generation with LLM Reasoning and Multi-Objective Reinforcement Learningcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026REM-CTX: Automated Peer Review via Reinforcement Learning with Auxiliary Context
- 2026ScholarPeer: A Context-Aware Multi-Agent Framework for Automated Peer Review
- 2026Benchmarking Agentic Review Systems
- 2026Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
- 2026From Passive Generation to Investigation: A Proactive Scientific Peer Review Agent
- 2026Reimagining Peer Review Process Through Multi-Agent Mechanism Design
- 2026ReCite: Agentic Reasoning for Faithful Citation
- 2026EGTR-Review: Efficient Evidence-Grounded Scientific Peer Review Generation via Multi-Agent Teacher Distillation