mlsanityData to 14 Oct 2026

MemoNoveltyAgent: A Historical Research Memory-Aware Agent Workflow for Paper Novelty Assessment

arXiv 2603.20884 ↗First posted 21 Mar 2026cs.CLcited by 1

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

To alleviate the heavy burden of paper screening, researchers increasingly rely on existing AI agents, such as AI reviewers or DeepResearch, for paper evaluation and novelty assessment. However, lacking specialized mechanisms for processing scholarly literature, their analyses often produce superficial results with noticeable deficiencies in quality. To bridge this gap, we introduce MemoNoveltyAgent, a multi-agent system designed to generate comprehensive and faithful novelty reports. Beyond retrieving concrete prior-paper evidence via RAG, our system incorporates a high-level abstract memory constructed from large-scale scholarly corpora. This memory organizes research into hierarchical trees to distill field-specific evolutionary trajectories, thereby providing a broader historical context. Furthermore, we decompose papers into discrete novelty points for fine-grained analysis and retrieval, while employing a self-validation mechanism to improve report faithfulness. Finally, to address the evaluation challenges of such open-ended generation tasks, we propose a RAG-augmented checklist evaluation method that enables reliable and evidence-grounded assessments. Extensive experiments demonstrate that MemoNoveltyAgent outperforms GPT-5 DeepResearch by 13.69%. Code and demo are available at https://github.com/SStan1/MemoNoveltyAgent

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 27 of its 45 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

27 of 45 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Deep Research: A Survey of Autonomous Research Agents18 Aug
  2. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents13 Jun

Other references · 25

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  5. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  6. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  7. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  8. 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 100
  9. 2024CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklistscited by 94
  10. 2024TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generationcited by 68
  11. 2025Large language models for automated scholarly paper review: A surveycited by 61
  12. 2020ReviewRobot: Explainable Paper Review Generation based on Knowledge Synthesiscited by 54
13 more
  1. 2024SciFIBench: Benchmarking Large Multimodal Models for Scientific Figure Interpretationcited by 48
  2. 2024Peer Review as A Multi-Turn and Long-Context Dialogue with Role-Based Interactionscited by 46
  3. 2025Evaluating Scoring Bias in LLM-as-a-Judgecited by 43
  4. 2025Deep Research: A Systematic Surveycited by 27
  5. 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 19
  6. 2025ReviewRL: Towards Automated Scientific Review with RLcited by 19
  7. 2025MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automationcited by 10
  8. 2025AgentInit: Initializing LLM-based Multi-Agent Systems via Diversity and Expertise Orchestration for Effective and Efficient Collaborationcited by 10
  9. 2025SGIC: A Self-Guided Iterative Calibration Framework for RAGcited by 8
  10. 2025REA-RL: Reflection-Aware Online Reinforcement Learning for Efficient Reasoningcited by 6
  11. 2025GraphMind: Interactive Novelty Assessment System for Accelerating Scientific Discoverycited by 5
  12. 2025AQuilt: Weaving Logic and Self-Inspection into Low-Cost, High-Relevance Data Synthesis for Specialist LLMscited by 4
  13. 2025Multimodal Peer Review Simulation with Actionable To-Do Recommendations for Community-Aware Manuscript Revisionscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenNovelty: An LLM-powered Agentic System for Verifiable Scholarly Novelty Assessment
  2. 2026Novelty-Aware Agentic Retrieval: Comparing Research Contributions Through Structured Multi-Step Reasoning
  3. 2026ScholarQuest: A Taxonomy-Guided Benchmark for Agentic Academic Paper Search in Open Literature Environments
  4. 2025NoveltyRank: A Retrieval-Augmented Framework for Conceptual Novelty Estimation in AI Research
  5. 2025Evaluating Novelty in AI-Generated Research Plans Using Multi-Workflow LLM Pipelines
  6. 2026AutoSci: A Memory-Centric Agentic System for the Full Scientific Research Lifecycle
  7. 2025Open-Source Agentic Hybrid RAG Framework for Scientific Literature Review
  8. 2026Towards Automating Scientific Review with Google's Paper Assistant Tool