mlsanityData to 7 Oct 2026

FMMD: A multimodal multidisciplinary dataset of open peer reviews from F1000Research

arXiv 2602.14285 ↗First posted 15 Feb 2026cs.DL cs.AI cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Automated scholarly paper review (ASPR) has entered the coexistence phase with traditional peer review, where artificial intelligence (AI) systems are increasingly incorporated into real-world manuscript evaluation. In parallel, research on automated and AI-assisted peer review has proliferated. Despite this momentum, empirical progress remains constrained by several critical limitations in existing datasets. While reviewers routinely evaluate figures, tables, and complex layouts to assess scientific claims, most existing datasets remain overwhelmingly text-centric. This bias is reinforced by a narrow focus on data from computer science publications. Furthermore, existing datasets rarely preserve precise alignment between review comments and specific manuscript versions, obscuring the iterative relationship between peer review and manuscript evolution. In response, we introduce FMMD, a multimodal and multidisciplinary open peer review dataset curated from F1000Research. The dataset addresses the current limitations by integrating manuscript-level visual and structural data with version-specific reviewer reports and editorial decisions. By explicitly aligning review comments with the exact article version under review, FMMD enables granular analysis of the peer review lifecycle. Importantly, its coverage of F1000Research extends ASPR research beyond its traditional focus on computer science to a diverse range of scientific disciplines. FMMD supports a range of research tasks, including visual-semantic consistency classification, figure-related review comment generation, and editorial decision prediction based on multimodal manuscript inputs, thereby providing a comprehensive empirical resource for developing and evaluating multimodal ASPR systems and advancing peer review research.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 15 Feb 2026.

Builds on

30 of 45 references.

References · 30

  1. 2023A Survey on Multimodal Large Language Modelscited by 898
  2. 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
  3. 2024ChartMimic: Evaluating LMM's Cross-Modal Reasoning Capability via Chart-to-Code Generationcited by 118
  4. 2025DeepReview: Improving LLM-based Paper Review with Human-like Deep Thinking Processcited by 97
  5. 2024LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewingcited by 62
  6. 2025Large language models for automated scholarly paper review: A surveycited by 59
  7. 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 41
  8. 2024Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysiscited by 33
  9. 2022MOPRD: A multidisciplinary open peer review datasetcited by 32
  10. 2025TreeReview: A Dynamic Tree of Questions Framework for Deep and Efficient LLM-based Scientific Peer Reviewcited by 31
  11. 2024SciLitLLM: How to Adapt LLMs for Scientific Literature Understandingcited by 29
  12. 2023SciCap+: A Knowledge Augmented Dataset to Study the Challenges of Scientific Figure Captioningcited by 24
18 more
  1. 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understandingcited by 23
  2. 2025ReviewEval: An Evaluation Framework for AI-Generated Reviewscited by 22
  3. 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
  4. 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Paperscited by 16
  5. 2025Unveiling the Merits and Defects of LLMs in Automatic Review Generation for Scientific Paperscited by 12
  6. 2023ACL-Fig: A Dataset for Scientific Figure Classificationcited by 10
  7. 2024cPAPERS: A Dataset of Situated and Multimodal Interactive Conversations in Scientific Paperscited by 10
  8. 2025MMReview: A Multidisciplinary and Multimodal Benchmark for LLM-Based Peer Review Automationcited by 9
  9. 2024Uni-SMART: Universal Science Multimodal Analysis and Research Transformercited by 7
  10. 2024RelevAI-Reviewer: A Benchmark on AI Reviewers for Survey Paper Relevancecited by 6
  11. 2025Identifying Aspects in Peer Reviewscited by 4
  12. 2025AI-Driven Scholarly Peer Review via Persistent Workflow Prompting, Meta-Prompting, and Meta-Reasoningcited by 4
  13. 2025What Drives Paper Acceptance? A Process-Centric Analysis of Modern Peer Reviewcited by 4
  14. 2025Gen-Review: A Large-scale Dataset of AI-Generated (and Human-written) Peer Reviewscited by 3
  15. 2025LLM Context Conditioning and PWP Prompting for Multimodal Validation of Chemical Formulascited by 2
  16. 2025Multi-Agent LLMs for Generating Research Limitationscited by 2
  17. 2024Inconsistencies in TeX-Produced Documentscited by 1
  18. 2024AceParse: A Comprehensive Dataset with Diverse Structured Texts for Academic Literature Parsingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.