mlsanityData to 14 Oct 2026

OmniVCBench: Benchmarking Evidence-Grounded Multimodal Reasoning Towards AI Virtual Cells

arXiv 2609.37773 ↗First posted 29 Sep 2026cs.AI q-bio.QMcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Artificial Intelligence Virtual Cells (AIVCs) are envisioned as scientific agents that simulate cellular responses, explain underlying mechanisms, and support hypothesis-driven discovery. Existing AIVC benchmarks, however, operate primarily at the simulation layer, motivating complementary evaluation of how models interpret experimental evidence and formulate biological hypotheses. We introduce OmniVCBench, a figure-centric, source-traceable benchmark for the interpretation component of an AIVC. It contains 6,077 curated single- and multi-subfigure question--answer pairs derived from figures and experimental contexts in the scientific literature. Guided by Bloom's taxonomy, we instantiate interpretation-layer counterparts of the AIVC Predict--Explain--Discover agenda through three scientific reasoning tasks. We further introduce AIVC-Judge, a task-conditioned MLLM-as-a-judge framework with category-specific, reference-aware rubrics for evaluating open-ended responses. A complementary Model-Derived Hard-Negative Mining (MDHNM) strategy converts plausible errors observed during model inference into MCQ distractors for lower-cost evaluation. Within the evaluated heterogeneous model pool, MCQ accuracy correlates positively with AIVC-Judge scores, providing a complementary view of performance alongside open-response evaluation. Code and data demo are available at https://anonymous.4open.science/r/OmniVCBench.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 15 of its 65 references that are in the map. First posted on arXiv 29 Sep 2026.

Builds on

15 of 65 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026SC-Arena: A Natural Language Benchmark for Single-Cell Reasoning with Knowledge-Augmented Evaluation26 Feb

Other references · 14

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  7. 2025SmolVLM: Redefining small and efficient multimodal modelscited by 237
  8. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
  9. 2024HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scalecited by 200
  10. 2026GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agentscited by 34
  11. 2024MMSci: A Dataset for Graduate-Level Multi-Discipline Multimodal Scientific Understandingcited by 24
  12. 2026LABBench2: An Improved Benchmark for AI Systems Performing Biology Researchcited by 8
2 more
  1. 2025Virtual Cells: Predict, Explain, Discovercited by 7
  2. 2025HiSciBench: A Hierarchical Multi-disciplinary Benchmark for Scientific Intelligence from Reading to Discoverycited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research
  2. 2026Sci-MMR: Benchmarking Multi-Step Evidence-Grounded Scientific Reasoning in Multimodal Agents
  3. 2026Towards Autonomous Mechanistic Reasoning in Virtual Cells
  4. 2026S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation
  5. 2026HeurekaBench: A Benchmarking Framework for AI Co-scientist
  6. 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
  7. 2025CSVQA: A Chinese Multimodal Benchmark for Evaluating STEM Reasoning Capabilities of VLMs
  8. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Research