From Macro to Micro: Benchmarking Microscopic Spatial Intelligence on Molecules via Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
This paper introduces the concept of Microscopic Spatial Intelligence (MiSI), the capability to perceive and reason about the spatial relationships of invisible microscopic entities, which is fundamental to scientific discovery. To assess the potential of Vision-Language Models (VLMs) in this domain, we propose a systematic benchmark framework MiSI-Bench. This framework features over 163,000 question-answer pairs and 587,000 images derived from approximately 4,000 molecular structures, covering nine complementary tasks that evaluate abilities ranging from elementary spatial transformations to complex relational identifications. Experimental results reveal that current state-of-the-art VLMs perform significantly below human level on this benchmark. However, a fine-tuned 7B model demonstrates substantial potential, even surpassing humans in spatial transformation tasks, while its poor performance in scientifically-grounded tasks like hydrogen bond recognition underscores the necessity of integrating explicit domain knowledge for progress toward scientific AGI. The datasets are available at https://huggingface.co/datasets/zongzhao/MiSI-bench.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 50 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
26 of 50 references.
References · 26
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
14 more
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 188
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 138
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 95
- 2022Conditional Antibody Design as 3D Equivariant Graph Translationcited by 75
- 2020ATOM3D: Tasks On Molecules in Three Dimensionscited by 74
- 2025OneThinker: All-in-one Reasoning Model for Image and Videocited by 56
- 2025LEGO-Puzzles: How Good Are MLLMs at Multi-Step Spatial Reasoning?cited by 49
- 2025Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learningcited by 37
- 2023DrugCLIP: Contrastive Protein-Molecule Representation Learning for Virtual Screeningcited by 28
- 2023Generalist Equivariant Transformer Towards 3D Molecular Interaction Learningcited by 19
- 2024Structure-based drug design by denoising voxel gridscited by 19
- 2024Towards Foundation Models for 3D Vision: How Close Are We?cited by 13
- 2024An Equivariant Pretrained Transformer for Unified 3D Molecular Representation Learningcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MolSight: A Graph-Aware Vision-Language Model for Unified Chemical Image Understanding
- 2024Probing the limitations of multimodal language models for chemistry and materials research
- 2024μ-Bench: A Vision-Language Benchmark for Microscopy Understanding
- 2025TinyChemVL: Advancing Chemical Vision-Language Models via Efficient Visual Token Reduction and Complex Reaction Tasks
- 2026Benchmarking Vision-Language Models for Microscopic Plant Image Understanding
- 2024nach0-pc: Multi-task Language Model with Molecular Point Cloud Encoder
- 2026DISSECT: Diagnosing Where Vision Ends and Language Priors Begin in Scientific VLMs
- 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research