mlsanityData to 14 Oct 2026

Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures

arXiv 2609.00663 ↗First posted 1 Sep 2026cs.CV cond-mat.mtrl-sci physics.chem-phcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal evaluations cannot say whether a vision-language model misread an image or misreasoned about it, because every existing method for separating the two places a second model in the loop. We introduce the render ceiling, a model-free reference for benchmarks built by rendering known objects: inverting the frozen cameras and re-solving cross-view correspondence recovers exactly the answer the images support. We prove the ceiling fails only through an enumerable set of projection coincidences and certify that set empty on 2,160 rendered crystal structures, so every point of a model's deficit belongs to the model. Across fourteen vision-language models, supplying exact geometry as text lifts every model yet closes under half the gap for thirteen, while a supervised vision model with no language component reads the same images at 0.8952, above every vision-language model. The instrument exposes extraction-stage fabrication that downstream accuracy would misattribute to reasoning, yields camera-placement rules for benchmark builders, and transfers to any benchmark with an invertible forward rendering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 45 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

25 of 45 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Visual Access Boundaries in Vision-Language Model Reasoning14 Jul
  2. 2026From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models19 May
  3. 2026Grounding the Score: Explicit Visual Premise Verification for Reliable Vision-Language Process Reward Models17 Mar
  4. 2025Your Reasoning Benchmark May Not Test Reasoning: Revealing Perception Bottleneck in Abstract Reasoning Benchmarks24 Dec
  5. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
  6. 2025What MLLMs Learn about When they Learn about Multimodal Reasoning2 Oct
  7. 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models30 Sep
  8. 2024Visually Descriptive Language Model for Vector Graphics Reasoning9 Apr

Other references · 17

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  4. 2020MVTN: Multi-View Transformation Network for 3D Shape Recognitioncited by 140
  5. 2023Identifiability Results for Multimodal Contrastive Learningcited by 61
  6. 2025ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Modelscited by 58
  7. 2024VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception of Geometric Informationcited by 39
  8. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMscited by 16
  9. 2025Native Visual Understanding: Resolving Resolution Dilemmas in Vision-Language Modelscited by 11
  10. 2025Res-Bench: Benchmarking the Robustness of Multimodal Large Language Models to Dynamic Resolution Inputcited by 9
  11. 2020CRYSPNet: Crystal Structure Predictions via Neural Networkcited by 7
  12. 2026Chain-of-Thought Degrades Visual Spatial Reasoning Capabilities of Multimodal LLMscited by 6
5 more
  1. 2025Stress-Testing Multimodal Foundation Models for Crystallographic Reasoningcited by 4
  2. 2026Unsolvability Ceiling in Multi-LLM Routing: An Empirical Study of Evaluation Artifactscited by 4
  3. 2026CrystalXRD-Bench: Benchmarking Vision-Language Models for XRD Peak Indexing Across Diverse Crystalline Materialscited by 2
  4. 2024Designing a Dataset for Convolutional Neural Networks to Predict Space Groups Consistent with Extinction Lawscited by 1
  5. 2025M3-Verse: A "Spot the Difference" Challenge for Large Multimodal Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Do Vision-Language Models Understand 3D Scenes or Just Catalogue Objects?
  2. 2026Do Vision-Language Models Truly Perform Vision Reasoning? A Rigorous Study of the Modality Gap
  3. 2026Grid2Matrix: Revealing Digital Agnosia in Vision-Language Models
  4. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models
  5. 2024JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images
  6. 2026The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models
  7. 2026Seeing without Looking: Do Vision-Language Benchmarks Really Test Vision?
  8. 2023Synthesize, Diagnose, and Optimize: Towards Fine-Grained Vision-Language Understanding