mlsanityData to 7 Oct 2026

MedLVR: Latent Visual Reasoning for Reliable Medical Visual Question Answering

arXiv 2604.09757 ↗First posted 10 Apr 2026cs.CV cs.AIcited by 1

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is dominated by language. This paradigm is fundamentally limited in clinical scenarios, where accurate answers often depend on subtle, localized visual evidence that cannot be reliably preserved in static embeddings. We propose textscMedLVR, a latent visual reasoning framework that introduces an explicit visual evidence state into autoregressive decoding. Instead of relying solely on text-based intermediate reasoning, textscMedLVR interleaves a short latent reasoning segment within the decoder by reusing hidden states as continuous latent steps, enabling iterative preservation and refinement of query-relevant visual evidence before answer generation. To support effective visual supervision, we adopt a two-stage training strategy: region of interest (ROI)-supervised fine-tuning aligns latent states with clinically relevant image evidence, and Visual-Latent Policy Optimization (VLPO) further optimizes latent reasoning and answer generation under outcome-level rewards. Experiments on OmniMedVQA and five external medical VQA benchmarks show that textscMedLVR consistently outperforms recent reasoning baselines and improves the average score over the Qwen2.5-VL-7B backbone from 48.3% to 53.4%. These results show that latent visual reasoning provides an effective mechanism for preserving diagnostically relevant visual evidence and improving the reliability of medical VQA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 45 of its 55 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

45 of 55 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026MEDVISTAGYM: A Scalable Training Environment for Thinking with Medical Images via Tool-Integrated Reinforcement Learning12 Jan
  2. 2025Think Twice to See More: Iterative Visual Reasoning in Medical VLMs11 Oct
  3. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning8 Jun
  4. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learning26 Feb

Other references · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  10. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  11. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  12. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
29 more
  1. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  2. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 740
  3. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  4. 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
  5. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  6. 2023OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocationcited by 468
  7. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
  8. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
  9. 2025MedGemma Technical Reportcited by 398
  10. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  11. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
  12. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 364
  13. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
  14. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  15. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  16. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  17. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  18. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
  19. 2024Compressed Chain of Thought: Efficient Reasoning Through Dense Representationscited by 192
  20. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  21. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
  22. 2024Why are Visually-Grounded Language Models Bad at Image Classification?cited by 101
  23. 2025Latent Visual Reasoningcited by 99
  24. 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
  25. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 81
  26. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 75
  27. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 68
  28. 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
  29. 2024GEMeX: A Large-Scale, Groundable, and Explainable Medical VQA Benchmark for Chest X-ray Diagnosiscited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering
  2. 2026Do Medical Vision Language Models Actually See? A Counterfactual Grounding Framework and Hard-Negative Contrastive Training for Visually-Reliant Medical VLMs
  3. 2026InViC: Intent-aware Visual Cues for Medical Visual Question Answering
  4. 2025CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Training
  5. 2023Visual Question Answering in the Medical Domain
  6. 2025Knowing or Guessing? Robust Medical Visual Question Answering via Joint Consistency and Contrastive Learning
  7. 2026MedProb: Probing Internal Representations of Vision-Language Models for Medical Question Answering
  8. 2026Med-R2: An Adversarial Benchmark for Evidence-Grounded Reasoning in Medical VLMs