mlsanityData to 7 Oct 2026

MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution

arXiv 2604.26283 ↗First posted 29 Apr 2026cs.CV cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs caused by discrete tokenization, leading to quantization loss, long-range information dissipation, and missing case-adaptive expertise. To bridge this gap, we propose ours, a framework for latent diagnostic memory evolution that simulates the experiential invocation of clinicians by dynamically synthesizing implicit diagnostic memories within the model's hidden stream. Specifically, it begins with a Meta Query for Prior Memorization mechanism, where learnable probes retrieve structured priors from an anatomical prior encoder to generate condensed implicit memories. To ensure clinical fidelity, we introduce Causal Counterfactual Refinement (CCR), which leverages reinforcement learning and counterfactual rewards derived from region-level feature masking to quantify the causal contribution of each memory, thereby pruning redundancies and aligning latent representations with diagnostic logic. This evolutionary process culminates in Intrinsic Memory Transition (IMT), a privileged-autonomous dual-branch paradigm that internalizes teacher-branch diagnostic patterns into the student-branch via full-vocabulary divergence alignment. Comprehensive empirical evaluations across multiple datasets demonstrate that ours, by transferring external expertise into endogenous parameters, significantly outperforms existing state-of-the-art methods, particularly chain-of-thought paradigms, in diagnostic accuracy. The code is available at https://github.com/zhcz328/MedSynapse-V.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 146 of its 220 references that are in the map. First posted on arXiv 29 Apr 2026.

Builds on

146 of 220 references.

References · 146

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2025Qwen3-VL Technical Reportcited by 2,534
  9. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  11. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  12. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
38 more
  1. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  2. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
  3. 2025MedGemma Technical Reportcited by 398
  4. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
  5. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
  6. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
  7. 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
  8. 2025CODI: Compressing Chain-of-Thought into Continuous Space via Self-Distillationcited by 216
  9. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  10. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
  11. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 172
  12. 2023SAM-Med2Dcited by 123
  13. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 122
  14. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
  15. 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 108
  16. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphscited by 105
  17. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
  18. 2024GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AIcited by 96
  19. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 96
  20. 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 89
  21. 2025MedRAG: Enhancing Retrieval-augmented Generation with Knowledge Graph-Elicited Reasoning for Healthcare Copilotcited by 83
  22. 2025Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chainscited by 81
  23. 2024Parameter Competition Balancing for Model Mergingcited by 71
  24. 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Modelscited by 58
  25. 2024Detecting and Evaluating Medical Hallucinations in Large Vision Language Modelscited by 57
  26. 2024VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledgecited by 50
  27. 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
  28. 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 40
  29. 2025GMAI-VL-R1: Harnessing Reinforcement Learning for Multimodal Medical Reasoningcited by 39
  30. 2025SoftCoT++: Test-Time Scaling with Soft Chain-of-Thought Reasoningcited by 38
  31. 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Modelcited by 33
  32. 2025MedEyes: Learning Dynamic Visual Focus for Medical Progressive Diagnosiscited by 32
  33. 2025VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Modelscited by 31
  34. 2025Fine-Grained Preference Optimization Improves Spatial Reasoning in VLMscited by 30
  35. 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Modelscited by 29
  36. 2025SpaceDrive: Infusing Spatial Awareness into VLM-based Autonomous Drivingcited by 28
  37. 2026MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methodscited by 27
  38. 2024CoMT: Chain-of-Medical-Thought Reduces Hallucination in Medical Report Generationcited by 25

50 most cited of 146 All 146 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 12.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MedExpMem: Adapting Experience Memory for Differential Diagnosis
  2. 2026MSM-Mem: A Universal Medical Structured Multimodal Memory Framework for Medical AI Agents
  3. 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery
  4. 2026Making medical vision-language models think causally across modalities with retrieval-augmented cross-modal reasoning
  5. 2026SAGEAgent: A Self-Evolving Agent for Cost-Aware Modality Acquisition in Multimodal Survival Prediction
  6. 2026Evo-MedAgent: Beyond One-Shot Diagnosis with Agents That Remember, Reflect, and Improve
  7. 2026MIRA: Medical Image Reflection for Agentic Diagnosis
  8. 2025Embeddings to Diagnosis: Latent Fragility under Agentic Perturbations in Clinical LLMs