mlsanityData to 14 Oct 2026

MedPixel: A Unified Pixel-Language Model for Medical Reasoning and Segmentation

arXiv 2608.09818 ↗First posted 10 Aug 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Reliable medical image understanding requires models to connect clinical language and visual reasoning with pixel-level grounding. Yet medical vision-language models often lack precise localization, whereas medical segmenters typically rely on explicit target categories or precise spatial prompts. This divide is reinforced by a supervision mismatch: segmentation datasets provide precise masks but little language supervision, whereas medical vision-language data rarely pair language with dense spatial annotations. To address this gap, we present MedPixel, a unified medical pixel-language model built around a shared language--mask interface. To provide scalable supervision, we introduce MedPLG-440K, comprising approximately 440K pixel-language task samples constructed through a clinically motivated synthesis process without external LLM annotation. MedPixel is trained with joint multi-task supervised fine-tuning followed by Pixel-Level Preference Optimization, which uses ground-truth masks as offline verifiers to derive response preferences from mask quality. MedPixel supports a broad spectrum of tasks spanning explicit grounding, implicit reasoning, spatial interaction, grounded explanation, and medical VQA. Across this task spectrum, MedPixel achieves strong performance in both pixel-level prediction and response generation, together with effective zero-shot transfer to external grounding benchmarks and robustness to imperfect spatial prompts. Code and model checkpoints will be released at https://github.com/yhy-whu/Medpixel.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 14 of its 38 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

14 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025MedSeg-R: Reasoning Segmentation in Medical Images with Multimodal Large Language Models12 Jun
  2. 2025Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision Support25 Feb
  3. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMs25 Dec

Other references · 11

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025MedGemma Technical Reportcited by 436
  3. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  4. 2024MAIRA-2: Grounded Radiology Report Generationcited by 145
  5. 2023SAM-Med2Dcited by 124
  6. 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 111
  7. 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 96
  8. 2023LISA++: An Improved Baseline for Reasoning Segmentation with Large Language Modelcited by 71
  9. 2025UniBiomed: A Universal Foundation Model for Grounded Biomedical Image Interpretationcited by 10
  10. 2025Citrus-V: Advancing Medical Foundation Models with Unified Medical Image Grounding for Clinical Reasoningcited by 8
  11. 2025Med-GLIP: Advancing Medical Language-Image Pre-training with Large-scale Grounded Datasetcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentation
  2. 2025MedReasoner: Reinforcement Learning Drives Reasoning Grounding from Clinical Thought to Pixel-Level Precision
  3. 2026MedSIGHT: Towards Grounded Visual Comprehension in Medical Large Vision-Language Models
  4. 2026From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation
  5. 2026MedUP: Awakening Unified Understanding and Perception in Medical Vision-Language Models
  6. 2026MedVL-SAM2: A unified 3D medical vision-language model for multimodal reasoning and prompt-driven segmentation
  7. 2026MedGround: Bridging the Evidence Gap in Medical Vision-Language Models with Verified Grounding Data
  8. 2025MedCLM: Learning to Localize and Reason via a CoT-Curriculum in Medical Vision-Language Models